-- Logs begin at Wed 2021-11-24 03:31:05 UTC, end at Wed 2021-11-24 04:26:04 UTC. -- Nov 24 04:00:47.996300 dv-neutron-819049-1-hyperv systemd[1]: Started Devstack devstack@q-svc.service. Nov 24 04:00:50.716681 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.common.config [-] Logging enabled! Nov 24 04:00:50.717295 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev224 Nov 24 04:00:50.717467 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103271) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 04:00:50.720649 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.common.config [-] Logging enabled! Nov 24 04:00:50.720907 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev224 Nov 24 04:00:50.721226 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103271) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 04:00:50.722168 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 04:00:50.722415 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 04:00:50.722777 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 04:00:50.723026 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 04:00:50.723277 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 04:00:50.723602 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.724027 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 24 04:00:50.724341 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.724637 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.724932 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.725225 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.725515 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.725796 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.726084 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.726406 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.726698 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.726979 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.727263 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.727556 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.727839 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.728127 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.728415 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.728700 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.728983 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.729418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.729830 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.730108 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.730420 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.730707 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.730978 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.731260 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.731544 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.731873 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] host = dv-neutron-819049-1-hyperv {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.732150 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.732439 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.732728 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.733014 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.733292 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.733566 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.733851 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.734123 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.734429 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.734703 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.734992 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.735278 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.735567 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.735791 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.736012 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.736297 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.736584 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.736859 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.737132 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.737404 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.737678 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.737951 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.738240 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.738529 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.738814 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.739615 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.739890 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.740162 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.740434 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.740706 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.740990 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.741264 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.741539 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.741817 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.742102 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.742395 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.742670 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.742974 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.743262 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.743546 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.743830 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.744101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.744383 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.744657 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.744931 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.745205 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.745480 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.745752 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.746035 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.746333 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.746610 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.746884 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.747159 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.747446 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:50.747743 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.748043 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.748345 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.748631 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.748942 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.749481 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.749778 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.750065 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.750386 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.750680 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.750971 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.751256 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.751547 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.751834 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.752130 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.752436 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.752730 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.753022 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.753301 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.753578 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.753856 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.754138 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.754449 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.755336 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.755633 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.755927 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.756209 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.756508 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.756795 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.757091 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.757380 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.757656 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.757939 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.758262 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.758546 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.758821 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.759103 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.759392 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.759671 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.759945 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.760230 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.760507 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.760782 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.761057 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.761336 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.761630 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.761916 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.762220 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.762497 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.762778 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.763049 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.763332 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.763612 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.763887 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.764162 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.764442 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.764714 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.764987 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.765265 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.765536 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.765815 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.766088 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.766384 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.766659 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.766932 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.767202 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.767471 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.767744 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.768022 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.768292 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.768564 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.768835 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.769105 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.769377 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.769664 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.769961 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.770304 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.770582 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.770862 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.771140 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.771416 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.771696 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.771972 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.772247 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.772516 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.772804 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.773085 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.773367 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.773649 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.773948 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.774271 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.774547 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.774826 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.775102 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.775374 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.775656 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.775940 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.776232 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.776523 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.776813 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.777102 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.777392 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.777668 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.777972 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.778271 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:50.778491 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 04:00:50.778729 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=103271) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 24 04:00:51.206474 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 04:00:51.206754 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 04:00:51.207061 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 04:00:51.207396 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 24 04:00:51.525770 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.526064 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.526362 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.527523 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.527812 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.528192 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.563722 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.563998 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.564264 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.578528 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.578816 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.579084 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.607269 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.607551 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.607818 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.645300 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.645582 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.645854 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.888632 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.889233 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.889233 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.889398 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.890051 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.988485 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.988837 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.989125 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.989399 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.989667 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.989980 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.990268 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.990531 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.990789 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.991076 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.991338 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.991604 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.991862 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.992125 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.992384 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.992651 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.992909 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.993177 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.993448 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.993711 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.993985 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.994263 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.994548 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.994928 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.995180 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.995429 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:51.995824 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:51.996064 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:51.996299 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:51.996533 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:51.996765 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:51.996998 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:51.997358 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 24 04:00:52.000693 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 24 04:00:52.004656 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 24 04:00:52.008399 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(150, 199)])]) Nov 24 04:00:52.010186 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 24 04:00:52.010648 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 24 04:00:52.010984 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 24 04:00:52.011368 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 24 04:00:52.014203 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 24 04:00:52.014457 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 24 04:00:52.014802 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 04:00:52.020027 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 24 04:00:52.043350 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 24 04:00:52.043804 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.044101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=103271) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Nov 24 04:00:52.044462 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.045818 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=103271) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 24 04:00:52.046100 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 04:00:52.046372 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 24 04:00:52.050776 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.051063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.114229 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 24 04:00:52.114471 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 24 04:00:52.114708 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 24 04:00:52.115074 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 24 04:00:52.135139 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 04:00:52.671144 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing driver for type 'gre' Nov 24 04:00:52.671736 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] gre ID ranges: [(1, 1000)] Nov 24 04:00:52.722191 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing driver for type 'local' Nov 24 04:00:52.722540 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing driver for type 'vlan' Nov 24 04:00:52.735624 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] VlanTypeDriver initialization complete Nov 24 04:00:52.736042 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing driver for type 'vxlan' Nov 24 04:00:52.736532 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] vxlan ID ranges: [(1, 1000)] Nov 24 04:00:52.788377 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing extension driver 'port_security' Nov 24 04:00:52.788730 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.extensions.port_security [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] PortSecurityExtensionDriver initialization complete Nov 24 04:00:52.789078 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing mechanism driver 'openvswitch' Nov 24 04:00:52.789413 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing mechanism driver 'hyperv' Nov 24 04:00:52.795992 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.plugin [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103271) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:00:52.796671 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.797052 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.797421 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.797961 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=103271) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 04:00:52.798432 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.798794 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.799149 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.799555 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=103271) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 04:00:52.799972 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.800331 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.800683 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.801083 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=103271) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 04:00:52.801528 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > security_group after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.801886 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > security_group after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.802290 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > security_group after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.802829 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=103271) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 04:00:52.803255 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.803661 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.804204 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.804616 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=103271) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 04:00:52.805034 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > address_group after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.805392 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > address_group after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.805742 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > address_group after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.806163 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=103271) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 04:00:52.806557 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] ML2 OVO RPC backend initialized. {{(pid=103271) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 24 04:00:52.807272 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.807634 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.808058 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.808418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > networks before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.808776 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.809126 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > ports before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.809482 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.809829 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnets before_response 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.810205 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.810559 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.810901 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.811243 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.811587 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.811926 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.812270 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.812615 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.812956 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.813541 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.plugin [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Modular L2 Plugin initialization complete Nov 24 04:00:52.813878 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading services supported by the core plugin {{(pid=103271) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 24 04:00:52.814233 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.plugins.ml2.managers [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Got port-security extension from driver 'port_security' Nov 24 04:00:52.814707 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.extensions.vlantransparent [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Disabled vlantransparent extension. Nov 24 04:00:52.815199 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103271) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 24 04:00:52.815520 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: router Nov 24 04:00:52.852340 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_interface before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.852742 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_create 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.853123 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router before_create 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.853499 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.853885 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.854278 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_delete 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.854650 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > floatingip after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.855008 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > floatingip after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.855374 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_create 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.855729 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_update 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.856084 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_update 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.856439 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.856805 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_update 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.857227 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_update 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.857607 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.857955 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.858337 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: subnet after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.858693 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.859051 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > port precommit_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.859407 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_create 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.859774 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.860117 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.860484 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router after_update 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.860836 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_delete 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.861198 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_create 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.861575 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.861931 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_update 55549900 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.862332 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > agent after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.862694 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > agent after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.863047 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > network after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.863942 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Tracking information for resource: router configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:52.864287 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Tracking information for resource: floatingip configured {{(pid=103271) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 04:00:52.869323 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.db.l3_agentschedulers_db [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 24 04:00:52.869914 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.870311 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port after_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.870695 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port after_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.871040 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: port after_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.871840 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router before_create 55550100 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.872214 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_delete 55550100 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.872584 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_create 55550100 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.872950 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > router precommit_update 55550100 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.878104 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.provider_configuration [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service providers = [] {{(pid=103271) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 24 04:00:52.878506 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.db.servicetype_db [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103271) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 24 04:00:52.881484 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.service_base [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=103271) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 04:00:52.881843 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.service_base [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=103271) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 04:00:52.882221 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.service_base [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=103271) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 04:00:52.883128 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.services.service_base [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=103271) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 04:00:52.883509 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.services.service_base [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 24 04:00:52.883896 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.884224 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 24 04:00:52.900802 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.901355 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: auto_allocate Nov 24 04:00:52.908476 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: network precommit_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.908864 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: network precommit_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.909409 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.909741 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: tag Nov 24 04:00:52.917896 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.918282 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: timestamp Nov 24 04:00:52.923217 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.923543 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: network_ip_availability Nov 24 04:00:52.931713 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.932114 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.932714 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:52.933691 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.934057 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: flavors Nov 24 04:00:52.940725 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.941069 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading Plugin: revisions Nov 24 04:00:52.945502 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103271) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 04:00:52.945913 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_concurrency.lockutils [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.739s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 04:00:52.946720 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=103271) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 24 04:00:52.947068 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Initializing extension manager. Nov 24 04:00:52.947601 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: __init__.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.947953 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: __pycache__ {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.948294 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.948635 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: address_group.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.949409 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.950007 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: address-group Nov 24 04:00:52.950354 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: address_scope.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.952690 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.953237 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: address-scope Nov 24 04:00:52.953579 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: admin_state_down_before_update.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.954579 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.955112 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: router-admin-state-down-before-update Nov 24 04:00:52.955450 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: agent.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.956170 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.956695 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: agent Nov 24 04:00:52.957030 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: agent_resources_synced.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.958526 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.959054 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: agent-resources-synced Nov 24 04:00:52.959385 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: allowedaddresspairs.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.961212 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.961747 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: allowed-address-pairs Nov 24 04:00:52.962084 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: auto_allocated_topology.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.963219 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.963745 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: auto-allocated-topology Nov 24 04:00:52.964079 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: availability_zone.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.964785 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.965303 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: availability_zone Nov 24 04:00:52.965636 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: availability_zone_filter.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.966612 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.967117 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: availability_zone_filter Nov 24 04:00:52.967449 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: data_plane_status.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.968370 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.968881 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension data-plane-status not supported by any of loaded plugins Nov 24 04:00:52.969211 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: default_subnetpools.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.970161 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.970684 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: default-subnetpools Nov 24 04:00:52.971014 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: dhcpagentscheduler.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.971840 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.972357 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: dhcp_agent_scheduler Nov 24 04:00:52.972689 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: dns.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.974299 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.974819 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension dns-integration not supported by any of loaded plugins Nov 24 04:00:52.975152 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: dns_domain_ports.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.976085 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.976603 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 24 04:00:52.976937 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.977878 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.978424 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 24 04:00:52.978754 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: dvr.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.979441 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.979955 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: dvr Nov 24 04:00:52.980285 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: ecmp_routes.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.981223 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.981738 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 24 04:00:52.982067 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: empty_string_filtering.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.983017 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.983537 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: empty-string-filtering Nov 24 04:00:52.983869 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.984797 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.985315 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 24 04:00:52.985646 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.986603 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.987121 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 24 04:00:52.987452 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: external_net.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.988382 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.988930 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: external-net Nov 24 04:00:52.989261 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: extra_dhcp_opt.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.990219 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.990743 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: extra_dhcp_opt Nov 24 04:00:52.991076 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: extraroute.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.991997 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.992516 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: extraroute Nov 24 04:00:52.992847 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: extraroute_atomic.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.993896 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.994460 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: extraroute-atomic Nov 24 04:00:52.994791 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: filter_validation.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.995466 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.995985 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: filter-validation Nov 24 04:00:52.996313 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: fip_pf_description.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.997242 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.997755 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 24 04:00:52.998082 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: fip_port_details.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:52.999309 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:52.999826 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: fip-port-details Nov 24 04:00:53.000156 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: flavors.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.001418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.001954 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: flavors Nov 24 04:00:53.002332 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.004041 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.004603 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 24 04:00:53.004949 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: floatingip_pools.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.005664 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.006218 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: floatingip-pools Nov 24 04:00:53.006558 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: ip_allocation.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.007500 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.008015 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension ip_allocation not supported by any of loaded plugins Nov 24 04:00:53.008351 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.009285 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.009817 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: ip-substring-filtering Nov 24 04:00:53.010170 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l2_adjacency.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.011128 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.011651 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 24 04:00:53.011986 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.013101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.013630 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: router Nov 24 04:00:53.013968 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3_conntrack_helper.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.016276 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.016814 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 24 04:00:53.017157 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.018101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.018658 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: ext-gw-mode Nov 24 04:00:53.019001 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.019932 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.020974 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: l3-ha Nov 24 04:00:53.021311 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3_flavors.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.022277 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.022798 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: l3-flavors Nov 24 04:00:53.023133 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.024063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.024586 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 24 04:00:53.024921 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: l3agentscheduler.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.025970 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.026524 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: l3_agent_scheduler Nov 24 04:00:53.026859 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: local_ip.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.028665 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.029206 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension local_ip not supported by any of loaded plugins Nov 24 04:00:53.029552 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: logging.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.031086 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.031623 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension logging not supported by any of loaded plugins Nov 24 04:00:53.031961 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: metering.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.032721 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.033312 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: metering Nov 24 04:00:53.033647 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.034790 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.035324 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: metering_source_and_destination_fields Nov 24 04:00:53.036286 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: multiprovidernet.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.037239 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.037768 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: multi-provider Nov 24 04:00:53.038101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: netmtu.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.039067 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.039586 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: net-mtu Nov 24 04:00:53.039918 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: netmtu_writable.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.040857 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.041373 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: net-mtu-writable Nov 24 04:00:53.041705 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: network_availability_zone.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.042417 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.042931 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: network_availability_zone Nov 24 04:00:53.043259 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: network_ip_availability.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.044384 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.044909 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: network-ip-availability Nov 24 04:00:53.045246 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: network_segment_range.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.046021 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.046560 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension network-segment-range not supported by any of loaded plugins Nov 24 04:00:53.046892 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: pagination.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.047892 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.048357 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: pagination Nov 24 04:00:53.048688 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: port_device_profile.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.049626 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.050174 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: port-device-profile Nov 24 04:00:53.050520 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.051484 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.052006 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: port-mac-address-regenerate Nov 24 04:00:53.052338 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.053274 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.053795 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: port-numa-affinity-policy Nov 24 04:00:53.054125 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: port_resource_request.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.055082 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.055598 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension port-resource-request not supported by any of loaded plugins Nov 24 04:00:53.055929 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: port_resource_request_groups.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.056910 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.057428 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 24 04:00:53.057758 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: portbindings.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.058733 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.059259 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: binding Nov 24 04:00:53.059591 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: portbindings_extended.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.060878 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.061404 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: binding-extended Nov 24 04:00:53.061745 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: portsecurity.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.062704 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.063228 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: port-security Nov 24 04:00:53.063562 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: project_id.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.064557 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.064898 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: project-id Nov 24 04:00:53.065230 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: providernet.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.066195 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.066723 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: provider Nov 24 04:00:53.067589 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.071260 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.071796 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos not supported by any of loaded plugins Nov 24 04:00:53.072138 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.073398 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.073928 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 24 04:00:53.074308 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.075272 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.075797 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 24 04:00:53.076134 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_default.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.077072 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.077596 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-default not supported by any of loaded plugins Nov 24 04:00:53.077930 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_fip.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.078630 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.079151 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-fip not supported by any of loaded plugins Nov 24 04:00:53.079485 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_gateway_ip.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.080428 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.080953 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 24 04:00:53.081288 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_port_network_policy.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.082255 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.083388 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 24 04:00:53.083721 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.084789 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.085311 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 24 04:00:53.085645 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_pps_rule.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.086884 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.087412 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-pps not supported by any of loaded plugins Nov 24 04:00:53.087747 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_rule_type_details.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.088679 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.089197 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 24 04:00:53.089527 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: qos_rules_alias.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.090620 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.091146 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 24 04:00:53.091478 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: quota_check_limit.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.092406 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.092931 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: quota-check-limit Nov 24 04:00:53.093265 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: quotasv2.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.094220 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.094568 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: quotas Nov 24 04:00:53.094898 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: quotasv2_detail.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.098324 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.098679 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: quota_details Nov 24 04:00:53.099022 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: rbac.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.100095 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.100636 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: rbac-policies Nov 24 04:00:53.100976 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: rbac_address_group.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.102452 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.102990 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: rbac-address-group Nov 24 04:00:53.103328 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: rbac_address_scope.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.104267 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.104799 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: rbac-address-scope Nov 24 04:00:53.105135 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: rbac_security_groups.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.106062 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.106618 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: rbac-security-groups Nov 24 04:00:53.106954 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: rbac_subnetpool.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.107880 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.108404 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: rbac-subnetpool Nov 24 04:00:53.108738 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: revisionifmatch.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.109668 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.110223 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: revision-if-match Nov 24 04:00:53.110561 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: revisions.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.111684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.112209 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: standard-attr-revisions Nov 24 04:00:53.112544 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: router_availability_zone.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.113227 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.113770 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: router_availability_zone Nov 24 04:00:53.114108 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: routerservicetype.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.115079 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.115600 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension router-service-type not supported by any of loaded plugins Nov 24 04:00:53.115933 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.116952 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.117478 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: security-groups-normalized-cidr Nov 24 04:00:53.117812 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: security_groups_port_filtering.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.118776 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.119302 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: port-security-groups-filtering Nov 24 04:00:53.119638 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.120575 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.121103 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: security-groups-remote-address-group Nov 24 04:00:53.121437 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.122416 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.122944 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: security-groups-shared-filtering Nov 24 04:00:53.123277 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.123877 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 24 04:00:53.124467 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: securitygroup.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.134907 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.135457 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: security-group Nov 24 04:00:53.135800 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: segment.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.136596 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.137119 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension segment not supported by any of loaded plugins Nov 24 04:00:53.137456 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.138443 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.138966 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 24 04:00:53.139299 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: servicetype.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.140417 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.140955 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: service-type Nov 24 04:00:53.141293 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: sorting.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.142331 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.142676 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: sorting Nov 24 04:00:53.143012 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: standard_attr_segment.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.143945 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.144469 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 24 04:00:53.144803 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: standardattrdescription.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.146088 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.146644 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: standard-attr-description Nov 24 04:00:53.146981 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: stateful_security_group.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.147952 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.148479 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: stateful-security-group Nov 24 04:00:53.148812 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: stdattrs_common.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.149397 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 24 04:00:53.149729 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.150712 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.151240 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 24 04:00:53.151571 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: subnet_onboard.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.152665 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.153201 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: subnet_onboard Nov 24 04:00:53.153532 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.154517 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.155045 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 24 04:00:53.155379 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: subnet_service_types.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.156321 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.156848 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: subnet-service-types Nov 24 04:00:53.157179 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: subnetallocation.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.158336 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.158863 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: subnet_allocation Nov 24 04:00:53.159194 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.159872 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.160393 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: subnetpool-prefix-ops Nov 24 04:00:53.160753 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.161706 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.162387 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 24 04:00:53.162723 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: tagging.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.163821 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.164346 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: standard-attr-tag Nov 24 04:00:53.164679 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: timestamp.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.165907 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.166471 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loaded extension: standard-attr-timestamp Nov 24 04:00:53.166808 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: trunk.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.167872 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.168397 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension trunk not supported by any of loaded plugins Nov 24 04:00:53.168733 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: trunk_details.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.169669 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.170226 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension trunk-details not supported by any of loaded plugins Nov 24 04:00:53.170565 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: uplink_status_propagation.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.171514 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.172037 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 24 04:00:53.172370 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Loading extension file: vlantransparent.py {{(pid=103271) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 04:00:53.173056 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103271) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 04:00:53.173621 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 24 04:00:53.176137 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:network Nov 24 04:00:53.176717 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:subnet Nov 24 04:00:53.177130 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 04:00:53.177555 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:port Nov 24 04:00:53.178849 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.179293 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service FLAVORS assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.179909 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.180336 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.180675 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:router Nov 24 04:00:53.181110 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 04:00:53.181608 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service METERING assigned prefix: /metering {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.183111 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:53.183493 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:53.183866 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103271) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:00:53.184871 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 04:00:53.185335 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:security_group Nov 24 04:00:53.185783 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 04:00:53.186440 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service CORE assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.186792 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 04:00:53.187150 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] subnetpool is already registered Nov 24 04:00:53.187595 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service CORE assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.187931 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 04:00:53.188270 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] subnetpool is already registered Nov 24 04:00:53.190593 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.191038 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service FLAVORS assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.191631 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.192594 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.192936 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:router Nov 24 04:00:53.193283 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] router is already registered Nov 24 04:00:53.193700 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 04:00:53.194039 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] floatingip is already registered Nov 24 04:00:53.194536 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service METERING assigned prefix: /metering {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.195214 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 04:00:53.195555 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] rbac_policy is already registered Nov 24 04:00:53.195976 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:security_group Nov 24 04:00:53.196324 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] security_group is already registered Nov 24 04:00:53.196736 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 04:00:53.197076 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] security_group_rule is already registered Nov 24 04:00:53.197708 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service CORE assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.198041 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 04:00:53.198410 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] subnetpool is already registered Nov 24 04:00:53.198839 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.v2.resource_helper [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Service CORE assigned prefix: {{(pid=103271) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 04:00:53.199169 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 04:00:53.199505 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING neutron.quota.resource_registry [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] subnetpool is already registered Nov 24 04:00:53.199986 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: extensions {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.201431 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: address-groups {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.202940 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: address-scopes {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.204258 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: agents {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.205418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: auto-allocated-topology {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.206750 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: availability_zones {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.208599 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: dhcp-networks {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.210120 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: dhcp-agents {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.211582 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: routers {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.214738 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: flavors {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.215948 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: service_profiles {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.217166 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: next_providers {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.218653 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: service_profiles {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.220194 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: floatingip-pools {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.221420 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: routers {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.223933 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: floatingips {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.225209 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: l3-routers {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.226656 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: l3-agents {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.228050 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: metering-labels {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.229411 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: metering-label-rules {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.230777 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: network-ip-availabilities {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.232046 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: bindings {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.233685 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: quotas {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.235289 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: quotas {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.236831 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: rbac-policies {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.238134 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: security-groups {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.239418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: security-group-rules {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.240652 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: service-providers {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.241879 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: subnetpools {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.243318 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: subnetpools {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.244790 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.246886 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.248718 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.250815 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.252646 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.255072 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.260648 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.262624 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.264606 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.267903 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron.api.extensions [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Extended resource: tags {{(pid=103271) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 04:00:53.275147 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING keystonemiddleware.auth_token [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 04:00:53.279937 dv-neutron-819049-1-hyperv neutron-server[103271]: WARNING keystonemiddleware.auth_token [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 04:00:53.288799 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_concurrency.lockutils [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Acquired lock "singleton_lock" {{(pid=103271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 04:00:53.289292 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_concurrency.lockutils [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Releasing lock "singleton_lock" {{(pid=103271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 04:00:53.289948 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Starting 2 workers Nov 24 04:00:53.294909 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Started child 103380 {{(pid=103271) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 04:00:53.300146 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Started child 103381 {{(pid=103271) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 04:00:53.300414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:00:53.301049 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO neutron.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 24 04:00:53.301587 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Publish callbacks [] for process, before_spawn {{(pid=103271) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:00:53.302088 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [-] (103380) wsgi starting up on http://0.0.0.0:9696 Nov 24 04:00:53.304036 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Starting 1 workers Nov 24 04:00:53.304208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:00:53.305639 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [-] (103381) wsgi starting up on http://0.0.0.0:9696 Nov 24 04:00:53.309180 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Started child 103382 {{(pid=103271) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 04:00:53.309752 dv-neutron-819049-1-hyperv neutron-server[103271]: INFO oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Starting 1 workers Nov 24 04:00:53.313067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] calling RpcWorker wait() {{(pid=103382) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 24 04:00:53.313622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] returning from RpcWorker wait() {{(pid=103382) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 24 04:00:53.314180 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Started child 103383 {{(pid=103271) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 04:00:53.314989 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG neutron_lib.callbacks.manager [None req-f248937d-fd79-42f0-9eca-ba600d8f5686 None None] Publish callbacks [] for process, after_spawn {{(pid=103271) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:00:53.315087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:00:53.315528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:00:53.317451 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103271) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 04:00:53.317665 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 04:00:53.317855 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 04:00:53.318079 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 04:00:53.318471 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 04:00:53.318657 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 04:00:53.319181 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.319469 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.319727 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:00:53.320193 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.320193 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.320321 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.320808 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:00:53.320913 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.321114 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.321366 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.321637 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.321875 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.322050 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.322245 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.322496 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.322729 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.323052 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.323316 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.323570 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.323816 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.323990 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.324259 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.324529 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.324782 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.325048 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.325303 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.325798 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.326036 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.326330 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.326565 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.326850 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.327091 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.327361 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.327620 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.327865 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.328090 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.328349 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.328604 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.328841 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.329073 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.329294 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.329565 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.329810 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.330292 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] host = dv-neutron-819049-1-hyperv {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.330552 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.330793 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.331029 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.331303 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.331580 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.331802 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.332069 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.332320 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.333188 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.333440 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.333688 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.333953 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.334224 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.334487 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.334658 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.334900 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.335177 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.335460 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.335666 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.335840 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.336021 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.336285 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.336451 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.336707 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.336946 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.337170 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.337392 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.337634 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.337872 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.338141 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.338416 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.338638 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.338874 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.339128 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.339360 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.339587 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.339853 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.340116 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.340332 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.340551 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.340787 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.341019 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.341275 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.341498 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.341737 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.341974 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.342264 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.342488 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.342730 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.342996 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.343229 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.343461 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.343680 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.343947 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.344179 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.344445 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.344708 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.344946 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.345199 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.345417 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.345664 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.345901 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.346120 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.346393 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.346664 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.346903 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.347123 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.347346 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.347563 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.347832 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.348283 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.348575 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.348983 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.349250 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.349501 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.350238 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.350499 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.350817 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.351007 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.351267 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.351596 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.351892 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.352193 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.352462 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.354015 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.354371 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.354699 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.355195 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.356190 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.356663 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.356770 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.357018 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.357833 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.357983 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.358139 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.358953 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.359258 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.359604 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.48/identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.361684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.362735 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.362735 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.362735 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.363114 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.363114 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.363350 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.363481 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.365275 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.365566 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.365876 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.366233 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.366769 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.367285 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.367719 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.368141 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.368570 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.368812 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.369046 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.369291 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.369521 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.369788 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.370079 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.370366 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.370616 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.370835 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.371224 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.371465 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.371711 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.371935 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.372153 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.372397 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.372615 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.372865 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.373085 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.373305 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.373540 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.373928 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.374450 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.374688 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.374911 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.375148 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.375468 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.375709 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.375924 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.376209 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.376459 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.376654 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.377104 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.377529 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.377754 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.377979 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.378486 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.379029 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.379255 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.379970 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.380266 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.380591 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.380838 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.381101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.381480 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.381882 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.382124 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.382404 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.382659 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.382901 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.383138 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.383391 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.383663 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.384156 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.384397 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.384621 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.384865 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.385135 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.385369 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.385590 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.385836 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.386090 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.386383 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.386615 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.386847 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.387116 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.387381 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.387646 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.387898 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.388193 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.388412 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.388700 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.388985 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.389248 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.389519 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.389765 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.390000 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.390307 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.390563 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.390820 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.391071 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.391320 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.391538 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.391802 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.392028 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.392279 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.392528 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.392866 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.393098 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.393319 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.393520 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.393968 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.394416 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.394666 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.394958 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.395845 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.396086 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.396346 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.396580 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.48/identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.396836 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.397079 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.397485 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.397901 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.398138 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.398413 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.398633 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.398874 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.399091 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.399343 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.399580 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.399819 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.400186 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.400406 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.400788 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.401182 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.401549 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.401771 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.402027 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.402292 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.402555 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.402776 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.402993 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.403244 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.403507 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.403919 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.404202 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.404591 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.404820 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.405429 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.405669 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.405887 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.406184 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.406415 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.406634 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.406850 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.407069 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.407285 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.407496 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.407719 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.407950 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.408211 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.408447 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.408775 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.409037 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.409286 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.409538 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.409750 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.409993 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.410243 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.410484 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.410742 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.410959 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.411173 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.411408 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.411656 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.411906 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.412122 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.412351 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.412564 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.412938 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.413177 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.413477 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.413742 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.413989 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.414286 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.414490 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.414700 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.414927 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.415137 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.415347 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.415568 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.415807 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.416037 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.416261 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.416468 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.416697 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.416914 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.417127 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.417371 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.417596 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.417825 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.418038 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.418281 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.418497 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.418704 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.419394 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.419394 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.419394 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.419637 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.419809 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.420016 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.420262 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.420470 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.420678 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.420894 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.421107 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.421333 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.421813 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.421940 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.422078 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.422382 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.422646 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.422905 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.423155 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.423456 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.423747 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.423938 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.424171 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.424386 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.424602 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.424853 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.425153 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.425428 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.425686 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.425935 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.426778 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.427062 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:150:199'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.427352 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.427567 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.427868 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.428175 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.428455 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.428717 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.428944 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.429196 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.429416 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.429630 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.429862 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.430104 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.430339 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.430598 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.430823 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.431081 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.431311 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.431535 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.431752 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.432004 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.432213 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.432463 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.432675 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.432830 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 04:00:53.433342 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103271) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 04:00:53.433503 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 04:00:53.433656 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 04:00:53.433825 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 04:00:53.433993 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 04:00:53.434188 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 04:00:53.434374 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.434534 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.434692 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.434849 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.435006 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.435184 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.435343 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.435498 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.435653 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.435842 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.436490 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.436854 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.436854 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437026 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437101 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437235 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437392 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437549 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437720 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.437887 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.438018 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.438192 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.438350 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.438843 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.438843 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.438843 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439106 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439186 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439288 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439443 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439599 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439755 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.439910 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440066 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440222 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440377 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440704 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440704 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440865 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.440981 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.441137 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.441294 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] host = dv-neutron-819049-1-hyperv {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.441451 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.441608 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.441764 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.442544 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.442708 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.442866 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443024 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443182 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443340 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443497 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443654 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443811 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.443970 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.444133 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.444290 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.444449 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.444605 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.444763 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.444950 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.445114 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.445272 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.445431 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.445588 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.445746 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.445908 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.446062 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.446390 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.446549 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.446709 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.446865 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447022 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447180 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447338 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447497 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447655 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447812 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.447967 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.448124 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.448280 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.448438 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.448594 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.448750 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.448907 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.449064 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.449220 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.449377 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.449534 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.449693 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.449852 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450008 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450186 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450339 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450496 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450657 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450814 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.450971 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.451166 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.451257 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.451466 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.451658 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.451790 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.451876 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452001 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452157 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452314 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452470 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452634 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452780 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.452937 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.453094 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 04:00:53.453269 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.453428 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.453598 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.453757 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.453917 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.454083 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.454262 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.454422 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.454581 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.454739 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.454905 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.455063 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456504 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456504 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456504 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456713 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456713 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456857 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.456995 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.457153 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.457312 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.457494 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.457669 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.457843 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458001 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458263 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.48/identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458365 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458486 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458644 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458804 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.458963 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.459123 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.459282 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.459441 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.459601 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.459761 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.459921 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.460079 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.460239 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.460399 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.460559 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.460718 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.460877 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461037 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461196 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461355 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461583 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461691 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461823 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.461982 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.462140 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.462330 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.462488 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.462646 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.462804 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.462973 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.463112 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.463270 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.463428 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.463586 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.463745 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.463833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:00:53.463921 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.464067 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.464225 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.464384 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.464542 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.464701 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.464861 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465020 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465178 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465335 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465492 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465649 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465806 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.465963 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.466123 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.466305 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.466462 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.466622 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.466780 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.466940 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.467099 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.467257 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.467415 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.467572 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.467739 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.467911 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.468069 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.468226 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.468410 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.468529 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.468687 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.468845 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469003 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469161 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469318 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469478 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469636 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469797 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.469955 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.470113 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.470294 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.470451 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.470610 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.470767 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.470926 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.471084 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.471245 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.471401 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.471560 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.471727 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.471870 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.472037 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.472195 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.472355 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.472513 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.472678 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.472845 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473004 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473185 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473344 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473501 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473658 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473818 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.473977 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.474140 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.474318 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.474477 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.474646 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.474805 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.474963 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.475122 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.475303 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.475460 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.475618 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.475776 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.475934 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.476092 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.476250 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.476408 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.476566 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.476724 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.476882 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.477042 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.48/identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.477200 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.477358 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.477516 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.477676 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.479418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.479418 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.479587 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.479726 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.479891 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.480050 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.480210 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.480369 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.480527 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.480687 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.480846 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481149 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481149 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481315 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481445 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481603 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481780 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.481919 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.482077 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.482256 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.482416 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.482576 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.482734 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.482894 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483054 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483215 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483519 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483519 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483670 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483818 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.483978 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.484141 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.484301 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.484461 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.484619 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.484779 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.484938 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.485097 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.485255 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.485428 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.485588 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.485746 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.485904 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.486062 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.486239 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.486398 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.486557 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.486715 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.486873 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487030 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487191 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487354 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487512 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487670 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487828 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.487986 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.488145 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.488302 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.488473 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.488632 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.489318 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.489479 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.489637 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.489795 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.489964 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.490123 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.490287 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.490449 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.490609 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.490768 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.490935 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.491093 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.491251 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.491409 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.491568 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.491727 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.491894 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.492052 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.492210 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.492367 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.492525 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.492683 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.492849 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493008 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493166 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493324 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493483 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493640 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493808 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.493966 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.494124 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.494301 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.494460 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.494623 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.494788 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.494949 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.495108 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.495273 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.495431 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.495590 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.495750 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.495919 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.496078 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.496240 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.496397 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.496556 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.496714 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.496874 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.497039 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.497204 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.497450 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.497553 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.497680 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.497849 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:150:199'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.498015 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.498189 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.498355 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.498524 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.498684 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.498841 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.499252 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.499411 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.499570 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.499728 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.499886 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500043 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500201 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500360 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500518 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500676 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500833 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.500991 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.501149 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.501307 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.501466 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.501625 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.501782 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 04:00:53.501933 dv-neutron-819049-1-hyperv neutron-server[103271]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 04:00:53.667320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55208) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:00:53.675840 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [-] 10.222.0.48 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0063188 Nov 24 04:01:04.988911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f223af7d-599d-4eb9-8493-bf1062aeaa8e None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:01:05.061005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f223af7d-599d-4eb9-8493-bf1062aeaa8e None None] No non-hosted networks {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 24 04:01:05.098818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-97d51684-2a72-4a9b-b934-32656fcbbf99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-600532'] for agent, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:07.264532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-77a4a0c3-8a16-4835-a70d-472d22d0fc8e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-600532'] for agent, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:07.318045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-dcbbcc8b-948b-48bc-8e73-22280dcdd41d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:08.759226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-600532'] for agent, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:10.059253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-600532'] for agent, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:10.209385 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.db.l3_hamode_db [None req-c2edd08d-6692-41f2-add1-f75eeb3037a1 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 24 04:01:10.296841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2edd08d-6692-41f2-add1-f75eeb3037a1 None None] Routers set() bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:01:10.297222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2edd08d-6692-41f2-add1-f75eeb3037a1 None None] Router IDs set() for agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 04:01:10.785949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-600532'] for agent, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:10.786646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.786988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.787319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.787724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.788025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.788350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.788734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.790062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.790062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.791295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.791883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.792168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:10.792584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-neutron-819049-1-hyperv', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:10.809004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-neutron-819049-1-hyperv', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:11.582910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55296) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:12.095761 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING oslo_policy.policy [None req-62ee66f1-37b6-4fd9-86d8-250096bf35cb admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:12.096365 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING oslo_policy.policy [None req-62ee66f1-37b6-4fd9-86d8-250096bf35cb admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:12.319510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-62ee66f1-37b6-4fd9-86d8-250096bf35cb admin admin] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:01:12.320599 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-62ee66f1-37b6-4fd9-86d8-250096bf35cb admin admin] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7367632 Nov 24 04:01:14.766906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55312) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:15.069432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] Request body: {'subnetpool': {'shared': True, 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:15.164630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.policy [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103381) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 04:01:15.211686 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING oslo_policy.policy [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:15.212061 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING oslo_policy.policy [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:15.220683 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.quota [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] Loaded quota_driver: . Nov 24 04:01:15.309627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769094663057', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769094661614', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769094651605', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769094648782', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769094670476', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8769094563219', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-16319642', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16523761', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-857115', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-920311'] for rbac-policy, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:15.373973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:15.375183 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3c012bcc-6807-440b-ba3c-1cfd6e527edc admin admin] 10.222.0.48 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6072598 Nov 24 04:01:18.041759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55324) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:18.332486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Request body: {'network': {'admin_state_up': True, 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'name': 'private'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:18.360299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Made reservation on behalf of 0aeb52efadce4ababe7964109ad2556a for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:01:18.363153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.379639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.485938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.489725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.508796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] vlan segment allocate from pool success with {'vlan_id': 165, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:01:18.536931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8769089995695', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.537510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Unsubscribe: segment precommit_create {{(pid=103381) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 04:01:18.538023 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Added segment 945b3787-8f1c-4079-bf96-fdccff7b4748 of type vlan for network 122f4745-5132-4f13-8559-96c75f078e1b Nov 24 04:01:18.553297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d22b3294-0ba1-40ff-8e1b-6c56f228aab1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:18.604779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.605141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.605479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.605810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.606136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.606499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.606829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.607167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.607494 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.607816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.608135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.608452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Tracked resource versions report: Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: pushed versions: Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: { 'AddressGroup': {'1.2'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'ConntrackHelper': {'1.0'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Log': {'1.0'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Network': {'1.1'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Port': {'1.7'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'PortForwarding': {'1.2'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'QosPolicy': {'1.10'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroup': {'1.5'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SubPort': {'1.0'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Subnet': {'1.1'}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Trunk': {'1.1'}} Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: consumer versions: Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'ConntrackHelper': '1.0', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Log': '1.0', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Network': '1.1', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Port': '1.7', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'PortForwarding': '1.2', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'QosPolicy': '1.10', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroup': '1.5', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroupRule': '1.2', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SubPort': '1.0', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Subnet': '1.1', Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Trunk': '1.1'}} Nov 24 04:01:18.609773 dv-neutron-819049-1-hyperv neutron-server[103381]: {{(pid=103381) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:01:18.649935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.691679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.692808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:18.693505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:18.750654 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7077181 Nov 24 04:01:18.795138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47364e85-85e2-4e24-964a-900408107fd9 admin admin] Pushing event updated for resources: {'Network': ['ID=122f4745-5132-4f13-8559-96c75f078e1b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:18.807078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 122f4745-5132-4f13-8559-96c75f078e1b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:01:21.504066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 55338) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:21.987977 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING oslo_policy.policy [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:21.988546 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING oslo_policy.policy [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:22.430772 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.policy [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103380) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 04:01:22.477177 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING oslo_policy.policy [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:22.477593 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING oslo_policy.policy [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 04:01:22.486779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:22.489190 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-174c539c-577b-4b56-bf3c-ad87ca169641 admin admin] 10.222.0.48 "GET /v2.0/networks/122f4745-5132-4f13-8559-96c75f078e1b HTTP/1.1" status: 200 len: 825 time: 0.9831109 Nov 24 04:01:22.526856 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2f7532b2-1a83-40ea-8f92-fca1d7b31e07 admin admin] 10.222.0.48 "GET /v2.0/subnetpools/60b8e73e-b609-448c-bb8e-6c6389804a56 HTTP/1.1" status: 200 len: 734 time: 0.0316734 Nov 24 04:01:22.536510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Request body: {'subnet': {'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'name': 'private-subnet', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:22.538391 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.quota [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Loaded quota_driver: . Nov 24 04:01:22.575658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Made reservation on behalf of 0aeb52efadce4ababe7964109ad2556a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:01:22.578760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Publish callbacks [] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:22.858132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:22.924103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Checking segment: {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:01:22.924555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Network hostable DHCP agents. Network: 122f4745-5132-4f13-8559-96c75f078e1b, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:01:22.942678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Pushing event updated for resources: {'Subnet': ['ID=e0cd6ac6-8b7e-43f4-af37-a78e2e81f203,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:22.954034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.954422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.954829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.955089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.955414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.955758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.956602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.956942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.957264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.957582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.957896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.958311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Tracked resource versions report: Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: pushed versions: Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: { 'AddressGroup': {'1.2'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'ConntrackHelper': {'1.0'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Log': {'1.0'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Network': {'1.1'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Port': {'1.7'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'PortForwarding': {'1.2'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'QosPolicy': {'1.10'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroup': {'1.5'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SubPort': {'1.0'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Subnet': {'1.1'}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Trunk': {'1.1'}} Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: consumer versions: Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'ConntrackHelper': '1.0', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Log': '1.0', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Network': '1.1', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Port': '1.7', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'PortForwarding': '1.2', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'QosPolicy': '1.10', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroup': '1.5', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroupRule': '1.2', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SubPort': '1.0', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Subnet': '1.1', Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Trunk': '1.1'}} Nov 24 04:01:22.959547 dv-neutron-819049-1-hyperv neutron-server[103380]: {{(pid=103380) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:01:22.978093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Network 122f4745-5132-4f13-8559-96c75f078e1b is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:01:22.996086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 122f4745-5132-4f13-8559-96c75f078e1b) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:01:23.001118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:23.001750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:23.005775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-275d8e3b-5fac-4b36-9f10-67afccdb66d7 None None] Network 122f4745-5132-4f13-8559-96c75f078e1b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:01:23.023754 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ce28c666-129a-4809-844e-eadc360a1b1b admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4912152 Nov 24 04:01:23.328312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-122f4745-5132-4f13-8559-96c75f078e1b', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:01:23.329535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:23.620107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Allocated IP 172.20.0.2 (122f4745-5132-4f13-8559-96c75f078e1b/e0cd6ac6-8b7e-43f4-af37-a78e2e81f203/83832135-2aca-4893-9537-8fee0f81228e) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:01:23.818636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:23.826161 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:23.896545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Network 122f4745-5132-4f13-8559-96c75f078e1b is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:01:23.911202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:01:23.914495 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:01:23.920463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Pushing event updated for resources: {'Port': ['ID=83832135-2aca-4893-9537-8fee0f81228e,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:23.953444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.953812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.954189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.954530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.954865 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.955221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.955559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.955905 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.956806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.957142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.957477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.957802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Tracked resource versions report: Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: pushed versions: Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: { 'AddressGroup': {'1.2'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'ConntrackHelper': {'1.0'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Log': {'1.0'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Network': {'1.1'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Port': {'1.7'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'PortForwarding': {'1.2'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'QosPolicy': {'1.10'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroup': {'1.5'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SubPort': {'1.0'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Subnet': {'1.1'}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Trunk': {'1.1'}} Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: consumer versions: Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'ConntrackHelper': '1.0', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Log': '1.0', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Network': '1.1', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Port': '1.7', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'PortForwarding': '1.2', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'QosPolicy': '1.10', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroup': '1.5', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroupRule': '1.2', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SubPort': '1.0', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Subnet': '1.1', Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Trunk': '1.1'}} Nov 24 04:01:23.959139 dv-neutron-819049-1-hyperv neutron-server[103382]: {{(pid=103382) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:01:24.008888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Attempting to bind port 83832135-2aca-4893-9537-8fee0f81228e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:01:24.009556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Attempting to bind port 83832135-2aca-4893-9537-8fee0f81228e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:01:24.009676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Attempting to bind port 83832135-2aca-4893-9537-8fee0f81228e on network 122f4745-5132-4f13-8559-96c75f078e1b {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:01:24.014629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 1, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:01:24.015011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Checking segment: {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:01:24.015482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:24.015874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Bound using segment: {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:01:24.016357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Bound port: 83832135-2aca-4893-9537-8fee0f81228e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:01:24.016776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:24.080355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] For port 83832135-2aca-4893-9537-8fee0f81228e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:01:24.085173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] For port 83832135-2aca-4893-9537-8fee0f81228e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=83832135-2aca-4893-9537-8fee0f81228e,segment=NetworkSegment(945b3787-8f1c-4079-bf96-fdccff7b4748),segment_id=945b3787-8f1c-4079-bf96-fdccff7b4748)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:01:24.089668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:24.156197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23ebb02-9a88-4a89-a0b9-70efc5dc91a5 None None] Pushing event updated for resources: {'Port': ['ID=83832135-2aca-4893-9537-8fee0f81228e,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:25.582274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 55358) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:25.893998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-766b0618-8f9c-48f6-a3b1-211933f76b09 admin admin] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:01:25.895113 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-766b0618-8f9c-48f6-a3b1-211933f76b09 admin admin] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3118348 Nov 24 04:01:28.449426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 55366) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:28.760168 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-ddadf4eb-19c6-463e-92ed-23b9a137e350 admin admin] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:01:28.761179 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ddadf4eb-19c6-463e-92ed-23b9a137e350 admin admin] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3108110 Nov 24 04:01:31.489790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 55376) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:31.790458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] Request body: {'router': {'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'name': 'router1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:31.814217 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:31.816394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:31.964127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:31.969124 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:31.984352 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:31.994217 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8406de60-f6b2-4b6b-99c2-0455574e8081 admin admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4945660 Nov 24 04:01:32.479435 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 83832135-2aca-4893-9537-8fee0f81228e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:01:32.571034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 83832135-2aca-4893-9537-8fee0f81228e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:32.571541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:32.681809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:32.717415 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 83832135-2aca-4893-9537-8fee0f81228e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=83832135-2aca-4893-9537-8fee0f81228e,segment=NetworkSegment(945b3787-8f1c-4079-bf96-fdccff7b4748),segment_id=945b3787-8f1c-4079-bf96-fdccff7b4748)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:01:32.723775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:32.777408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=83832135-2aca-4893-9537-8fee0f81228e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:33.224982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7d3629d-ecd1-4afc-81dd-4bb1f3e98fff None None] Network 122f4745-5132-4f13-8559-96c75f078e1b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:01:33.291426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-91b8760d-22f2-4e12-9be9-698722d7115b None None] Provisioning complete for port 83832135-2aca-4893-9537-8fee0f81228e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:33.291796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91b8760d-22f2-4e12-9be9-698722d7115b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:33.633996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6491da8a-e005-4166-83b4-b8e2571fba96 None None] Provisioning complete for port 83832135-2aca-4893-9537-8fee0f81228e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:33.634679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6491da8a-e005-4166-83b4-b8e2571fba96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:34.458763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 83832135-2aca-4893-9537-8fee0f81228e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:01:34.470865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 55388) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:34.509117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 83832135-2aca-4893-9537-8fee0f81228e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:34.509489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:34.774843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-82fcbe6b-cc32-4afe-8352-e536f8074452 admin admin] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:01:34.775841 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-82fcbe6b-cc32-4afe-8352-e536f8074452 admin admin] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3033965 Nov 24 04:01:34.903146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bf6c761b-643f-4e71-a5ca-09ce3c2e9153 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.259476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f188c1cc-9e2e-4544-b391-25cbe7b818ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.260812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55396) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:37.566447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Request body: {'network': {'is_default': True, 'name': 'public', 'admin_state_up': True, 'provider:physical_network': 'physnet1', 'router:external': True, 'provider:network_type': 'flat'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:37.586200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Made reservation on behalf of cd2eb1ea5407484bad84378e044501e7 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:01:37.588398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.597085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.670562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.673959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.689943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Reserving flat network on physical network physnet1 {{(pid=103381) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 24 04:01:37.711176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.711539 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Added segment fb2d4bf4-50bd-4c43-8f74-b9785ff5147f of type flat for network f70b2100-2610-4e2a-8841-1763c44a2ca9 Nov 24 04:01:37.712856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=276a6d3d-020c-4d16-9667-232592a578d6,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:37.760344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.792507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.793339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:37.793901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:37.826380 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5649366 Nov 24 04:01:37.854096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e67369-fffd-478e-b520-b928d3434ae7 admin admin] Pushing event updated for resources: {'Network': ['ID=f70b2100-2610-4e2a-8841-1763c44a2ca9,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:37.864778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:01:38.653145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:39.971351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:40.294511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55414) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:40.508615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73e7725b-f675-46df-a8d1-73e231407e8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:40.510029 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-73e7725b-f675-46df-a8d1-73e231407e8c admin admin] 10.222.0.48 "GET /v2.0/subnets/e0cd6ac6-8b7e-43f4-af37-a78e2e81f203 HTTP/1.1" status: 200 len: 849 time: 0.2145407 Nov 24 04:01:40.682462 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-affb80bb-9acc-4509-a3d0-820ea3fdddf7 admin admin] 10.222.0.48 "GET /v2.0/routers/9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 HTTP/1.1" status: 200 len: 704 time: 0.1663518 Nov 24 04:01:40.780685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:40.950929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:41.245248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Allocated IP 172.20.0.1 (122f4745-5132-4f13-8559-96c75f078e1b/e0cd6ac6-8b7e-43f4-af37-a78e2e81f203/ff07ed36-26e8-4583-96a6-c50827cd284d) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:01:41.427510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:41.493114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:41.568011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Network 122f4745-5132-4f13-8559-96c75f078e1b is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:01:41.573468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:01:41.584239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:01:41.585120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:41.603199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Pushing event updated for resources: {'Port': ['ID=ff07ed36-26e8-4583-96a6-c50827cd284d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:41.775239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5a6700ea-deb6-4dc3-b545-e8db69158c8c None None] Provisioning complete for port ff07ed36-26e8-4583-96a6-c50827cd284d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:41.775823 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5a6700ea-deb6-4dc3-b545-e8db69158c8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:41.832299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:41.863773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5a6700ea-deb6-4dc3-b545-e8db69158c8c None None] Port ff07ed36-26e8-4583-96a6-c50827cd284d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:01:42.046725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:42.051672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:42.052405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:42.114038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Pushing event updated for resources: {'Port': ['ID=ff07ed36-26e8-4583-96a6-c50827cd284d,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:42.176155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Network 122f4745-5132-4f13-8559-96c75f078e1b is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:01:42.177569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:01:42.337746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:01:42.386202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-74eb926c-7726-4033-bd69-9c282d3a108d None None] Provisioning complete for port ff07ed36-26e8-4583-96a6-c50827cd284d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:42.386503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-74eb926c-7726-4033-bd69-9c282d3a108d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:42.419622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-74eb926c-7726-4033-bd69-9c282d3a108d None None] Port ff07ed36-26e8-4583-96a6-c50827cd284d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:01:42.430245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:01:42.435392 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-554df738-cc36-411b-a045-cca1f503b478 admin admin] 10.222.0.48 "PUT /v2.0/routers/9eabed5c-78c2-43f6-844c-d6e9bc50fcf1/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7474952 Nov 24 04:01:42.440089 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Sync routers for ids ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:01:42.452843 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Routers {'9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:01:42.453945 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:01:37Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:42.641291 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Set router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:01:43.078952 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'name': 'router1', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:01:31Z', 'updated_at': '2021-11-24T04:01:41Z', 'revision_number': 2, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'gw_port_host': None, '_interfaces': [{'id': 'ff07ed36-26e8-4583-96a6-c50827cd284d', 'name': '', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'mac_address': 'fa:16:3e:73:f5:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:40Z', 'updated_at': '2021-11-24T04:01:41Z', 'revision_number': 2, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'subnets': [{'id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:43.129482 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Checking router: 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:01:43.129855 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Updating router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 port ff07ed36-26e8-4583-96a6-c50827cd284d binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:01:43.177695 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:43.440186 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:01:43.704401 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:43.710668 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:43.811001 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Pushing event updated for resources: {'Port': ['ID=ff07ed36-26e8-4583-96a6-c50827cd284d,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:43.839984 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.840353 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.840704 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.841044 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.841379 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.841718 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.842055 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.842429 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.842780 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.843112 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.843439 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.843760 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Tracked resource versions report: Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: pushed versions: Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: { 'AddressGroup': {'1.2'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'ConntrackHelper': {'1.0'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Log': {'1.0'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Network': {'1.1'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Port': {'1.7'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'PortForwarding': {'1.2'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'QosPolicy': {'1.10'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroup': {'1.5'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SubPort': {'1.0'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Subnet': {'1.1'}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Trunk': {'1.1'}} Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: consumer versions: Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'ConntrackHelper': '1.0', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Log': '1.0', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Network': '1.1', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Port': '1.7', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'PortForwarding': '1.2', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'QosPolicy': '1.10', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroup': '1.5', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroupRule': '1.2', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SubPort': '1.0', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Subnet': '1.1', Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Trunk': '1.1'}} Nov 24 04:01:43.845045 dv-neutron-819049-1-hyperv neutron-server[103383]: {{(pid=103383) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:01:43.900492 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Attempting to bind port ff07ed36-26e8-4583-96a6-c50827cd284d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:01:43.900898 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Attempting to bind port ff07ed36-26e8-4583-96a6-c50827cd284d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:01:43.901420 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Attempting to bind port ff07ed36-26e8-4583-96a6-c50827cd284d on network 122f4745-5132-4f13-8559-96c75f078e1b {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:01:43.908290 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 1, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:01:43.908693 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Checking segment: {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:01:43.909170 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:43.909697 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Bound using segment: {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:01:43.910066 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Bound port: ff07ed36-26e8-4583-96a6-c50827cd284d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '945b3787-8f1c-4079-bf96-fdccff7b4748', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 165, 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:01:43.910490 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:43.982053 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] For port ff07ed36-26e8-4583-96a6-c50827cd284d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:01:44.001184 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] For port ff07ed36-26e8-4583-96a6-c50827cd284d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ff07ed36-26e8-4583-96a6-c50827cd284d,segment=NetworkSegment(945b3787-8f1c-4079-bf96-fdccff7b4748),segment_id=945b3787-8f1c-4079-bf96-fdccff7b4748)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:01:44.006451 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:44.053630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c9a1d92c-266e-4aaa-8eb4-834670999ed2 None None] Provisioning complete for port ff07ed36-26e8-4583-96a6-c50827cd284d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:44.056980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9a1d92c-266e-4aaa-8eb4-834670999ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:44.069859 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cafd34d3-ed6f-45f7-a711-fcc0e48836e0 None None] Pushing event updated for resources: {'Port': ['ID=ff07ed36-26e8-4583-96a6-c50827cd284d,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:44.072371 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Routers {'9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:01:44.072998 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:01:37Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:44.166743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9a1d92c-266e-4aaa-8eb4-834670999ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:44.176479 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] Set router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:01:44.203279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c9a1d92c-266e-4aaa-8eb4-834670999ed2 None None] For port ff07ed36-26e8-4583-96a6-c50827cd284d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ff07ed36-26e8-4583-96a6-c50827cd284d,segment=NetworkSegment(945b3787-8f1c-4079-bf96-fdccff7b4748),segment_id=945b3787-8f1c-4079-bf96-fdccff7b4748)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:01:44.212239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9a1d92c-266e-4aaa-8eb4-834670999ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:44.260504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a1d92c-266e-4aaa-8eb4-834670999ed2 None None] Pushing event updated for resources: {'Port': ['ID=ff07ed36-26e8-4583-96a6-c50827cd284d,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:44.331951 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3c1f3002-d84c-421d-9b00-68e628b62f5a None None] Provisioning complete for port ff07ed36-26e8-4583-96a6-c50827cd284d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:44.332258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c1f3002-d84c-421d-9b00-68e628b62f5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:44.393996 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'name': 'router1', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:01:31Z', 'updated_at': '2021-11-24T04:01:41Z', 'revision_number': 2, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'gw_port_host': None, '_interfaces': [{'id': 'ff07ed36-26e8-4583-96a6-c50827cd284d', 'name': '', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'mac_address': 'fa:16:3e:73:f5:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:40Z', 'updated_at': '2021-11-24T04:01:43Z', 'revision_number': 4, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'subnets': [{'id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:44.432032 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bdccec-fa9d-4d2b-a6d5-746ad9f59634 None None] The sync data for ids ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'] in dv-neutron-819049-1-hyperv is: [{'id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'name': 'router1', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:01:31Z', 'updated_at': '2021-11-24T04:01:41Z', 'revision_number': 2, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'gw_port_host': None, '_interfaces': [{'id': 'ff07ed36-26e8-4583-96a6-c50827cd284d', 'name': '', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'mac_address': 'fa:16:3e:73:f5:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:40Z', 'updated_at': '2021-11-24T04:01:43Z', 'revision_number': 4, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'subnets': [{'id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:01:44.764529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55434) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:44.877890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0c6f5c0-e4ec-4c93-acfb-0d595bda4cb0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:44.879306 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e0c6f5c0-e4ec-4c93-acfb-0d595bda4cb0 admin admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 842 time: 0.1138391 Nov 24 04:01:44.889272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Request body: {'subnet': {'enable_dhcp': False, 'ip_version': 4, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'name': 'public-subnet', 'gateway_ip': '172.26.5.1', 'cidr': '172.26.5.0/24'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:44.914433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Made reservation on behalf of cd2eb1ea5407484bad84378e044501e7 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:01:44.916646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Publish callbacks [] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:45.215991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:01:45.216428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:45.273388 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Pushing event updated for resources: {'Subnet': ['ID=3754be7e-8738-44a0-8cf7-94c154ac7d80,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:45.281777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:01:45.282158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Network hostable DHCP agents. Network: f70b2100-2610-4e2a-8841-1763c44a2ca9, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:01:45.302796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:01:45.313840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, f70b2100-2610-4e2a-8841-1763c44a2ca9) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:01:45.319422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:45.320770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:45.322373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86e19659-e4a4-4de9-b8df-3e9c9a177322 None None] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:01:45.336150 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ba38bc9d-3684-41f9-b6df-8ccf9819086a admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4502940 Nov 24 04:01:45.464323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acb92f11-10a5-4094-bc18-856b2e216c9e None None] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:01:47.730057 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55442) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:47.856873 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-192e258e-6789-493a-b947-e2c67ed6b592 admin admin] 10.222.0.48 "GET /v2.0/routers/9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 HTTP/1.1" status: 200 len: 710 time: 0.1256468 Nov 24 04:01:47.945980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5561964-0f3a-4970-88c5-8691034246fb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:01:47.947388 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e5561964-0f3a-4970-88c5-8691034246fb admin admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 886 time: 0.0837436 Nov 24 04:01:47.956880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:01:48.281453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:48.512347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:48.588972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:48.688917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Allocated IP 172.26.5.129 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/05680a67-f712-4941-9fd3-852fad6b27fb) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:01:48.789484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:48.821507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:48.859186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:01:48.865155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:01:48.868505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:01:48.931509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Pushing event updated for resources: {'Port': ['ID=05680a67-f712-4941-9fd3-852fad6b27fb,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:49.112264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:49.299931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:49.303526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:49.491315 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:01:49.597493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:01:49.601770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:49.602986 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8483a6d0-5b0c-4eac-a622-daf0834b55eb admin admin] 10.222.0.48 "PUT /v2.0/routers/9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 HTTP/1.1" status: 200 len: 890 time: 1.6494441 Nov 24 04:01:50.494334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ff07ed36-26e8-4583-96a6-c50827cd284d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:01:50.542360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ff07ed36-26e8-4583-96a6-c50827cd284d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:50.542759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:51.305065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Sync routers for ids ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:01:51.319013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Routers {'9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:01:51.319690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:01:37Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:51.526177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Set router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:01:51.985280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'name': 'router1', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.129'}], 'enable_snat': True}, 'gw_port_id': '05680a67-f712-4941-9fd3-852fad6b27fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:01:31Z', 'updated_at': '2021-11-24T04:01:48Z', 'revision_number': 4, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'gw_port': {'id': '05680a67-f712-4941-9fd3-852fad6b27fb', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:ec:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:48Z', 'updated_at': '2021-11-24T04:01:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ff07ed36-26e8-4583-96a6-c50827cd284d', 'name': '', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'mac_address': 'fa:16:3e:73:f5:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:40Z', 'updated_at': '2021-11-24T04:01:44Z', 'revision_number': 5, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'subnets': [{'id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:52.034502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Checking router: 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:01:52.034882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Updating router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 port 05680a67-f712-4941-9fd3-852fad6b27fb binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:01:52.084197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:52.093771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55454) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:01:52.216190 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-efd21773-601c-47f3-9b38-6bfbc21931ec admin admin] 10.222.0.48 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1211512 Nov 24 04:01:52.407328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:52.413773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:52.461793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Attempting to bind port 05680a67-f712-4941-9fd3-852fad6b27fb on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:01:52.462171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Attempting to bind port 05680a67-f712-4941-9fd3-852fad6b27fb by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:01:52.462547 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Attempting to bind port 05680a67-f712-4941-9fd3-852fad6b27fb on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:01:52.470826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 1, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:01:52.471137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:01:52.471532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:52.471920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:01:52.472382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Bound port: 05680a67-f712-4941-9fd3-852fad6b27fb, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:01:52.472768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:52.474239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eef07e1-c0fe-45bb-951b-c2adfca2787a None None] Pushing event updated for resources: {'Port': ['ID=05680a67-f712-4941-9fd3-852fad6b27fb,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:52.526133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] For port 05680a67-f712-4941-9fd3-852fad6b27fb, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:01:52.529133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] For port 05680a67-f712-4941-9fd3-852fad6b27fb, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=05680a67-f712-4941-9fd3-852fad6b27fb,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:01:52.532653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:52.590132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eef07e1-c0fe-45bb-951b-c2adfca2787a None None] Pushing event updated for resources: {'Port': ['ID=05680a67-f712-4941-9fd3-852fad6b27fb,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:52.592560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Routers {'9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:01:52.593149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:01:37Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:52.702208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] Set router 9eabed5c-78c2-43f6-844c-d6e9bc50fcf1 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:01:52.921536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'name': 'router1', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.129'}], 'enable_snat': True}, 'gw_port_id': '05680a67-f712-4941-9fd3-852fad6b27fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:01:31Z', 'updated_at': '2021-11-24T04:01:48Z', 'revision_number': 4, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'gw_port': {'id': '05680a67-f712-4941-9fd3-852fad6b27fb', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:ec:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:48Z', 'updated_at': '2021-11-24T04:01:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ff07ed36-26e8-4583-96a6-c50827cd284d', 'name': '', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'mac_address': 'fa:16:3e:73:f5:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:40Z', 'updated_at': '2021-11-24T04:01:44Z', 'revision_number': 5, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'subnets': [{'id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:01:52.951233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb2aaa6-6ea2-4bc3-9e07-5957ffcce736 None None] The sync data for ids ['9eabed5c-78c2-43f6-844c-d6e9bc50fcf1'] in dv-neutron-819049-1-hyperv is: [{'id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'name': 'router1', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.129'}], 'enable_snat': True}, 'gw_port_id': '05680a67-f712-4941-9fd3-852fad6b27fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:01:31Z', 'updated_at': '2021-11-24T04:01:48Z', 'revision_number': 4, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'gw_port': {'id': '05680a67-f712-4941-9fd3-852fad6b27fb', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:ec:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:48Z', 'updated_at': '2021-11-24T04:01:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ff07ed36-26e8-4583-96a6-c50827cd284d', 'name': '', 'network_id': '122f4745-5132-4f13-8559-96c75f078e1b', 'tenant_id': '0aeb52efadce4ababe7964109ad2556a', 'mac_address': 'fa:16:3e:73:f5:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9eabed5c-78c2-43f6-844c-d6e9bc50fcf1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:01:40Z', 'updated_at': '2021-11-24T04:01:44Z', 'revision_number': 5, 'project_id': '0aeb52efadce4ababe7964109ad2556a', 'subnets': [{'id': 'e0cd6ac6-8b7e-43f4-af37-a78e2e81f203', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '60b8e73e-b609-448c-bb8e-6c6389804a56'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:01:54.511117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 05680a67-f712-4941-9fd3-852fad6b27fb up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:01:54.576706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 05680a67-f712-4941-9fd3-852fad6b27fb triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:54.577081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:54.664088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:54.685195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 05680a67-f712-4941-9fd3-852fad6b27fb, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=05680a67-f712-4941-9fd3-852fad6b27fb,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:01:54.690761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:01:54.740502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=05680a67-f712-4941-9fd3-852fad6b27fb,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:01:56.545888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 05680a67-f712-4941-9fd3-852fad6b27fb up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:01:56.602832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 05680a67-f712-4941-9fd3-852fad6b27fb triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:01:56.603570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:04.903404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7594d7a3-43c8-4940-9b4f-b9d4668f9071 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:07.264177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d5a0406b-283a-41b0-8c1a-c69dfe848ecc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:08.657894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:09.989664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:10.783846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:20.390015 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:02:34.903051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a53702fb-992c-41cc-904b-3b53a9345a1d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:37.258571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-abacd5ea-7388-49e9-84a1-433e264e92a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:38.658686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:39.978900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:40.787756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:02:57.378780 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:03:04.901110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-36fb75fd-b110-483c-bbe8-b6c399fa6571 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:07.260972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1bfa636a-7e7f-4658-abdb-7c32ead4a227 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:08.660765 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:09.982883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:10.792620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:16.060406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55972) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:16.119506 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-d685f633-3d51-4872-912f-69cc71422f0e admin admin] GET failed (client error): The resource could not be found. Nov 24 04:03:16.121046 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d685f633-3d51-4872-912f-69cc71422f0e admin admin] 10.222.0.48 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0593963 Nov 24 04:03:16.275984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e26a75e6-ace0-4f9e-94e3-553bb014128a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:16.277424 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e26a75e6-ace0-4f9e-94e3-553bb014128a admin admin] 10.222.0.48 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1517653 Nov 24 04:03:18.538999 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 55982) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:18.631452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbe9b527-1834-49ea-bf37-69e534cf69b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:18.632773 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fbe9b527-1834-49ea-bf37-69e534cf69b1 admin admin] 10.222.0.48 "GET /v2.0/subnets/e0cd6ac6-8b7e-43f4-af37-a78e2e81f203 HTTP/1.1" status: 200 len: 849 time: 0.0928366 Nov 24 04:03:18.643156 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:03:18.724358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Publish callbacks [] for subnet, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:18.860688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8769089902457'] for subnet, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:18.888516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:18.889099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:18.890951 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] 10.222.0.48 "PUT /v2.0/subnets/e0cd6ac6-8b7e-43f4-af37-a78e2e81f203 HTTP/1.1" status: 200 len: 868 time: 0.2513194 Nov 24 04:03:18.896813 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-095ea677-9ecd-42d2-849b-2ff3501c8a1a None None] Network 122f4745-5132-4f13-8559-96c75f078e1b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:03:18.914887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Pushing event updated for resources: {'Subnet': ['ID=e0cd6ac6-8b7e-43f4-af37-a78e2e81f203,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:03:18.924800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.925160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.925508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.925854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.926252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.926557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.926892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.927250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.927586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.927915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.928273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:18.928569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-152e437a-a377-4f21-b651-4201a300ce9e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:03:19.240719 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d9658b50-9606-4117-9e80-36915e6c3825 None None] Provisioning complete for port ff07ed36-26e8-4583-96a6-c50827cd284d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:03:19.241090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d9658b50-9606-4117-9e80-36915e6c3825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:19.329895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d9658b50-9606-4117-9e80-36915e6c3825 None None] Provisioning complete for port 83832135-2aca-4893-9537-8fee0f81228e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:03:19.330210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d9658b50-9606-4117-9e80-36915e6c3825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:21.182574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 55990) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:21.399720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a7d9747-aa8d-4f18-bbda-d3fd22253a98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:21.400190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a7d9747-aa8d-4f18-bbda-d3fd22253a98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:21.401725 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8a7d9747-aa8d-4f18-bbda-d3fd22253a98 admin admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2183027 Nov 24 04:03:23.692977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56000) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:23.823483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a72b1ba-0736-4385-be17-120cca9bd56c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:23.823942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a72b1ba-0736-4385-be17-120cca9bd56c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:23.825437 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9a72b1ba-0736-4385-be17-120cca9bd56c admin admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1315014 Nov 24 04:03:26.097983 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56008) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:26.267008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60d71f44-a527-47fc-aaef-258cbf34154a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:26.268379 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-60d71f44-a527-47fc-aaef-258cbf34154a admin admin] 10.222.0.48 "GET /v2.0/networks/122f4745-5132-4f13-8559-96c75f078e1b HTTP/1.1" status: 200 len: 869 time: 0.1694252 Nov 24 04:03:28.561361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56016) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:28.684757 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8ad5f64-69d5-4005-84ee-82d5cce846bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:28.686085 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f8ad5f64-69d5-4005-84ee-82d5cce846bb admin admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 886 time: 0.1232677 Nov 24 04:03:30.982411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56024) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:31.104692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38b23113-101a-4620-a65d-c25bb3a62e29 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:31.105141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38b23113-101a-4620-a65d-c25bb3a62e29 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:31.106652 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-38b23113-101a-4620-a65d-c25bb3a62e29 admin admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1232829 Nov 24 04:03:33.381047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56032) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:33.477143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e005efe-1c03-443b-8853-00c3ced0cd01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:33.477588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e005efe-1c03-443b-8853-00c3ced0cd01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:33.479090 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8e005efe-1c03-443b-8853-00c3ced0cd01 admin admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0970981 Nov 24 04:03:34.377526 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:03:34.902413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-330405da-df83-41be-886e-4bb72d42782b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:35.717936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56040) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:35.805068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc170ae7-fc00-453b-bc1d-2510355aca23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:35.806393 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fc170ae7-fc00-453b-bc1d-2510355aca23 admin admin] 10.222.0.48 "GET /v2.0/subnets/3754be7e-8738-44a0-8cf7-94c154ac7d80 HTTP/1.1" status: 200 len: 816 time: 0.0874140 Nov 24 04:03:37.262298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-460bfa33-3191-4af1-982b-ee069ad46688 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:38.067295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56048) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:03:38.160191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-781e13c7-9bca-49e9-9084-32c1b05d24a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:03:38.161492 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-781e13c7-9bca-49e9-9084-32c1b05d24a0 admin admin] 10.222.0.48 "GET /v2.0/subnets/e0cd6ac6-8b7e-43f4-af37-a78e2e81f203 HTTP/1.1" status: 200 len: 868 time: 0.0932710 Nov 24 04:03:38.663400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:39.985943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:03:40.793842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:02.664523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56102) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:04:02.710958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-86f6f26d-6826-4362-a6e7-537ee82531a5 admin admin] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:04:02.711923 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-86f6f26d-6826-4362-a6e7-537ee82531a5 admin admin] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0464718 Nov 24 04:04:04.904180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ede3c05a-e9cd-43d2-8f4b-56906ea56226 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:05.067577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56110) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:04:05.126271 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a781720-61af-409a-9a2c-8da4f223dbb2 admin admin] GET failed (client error): The resource could not be found. Nov 24 04:04:05.127546 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1a781720-61af-409a-9a2c-8da4f223dbb2 admin admin] 10.222.0.48 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0590227 Nov 24 04:04:05.210658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cfe995d-3878-48ce-9094-a2ea3150f2ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:04:05.212029 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2cfe995d-3878-48ce-9094-a2ea3150f2ce admin admin] 10.222.0.48 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0799596 Nov 24 04:04:07.263259 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-555babd3-0f4e-46a2-b052-6b46c73340a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:07.522416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56118) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:04:07.568546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:04:07.589732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Made reservation on behalf of cd2eb1ea5407484bad84378e044501e7 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:04:07.591964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:07.618532 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.services.revisions.revision_plugin [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Could not find related network for resource to bump revision. Nov 24 04:04:07.630124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] vlan segment allocate from pool success with {'vlan_id': 179, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:04:07.638910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:07.639244 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Added segment 0d8a1a43-5b51-4264-96f7-2d87f3e5a027 of type vlan for network ab213e8b-69fe-4927-b89e-42a727feeb40 Nov 24 04:04:07.679243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:07.702108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:07.703037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:04:07.703599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:07.737350 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2139421 Nov 24 04:04:07.765233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e414cfdf-b804-4833-82b3-b89ddf523408 admin admin] Pushing event updated for resources: {'Network': ['ID=ab213e8b-69fe-4927-b89e-42a727feeb40,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:04:07.776271 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network ab213e8b-69fe-4927-b89e-42a727feeb40 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:04:08.667205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:09.990971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:10.053105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56126) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:04:10.111341 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-82ab96b1-6c38-43c1-a30e-073492a35878 admin admin] GET failed (client error): The resource could not be found. Nov 24 04:04:10.112589 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-82ab96b1-6c38-43c1-a30e-073492a35878 admin admin] 10.222.0.48 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0585287 Nov 24 04:04:10.181643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-380b8f0a-a3d6-4cce-8321-ffbc5457d893 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:04:10.182981 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-380b8f0a-a3d6-4cce-8321-ffbc5457d893 admin admin] 10.222.0.48 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0660260 Nov 24 04:04:10.193204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Request body: {'subnet': {'ip_version': 4, 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40', 'name': 'shared-subnet'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:04:10.211931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Made reservation on behalf of cd2eb1ea5407484bad84378e044501e7 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:04:10.214135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:10.376858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:10.427892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6039864a-de70-4429-bade-96a0d79a5844,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:04:10.437589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Checking segment: {'id': '0d8a1a43-5b51-4264-96f7-2d87f3e5a027', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:04:10.437944 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Network hostable DHCP agents. Network: ab213e8b-69fe-4927-b89e-42a727feeb40, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:04:10.453852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Network ab213e8b-69fe-4927-b89e-42a727feeb40 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:04:10.462070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, ab213e8b-69fe-4927-b89e-42a727feeb40) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:04:10.466356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:04:10.467187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:10.472123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f77307d7-c4ee-46be-92b0-4beb34e85b82 None None] Network ab213e8b-69fe-4927-b89e-42a727feeb40 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:04:10.484372 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b3401f5f-0534-4a63-b874-246b878836a1 admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2938082 Nov 24 04:04:10.716047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-ab213e8b-69fe-4927-b89e-42a727feeb40', 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40', 'tenant_id': 'cd2eb1ea5407484bad84378e044501e7', 'fixed_ips': [{'subnet_id': '6039864a-de70-4429-bade-96a0d79a5844'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:04:10.717072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:10.819035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:10.873904 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Allocated IP 192.168.233.2 (ab213e8b-69fe-4927-b89e-42a727feeb40/6039864a-de70-4429-bade-96a0d79a5844/cbdb3ad2-cbfb-403d-80a8-2ec23100724b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:04:11.038004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:11.043918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:11.080484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Network ab213e8b-69fe-4927-b89e-42a727feeb40 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:04:11.085233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:04:11.087793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:04:11.098295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Pushing event updated for resources: {'Port': ['ID=cbdb3ad2-cbfb-403d-80a8-2ec23100724b,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:04:11.121654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.122020 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.122389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.122720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.123051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.123396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.123726 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.124580 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.124920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.125246 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.126191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.126191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:04:11.161176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Attempting to bind port cbdb3ad2-cbfb-403d-80a8-2ec23100724b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:04:11.161546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Attempting to bind port cbdb3ad2-cbfb-403d-80a8-2ec23100724b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '0d8a1a43-5b51-4264-96f7-2d87f3e5a027', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:04:11.161909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Attempting to bind port cbdb3ad2-cbfb-403d-80a8-2ec23100724b on network ab213e8b-69fe-4927-b89e-42a727feeb40 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:04:11.166929 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 4, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:04:11.167584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Checking segment: {'id': '0d8a1a43-5b51-4264-96f7-2d87f3e5a027', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:04:11.167985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:11.168374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Bound using segment: {'id': '0d8a1a43-5b51-4264-96f7-2d87f3e5a027', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:04:11.168831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Bound port: cbdb3ad2-cbfb-403d-80a8-2ec23100724b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0d8a1a43-5b51-4264-96f7-2d87f3e5a027', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 179, 'network_id': 'ab213e8b-69fe-4927-b89e-42a727feeb40'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:04:11.169222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:11.230289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] For port cbdb3ad2-cbfb-403d-80a8-2ec23100724b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:04:11.233369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] For port cbdb3ad2-cbfb-403d-80a8-2ec23100724b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=cbdb3ad2-cbfb-403d-80a8-2ec23100724b,segment=NetworkSegment(0d8a1a43-5b51-4264-96f7-2d87f3e5a027),segment_id=0d8a1a43-5b51-4264-96f7-2d87f3e5a027)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:04:11.239189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:11.301172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e986a66d-92b9-4d0a-aae3-049dec0117ae None None] Pushing event updated for resources: {'Port': ['ID=cbdb3ad2-cbfb-403d-80a8-2ec23100724b,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:04:11.378819 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:04:12.142464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c59378c3-0a33-4e92-a909-be31cff5db59 None None] Network ab213e8b-69fe-4927-b89e-42a727feeb40 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:04:12.252199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-26f1c714-58f0-46fa-ade9-b3f907905ad1 None None] Provisioning complete for port cbdb3ad2-cbfb-403d-80a8-2ec23100724b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:04:12.252572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26f1c714-58f0-46fa-ade9-b3f907905ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:12.365632 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26f1c714-58f0-46fa-ade9-b3f907905ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:12.399402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-26f1c714-58f0-46fa-ade9-b3f907905ad1 None None] For port cbdb3ad2-cbfb-403d-80a8-2ec23100724b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=cbdb3ad2-cbfb-403d-80a8-2ec23100724b,segment=NetworkSegment(0d8a1a43-5b51-4264-96f7-2d87f3e5a027),segment_id=0d8a1a43-5b51-4264-96f7-2d87f3e5a027)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:04:12.405339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26f1c714-58f0-46fa-ade9-b3f907905ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:12.456806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26f1c714-58f0-46fa-ade9-b3f907905ad1 None None] Pushing event updated for resources: {'Port': ['ID=cbdb3ad2-cbfb-403d-80a8-2ec23100724b,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:04:12.592954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device cbdb3ad2-cbfb-403d-80a8-2ec23100724b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:04:12.645184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5b908c22-071f-4dae-8f65-f978a35658fc None None] Provisioning complete for port cbdb3ad2-cbfb-403d-80a8-2ec23100724b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:04:12.645476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5b908c22-071f-4dae-8f65-f978a35658fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:12.685828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port cbdb3ad2-cbfb-403d-80a8-2ec23100724b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:04:12.686214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:34.913673 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fb1ea975-8663-44bf-a782-68bdd61a78cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:37.265397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d414e2ec-1d19-462d-8174-93a535646428 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:38.669713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:39.991236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:40.802750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:04:48.376637 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:05:04.907118 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a9f7380-d9be-4eb2-8c94-ef9de0eaec9d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:07.266780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5a4ee1f6-a434-4dc4-9869-7866d371006c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:08.676055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:09.994290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:10.805191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:25.375940 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:05:27.406090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56170) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:05:27.412100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-900df39d-0a2d-4aeb-bd6c-d7ef2c07664b tempest-verify_tempest_config-1552546746 tempest-verify_tempest_config-1552546746-project] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:05:27.413046 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-900df39d-0a2d-4aeb-bd6c-d7ef2c07664b tempest-verify_tempest_config-1552546746 tempest-verify_tempest_config-1552546746-project] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0059710 Nov 24 04:05:27.700501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56188) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:05:27.802302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:27.875546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:27.878992 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:27.921397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=151c0e8b-b546-444d-824d-a190b59a883f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:05:27.925922 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=3130a1c57a79453c9009c6217259a242&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2238452 Nov 24 04:05:27.928789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56192) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:05:27.930447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.930914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.931256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.931588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.931916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.932255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.932591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.932928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.933251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.933566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.933882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:27.934217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-741eb819-d5a7-4143-8420-47483dc70fe7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.008726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:28.028530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:28.124606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:28.127197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:28.128593 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/151c0e8b-b546-444d-824d-a190b59a883f HTTP/1.1" status: 204 len: 168 time: 0.1986511 Nov 24 04:05:28.136483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=151c0e8b-b546-444d-824d-a190b59a883f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:05:28.143295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.143670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.144017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.144357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.145260 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.145622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.145960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.146314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.146651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.146977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.147301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:28.147625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0669cc3-e415-46f0-bcd3-7ddba3fc7429 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:05:34.910088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-aa10e9da-3252-43b6-81b2-688e000f7652 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:37.268069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-207cc592-ebe1-4ded-b1b3-f0afaa3df9b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:38.677077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:39.996874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:05:40.806983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:02.374620 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:06:04.913599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-43c91b5d-9056-4db2-a5c6-2cc6c5bdc8f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:07.270335 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-013824a3-2a3a-4072-b63b-467bd3b376dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:08.679852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:09.999426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:10.807597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:34.914587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ec915aca-fbeb-47f4-8c9e-d3a17883be9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:37.271022 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-76874475-a1c1-4e56-82a4-f9dd91ed325c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:38.684962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:39.372935 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 5 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:06:40.003584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:40.808602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:42.090515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-600532'] for agent, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:06:56.933320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56264) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:06:57.037480 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6abe00b9-3f5c-4f80-8604-306a3841e951 admin admin] 10.222.0.48 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.1030693 Nov 24 04:06:59.340421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56274) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:06:59.394986 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0ff703b7-1c68-44f6-b99c-0caa85cb9ba5 admin admin] 10.222.0.48 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0534539 Nov 24 04:07:04.916599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b14607a9-049c-482e-aeca-c6f7878a0d66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:07.271041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e6eed8a1-a4e2-401f-b25d-af9c83e39dd3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:08.686318 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:10.005368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:10.810778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:12.042963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:16.371993 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:07:34.939278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6bcb56b7-e3be-49fd-b4ea-70414346adfa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:37.274630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-585fe404-f459-4b94-a262-7ea468636653 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:38.689392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:40.008071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:40.817007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:42.042241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:07:53.372102 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:08:04.927508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-883f7b08-e25f-4060-9b49-77948ec3f1da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:07.284884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ccbd6e6f-a7a3-4820-b9b7-bf7a0e846b77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:08.704268 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:10.013191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:10.819819 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:10.880931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56406) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:11.127998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1056098563-network', 'tenant_id': 'db5849637d02441e8e7822da79f37b83'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:11.154051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Made reservation on behalf of db5849637d02441e8e7822da79f37b83 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:11.159721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.173332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.258547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.262537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.287587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0b82a50-8098-4b00-997f-087063d3800e,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:11.298004 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.298253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.298662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.299014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.299353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.299694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.300034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.300383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.300831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.301143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.301478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.301830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Tracked resource versions report: Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: pushed versions: Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: { 'AddressGroup': {'1.2'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'ConntrackHelper': {'1.0'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Log': {'1.0'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Network': {'1.1'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Port': {'1.7'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'PortForwarding': {'1.2'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'QosPolicy': {'1.10'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroup': {'1.5'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SubPort': {'1.0'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Subnet': {'1.1'}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Trunk': {'1.1'}} Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: consumer versions: Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: HyperV agent@hv-neutron-8190: {}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'ConntrackHelper': '1.0', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Log': '1.0', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Network': '1.1', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Port': '1.7', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'PortForwarding': '1.2', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'QosPolicy': '1.10', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroup': '1.5', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SecurityGroupRule': '1.2', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'SubPort': '1.0', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Subnet': '1.1', Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: 'Trunk': '1.1'}} Nov 24 04:08:11.302839 dv-neutron-819049-1-hyperv neutron-server[103380]: {{(pid=103380) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:08:11.313863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] vlan segment allocate from pool success with {'vlan_id': 157, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:11.328290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8769089995695', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.328874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Unsubscribe: segment precommit_create {{(pid=103380) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 04:08:11.329382 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Added segment 672d840f-137e-4e24-919f-90c802e55efb of type vlan for network 4064fe6e-1a4a-440d-8829-8ec4922458b8 Nov 24 04:08:11.384790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.418210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.419517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:11.420110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.462767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56448) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:11.464206 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5813744 Nov 24 04:08:11.469594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Request body: {'subnet': {'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1056098563-subnet', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:11.500204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Made reservation on behalf of db5849637d02441e8e7822da79f37b83 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:11.503581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Publish callbacks [] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.548152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edab5cca-2beb-4b09-b2f5-3b42981e8477 admin admin] Pushing event updated for resources: {'Network': ['ID=4064fe6e-1a4a-440d-8829-8ec4922458b8,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:11.559506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:11.792268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.843578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Pushing event updated for resources: {'Subnet': ['ID=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:11.856737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.857105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.857450 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.857788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.858119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.858494 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.859358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.859693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.860072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.860338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.860986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.860986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Tracked resource versions report: Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: pushed versions: Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: { 'AddressGroup': {'1.2'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'ConntrackHelper': {'1.0'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Log': {'1.0'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Network': {'1.1'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Port': {'1.7'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'PortForwarding': {'1.2'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'QosPolicy': {'1.10'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroup': {'1.5'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SubPort': {'1.0'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Subnet': {'1.1'}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Trunk': {'1.1'}} Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: consumer versions: Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: HyperV agent@hv-neutron-8190: {}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'ConntrackHelper': '1.0', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Log': '1.0', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Network': '1.1', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Port': '1.7', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'PortForwarding': '1.2', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'QosPolicy': '1.10', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroup': '1.5', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SecurityGroupRule': '1.2', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'SubPort': '1.0', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Subnet': '1.1', Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: 'Trunk': '1.1'}} Nov 24 04:08:11.861967 dv-neutron-819049-1-hyperv neutron-server[103381]: {{(pid=103381) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:08:11.872496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Checking segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:11.872857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Network hostable DHCP agents. Network: 4064fe6e-1a4a-440d-8829-8ec4922458b8, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:11.891267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:11.907469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 4064fe6e-1a4a-440d-8829-8ec4922458b8) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:11.912281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:11.913041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.915917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31704f9b-906a-42d4-8cda-c579c5d1fd0c None None] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:11.935491 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0efec700-94b2-4bef-9af2-528ce3b4a83a admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4703639 Nov 24 04:08:11.936887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56472) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:11.945182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:11.977966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:11.979253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.074843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.087759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-4064fe6e-1a4a-440d-8829-8ec4922458b8', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:12.088700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.097579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.157301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56478) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:12.245015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Allocated IP 172.20.0.2 (4064fe6e-1a4a-440d-8829-8ec4922458b8/df7e7408-6a2c-4f38-aa9d-4f7793f54ec8/ebd48602-ede1-47f6-8ef4-bccd3575ea0d) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:12.247468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.315340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56488) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:12.352542 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56492) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:12.426471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.432679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56498) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:12.438964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.497424 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:12.500882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:12.503089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.504324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:12.513448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Pushing event updated for resources: {'Port': ['ID=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:12.533399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.548940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.548940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.549225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.549528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.549936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.550402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.550642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.550984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.551714 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.552304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.552636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.552963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Tracked resource versions report: Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: pushed versions: Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: { 'AddressGroup': {'1.2'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'ConntrackHelper': {'1.0'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Log': {'1.0'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Network': {'1.1'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Port': {'1.7'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'PortForwarding': {'1.2'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'QosPolicy': {'1.10'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroup': {'1.5'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SubPort': {'1.0'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Subnet': {'1.1'}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Trunk': {'1.1'}} Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: consumer versions: Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: HyperV agent@hv-neutron-8190: {}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'ConntrackHelper': '1.0', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Log': '1.0', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Network': '1.1', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Port': '1.7', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'PortForwarding': '1.2', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'QosPolicy': '1.10', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroup': '1.5', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SecurityGroupRule': '1.2', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'SubPort': '1.0', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Subnet': '1.1', Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: 'Trunk': '1.1'}} Nov 24 04:08:12.554072 dv-neutron-819049-1-hyperv neutron-server[103382]: {{(pid=103382) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:08:12.597161 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Attempting to bind port ebd48602-ede1-47f6-8ef4-bccd3575ea0d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:12.599273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Attempting to bind port ebd48602-ede1-47f6-8ef4-bccd3575ea0d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:12.600103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Attempting to bind port ebd48602-ede1-47f6-8ef4-bccd3575ea0d on network 4064fe6e-1a4a-440d-8829-8ec4922458b8 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:12.613620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-1460100416'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:12.620969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:12.621700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Checking segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:12.622609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.623196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Bound using segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:12.627738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Bound port: ebd48602-ede1-47f6-8ef4-bccd3575ea0d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:12.628404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.666271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:12.672599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.692814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.711473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-482089353-network', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:12.717667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Allocated IP 172.26.5.113 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/b16f6f22-9ec8-455b-bfdc-56955cdb66ff) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:12.739625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Made reservation on behalf of ca64a4f493b349449d44be7e1d9fb98c for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:12.742224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.757213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.765384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] For port ebd48602-ede1-47f6-8ef4-bccd3575ea0d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:12.770233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] For port ebd48602-ede1-47f6-8ef4-bccd3575ea0d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:12.779211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.883807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65913323-ced5-474a-86f1-ace3e3ba63e6 None None] Pushing event updated for resources: {'Port': ['ID=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:12.886935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.907441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.922313 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:12.981746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-369546969-network', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:12.993376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.013509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-193269709'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:13.025213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] vlan segment allocate from pool success with {'vlan_id': 185, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:13.039100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5b918287-71de-411e-af69-affb06edaedd,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:13.045381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.056606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.057248 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Added segment d051869f-c3c0-4ecf-a145-43173c8bbee4 of type vlan for network a2b36c78-43a6-4954-8102-cb5638999bb1 Nov 24 04:08:13.073725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Pushing event updated for resources: {'Port': ['ID=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:13.075515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.094073 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:13.096087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:13.099604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:13.169256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.173684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Made reservation on behalf of f983a1d6cdc44b639c49bee8aa3a5f49 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:13.176107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.212152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.221184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.226873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:13.227482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.243040 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Made reservation on behalf of 351e7d4c69be4ad8825078ca51ac45b4 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:13.249175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.279383 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.1195803 Nov 24 04:08:13.279990 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56526) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:13.408408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] vlan segment allocate from pool success with {'vlan_id': 158, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:13.419513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.420144 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Added segment 667b698e-2807-47a4-bcfc-45f0f3202512 of type vlan for network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 Nov 24 04:08:13.431286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75688ef9-88f1-4362-a406-8e6f2a94ad22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Network': ['ID=a2b36c78-43a6-4954-8102-cb5638999bb1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:13.433405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6d556a2-92d9-4a4f-b8c6-de3a57b1cc6a,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:13.442234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:13.444764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.464856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:13.468792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.537576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56536) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:13.729598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.759712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.843905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:13.851294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.924615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:13.925756 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:13.926614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.022991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-2147466201'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:14.073374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56550) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:14.073590 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 1.7570527 Nov 24 04:08:14.078238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Request body: {'subnet': {'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-482089353-subnet', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:14.088403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56552) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:14.091112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.099915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.111499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.113893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.api [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:08:14.113893 dv-neutron-819049-1-hyperv neutron-server[103381]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 24 04:08:14.113893 dv-neutron-819049-1-hyperv neutron-server[103381]: [parameters: {'project_id_1': 'ca64a4f493b349449d44be7e1d9fb98c', 'expiration_1': datetime.datetime(2021, 11, 24, 4, 7, 54, 84824)}] Nov 24 04:08:14.113893 dv-neutron-819049-1-hyperv neutron-server[103381]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103381) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:08:14.114336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG oslo_db.api [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:08:14.135715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Router 3d0d90ae-c638-4277-9998-3fafd099dea4 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:08:14.151635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.166291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b77023-f4be-4540-93f6-04d6fbd7de21 admin admin] Pushing event updated for resources: {'Network': ['ID=9279fc65-0f7e-4ac5-8fda-e94ff426a487,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:14.179495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] vlan segment allocate from pool success with {'vlan_id': 160, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:14.192810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Made reservation on behalf of a4afce0633f04eb685f1a50117b7159d for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:14.194933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:14.195627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.220082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] vlan segment allocate from pool success with {'vlan_id': 162, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:14.238886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.245923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.246396 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Added segment cbe779b8-68a9-4f40-be0b-27da35492bc4 of type vlan for network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 Nov 24 04:08:14.268293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.268999 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Added segment be98b3c0-70b2-46fe-b3aa-474dfd2bede2 of type vlan for network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 Nov 24 04:08:14.270726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d22bf61-baf3-4793-9d23-a40fdd7b7104,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:14.329688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b4480a6-f07c-4d4e-8731-db71dc8365e0 None None] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:14.365169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:14.381276 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Sync routers for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:14.405035 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:14.406503 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:14.413028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:14.419730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.426295 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2189d1ee-47d8-4b38-b43d-bb4a6b505d23 admin admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.4816928 Nov 24 04:08:14.426295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56560) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:14.448752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56562) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:14.472198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ad28f464-1ce3-43ff-9ae4-ed9479121ba7 None None] Provisioning complete for port ebd48602-ede1-47f6-8ef4-bccd3575ea0d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:14.474029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad28f464-1ce3-43ff-9ae4-ed9479121ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.495896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.525012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.548768 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:14.551101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d2a3b840-78f2-4610-8861-f432196f14d9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:14.589861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0677c794-44f4-432b-b958-c2b952f06fe2 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:14.632469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.641642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.644694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.646789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Made reservation on behalf of ca64a4f493b349449d44be7e1d9fb98c for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:14.649061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.652485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.658991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:14.659777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.665532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.666453 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:14.667019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.761612 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad28f464-1ce3-43ff-9ae4-ed9479121ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.777383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ebd48602-ede1-47f6-8ef4-bccd3575ea0d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:14.786561 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.803907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] vlan segment allocate from pool success with {'vlan_id': 187, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:14.824097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad28f464-1ce3-43ff-9ae4-ed9479121ba7 None None] For port ebd48602-ede1-47f6-8ef4-bccd3575ea0d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:14.825796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.826551 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Added segment e7d0e62f-5325-42e8-b488-cd8455aea1cc of type vlan for network e7b1bbe2-91db-433d-bb88-8704668a680f Nov 24 04:08:14.836149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad28f464-1ce3-43ff-9ae4-ed9479121ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.899374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.919533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad28f464-1ce3-43ff-9ae4-ed9479121ba7 None None] Pushing event updated for resources: {'Port': ['ID=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:14.945689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ebd48602-ede1-47f6-8ef4-bccd3575ea0d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:14.945689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:14.961064 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:13Z', 'revision_number': 3, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:14.989985 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0677c794-44f4-432b-b958-c2b952f06fe2 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "PUT /v2.0/quotas/e181bd0694f04e2e95aaa67ae82415f6 HTTP/1.1" status: 200 len: 366 time: 0.5603743 Nov 24 04:08:15.003584 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 2.6498759 Nov 24 04:08:15.006944 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 2.5732858 Nov 24 04:08:15.010769 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56572) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.011095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56576) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.011403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56578) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.015752 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Checking router: 3d0d90ae-c638-4277-9998-3fafd099dea4 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:15.016349 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Updating router 3d0d90ae-c638-4277-9998-3fafd099dea4 port b16f6f22-9ec8-455b-bfdc-56955cdb66ff binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:15.031678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Request body: {'subnet': {'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:15.052694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.055813 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.058519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:15.059132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.064349 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8d23ee14-0b88-4a98-8b1d-d69b719af1f2 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 468 time: 0.0491447 Nov 24 04:08:15.068421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56584) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.095890 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ac2e0ed2-5aa5-40bb-b2ea-602eedcbd067 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "GET /v2.0/quotas/e181bd0694f04e2e95aaa67ae82415f6 HTTP/1.1" status: 200 len: 366 time: 0.0204170 Nov 24 04:08:15.103926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56586) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.104851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Request body: {'subnet': {'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-369546969-subnet', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:15.112375 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e63d1e-7cc1-4e40-9222-549d7f9939cd tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event updated for resources: {'Network': ['ID=5e2ee65d-d6cd-44a3-bb7c-95d872e79f96,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.124821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:15.126911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba3d1711-1062-4b78-be49-de31c4ef69d9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.131313 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.179824 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b41d3ce2-e8c9-43cb-8dac-864bbccf3a65 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "DELETE /v2.0/quotas/e181bd0694f04e2e95aaa67ae82415f6 HTTP/1.1" status: 204 len: 168 time: 0.0687072 Nov 24 04:08:15.193345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e5d6fafb-4f87-49b2-961f-c87c3275ba09 None None] Provisioning complete for port ebd48602-ede1-47f6-8ef4-bccd3575ea0d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:15.194028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5d6fafb-4f87-49b2-961f-c87c3275ba09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.217758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56588) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.226701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=ba411cff-abfe-421c-93a3-cc27adcca313,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.260199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Made reservation on behalf of f983a1d6cdc44b639c49bee8aa3a5f49 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:15.262800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Publish callbacks [] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.283292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.291911 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0219335d-c0dd-45a3-a88e-4df05345f156 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 207 time: 0.0723412 Nov 24 04:08:15.301072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56592) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.348970 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-820c0e66-684c-452d-8893-bb5ff2118dbb tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "GET /v2.0/quotas/e181bd0694f04e2e95aaa67ae82415f6 HTTP/1.1" status: 200 len: 370 time: 0.0464611 Nov 24 04:08:15.353108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56596) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.376294 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d221aa5e-b918-46f4-80c1-b1ed76371b7a tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "GET /v2.0/quotas/e181bd0694f04e2e95aaa67ae82415f6/default HTTP/1.1" status: 200 len: 370 time: 0.0091958 Nov 24 04:08:15.382879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56598) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.397468 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 1.8399978 Nov 24 04:08:15.400132 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.403738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56600) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.406107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:15.406496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network hostable DHCP agents. Network: a2b36c78-43a6-4954-8102-cb5638999bb1, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:15.411902 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.446279 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-fb07b04a-548b-4703-88d9-f69f42e3a525 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] delete failed (client error): The resource could not be found. Nov 24 04:08:15.447441 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fb07b04a-548b-4703-88d9-f69f42e3a525 tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "DELETE /v2.0/quotas/e181bd0694f04e2e95aaa67ae82415f6 HTTP/1.1" status: 404 len: 348 time: 0.0625641 Nov 24 04:08:15.461727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20933bd9-9132-4e00-b777-42d1bf73ab3b admin admin] Pushing event updated for resources: {'Network': ['ID=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.465108 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Pushing event updated for resources: {'Port': ['ID=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,revision_number=2']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.474595 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.475248 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.475798 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.476324 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.476873 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.477416 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.477951 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.478584 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.479121 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.479893 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.480604 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.481491 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Tracked resource versions report: Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: pushed versions: Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: { 'AddressGroup': {'1.2'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'ConntrackHelper': {'1.0'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Log': {'1.0'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Network': {'1.1'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Port': {'1.7'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'PortForwarding': {'1.2'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'QosPolicy': {'1.10'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroup': {'1.5'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroupRule': {'1.2'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SubPort': {'1.0'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Subnet': {'1.1'}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Trunk': {'1.1'}} Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: consumer versions: Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: { DHCP agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: HyperV agent@hv-neutron-8190: {}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: L3 agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: Metadata agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: Metering agent@dv-neutron-819049-1-hyperv: {}, Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: Open vSwitch agent@dv-neutron-819049-1-hyperv: { 'AddressGroup': '1.2', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'ConntrackHelper': '1.0', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Log': '1.0', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Network': '1.1', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Port': '1.7', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'PortForwarding': '1.2', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'QosPolicy': '1.10', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroup': '1.5', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SecurityGroupRule': '1.2', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'SubPort': '1.0', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Subnet': '1.1', Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: 'Trunk': '1.1'}} Nov 24 04:08:15.482974 dv-neutron-819049-1-hyperv neutron-server[103383]: {{(pid=103383) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 04:08:15.487277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Made reservation on behalf of 351e7d4c69be4ad8825078ca51ac45b4 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:15.491930 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks [] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.498655 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Attempting to bind port b16f6f22-9ec8-455b-bfdc-56955cdb66ff on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:15.499179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:15.499933 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Attempting to bind port b16f6f22-9ec8-455b-bfdc-56955cdb66ff by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:15.500507 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Attempting to bind port b16f6f22-9ec8-455b-bfdc-56955cdb66ff on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:15.503492 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ac08ee4f-45d7-4c2e-ab90-055d80970c38,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.507055 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:15.507730 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:15.508344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.508938 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:15.509597 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Bound port: b16f6f22-9ec8-455b-bfdc-56955cdb66ff, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:15.510288 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.511167 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:15.521054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Checking segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:15.521773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Network hostable DHCP agents. Network: 9279fc65-0f7e-4ac5-8fda-e94ff426a487, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:15.563345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, a2b36c78-43a6-4954-8102-cb5638999bb1) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:15.634028 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] For port b16f6f22-9ec8-455b-bfdc-56955cdb66ff, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:15.635127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:15.635928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.643636 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Allocated IP 172.26.5.162 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/0bfae97a-e6f4-4ac5-aa66-cacea5e62825) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:15.648567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc7102e-47b5-443a-a6c9-cff363791585 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Pushing event updated for resources: {'Network': ['ID=e7b1bbe2-91db-433d-bb88-8704668a680f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.649882 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] For port b16f6f22-9ec8-455b-bfdc-56955cdb66ff, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:15.660547 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.666017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:15.687245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56606) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.703524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 9279fc65-0f7e-4ac5-8fda-e94ff426a487) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:15.710669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'network': {'name': 'tempest-network--505285741', 'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:15.732327 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5e54a2e1-0cc5-407e-bd7e-7428d4a2f113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.3025742 Nov 24 04:08:15.740348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56608) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.743414 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:15.744354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.748912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'name': 'tempest-NetworksTestDHCPv6-1679774761'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:15.758703 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49beab63-55c4-4ede-9f2d-083ad71757a8 None None] Pushing event updated for resources: {'Port': ['ID=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:15.793512 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:15.794183 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:15.817155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:network and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:15.844790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:15.847856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-395be3c8-eb29-4c3a-8f42-2cb96f22e202 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:15.849559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network e7b1bbe2-91db-433d-bb88-8704668a680f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:15.851261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34e1dd40-fb27-4827-bbfe-f9aacb6e0b27 None None] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:15.870755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:subnet and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:15.883568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.889898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:15.915059 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2556fa95-2566-412d-9d30-f9f12a5aa402 admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 841 time: 1.8380761 Nov 24 04:08:15.916699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56612) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:15.921701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.928288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:15.933097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.948191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:subnetpool and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:15.949134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Made reservation on behalf of 6bbeea287c51485fab52a581918dbccc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:15.951878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:15.959414 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:16.027229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.129200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Allocated IP 172.20.0.1 (4064fe6e-1a4a-440d-8829-8ec4922458b8/df7e7408-6a2c-4f38-aa9d-4f7793f54ec8/0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:16.150722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:16.152109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.174349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:16.190845 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:13Z', 'revision_number': 3, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:16.228950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:port and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:16.232064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6b900d5-6e1c-467d-a80c-b932fd4e77fd,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:16.236939 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.245153 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58a2cc63-3328-40aa-9cc7-01a55c2d9602 None None] The sync data for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv is: [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:13Z', 'revision_number': 3, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:16.246505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Checking segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:16.247999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Network hostable DHCP agents. Network: bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:16.256269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:16.334781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:16.340146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.341616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:16.348224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Pushing event updated for resources: {'Port': ['ID=0bfae97a-e6f4-4ac5-aa66-cacea5e62825,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:16.351566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Allocated IP 172.20.0.2 (9279fc65-0f7e-4ac5-8fda-e94ff426a487/ac08ee4f-45d7-4c2e-ab90-055d80970c38/8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:16.351867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:16.396652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:16.404355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'ba411cff-abfe-421c-93a3-cc27adcca313'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:16.405495 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.410384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:router and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:16.413359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.416440 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:16.418349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:16.419065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.420888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.422646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.426128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a045e41b-063c-4a91-b924-8159fd8249cc None None] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:16.439967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.486991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:16.491342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.500136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:floatingip and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:16.515921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event updated for resources: {'Subnet': ['ID=5fc8b036-8420-4810-b0e9-31b877c8e3c3,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:16.524521 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f18ecd5f-5b50-494c-9954-260d4787952b admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.5081880 Nov 24 04:08:16.534696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] vlan segment allocate from pool success with {'vlan_id': 159, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:16.536518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56616) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:16.549063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:16.549303 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:16.558982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:16.562838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28a89188-d462-4b94-802f-ae1061d4bdab,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:16.568903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.580414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port aede96d2-5d6c-45b5-8c19-5d520ff7835c yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:16.591678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.592032 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Added segment 49c0bd4c-865c-4b15-9a54-3d032ee019ea of type vlan for network d154fac7-3fe4-4efb-aeca-8064aef25ee4 Nov 24 04:08:16.745598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Checking segment: {'id': 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:16.745992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Network hostable DHCP agents. Network: 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:16.788716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.822552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.829425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/ba411cff-abfe-421c-93a3-cc27adcca313/fceaaa92-0388-4de8-a246-c71f3e89b312) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:16.861456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.862539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.925992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:16.963475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:16.982405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.013130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.019116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:17.020479 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.024767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:17.025583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.029419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ebd48602-ede1-47f6-8ef4-bccd3575ea0d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:17.069272 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.071357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.072320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:17.072908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.100666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.110414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:17.112091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-565f5758-bf92-44b9-9bfc-08f5ad904942 None None] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:17.118184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.161865 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:17.172677 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:17.199869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.213057 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-721f4017-337a-453c-b39c-6c92d5dd8334 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1930034 Nov 24 04:08:17.217008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56622) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:17.220853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Pushing event updated for resources: {'Port': ['ID=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:17.227455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Request body: {'port': {'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96', 'name': 'tempest-DHCPAgentSchedulersTestJSON-435483907'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:17.259575 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 1.8504820 Nov 24 04:08:17.273849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56624) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:17.340950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:17.362245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ebd48602-ede1-47f6-8ef4-bccd3575ea0d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:17.362571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.369708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:17.372899 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::1b7 (a2b36c78-43a6-4954-8102-cb5638999bb1/ba411cff-abfe-421c-93a3-cc27adcca313/aede96d2-5d6c-45b5-8c19-5d520ff7835c) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:17.374127 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:17.375547 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.378762 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506706cb-0543-4d62-b551-d8ef04e82e9b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Network': ['ID=d154fac7-3fe4-4efb-aeca-8064aef25ee4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:17.385070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:17.386920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.433614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network d154fac7-3fe4-4efb-aeca-8064aef25ee4 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:17.459524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Attempting to bind port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:17.459815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Attempting to bind port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:17.460197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Attempting to bind port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c on network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:17.462063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Pushing event updated for resources: {'Port': ['ID=fceaaa92-0388-4de8-a246-c71f3e89b312,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:17.534175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.569631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.584819 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:17.585244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Checking segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:17.585713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.585991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Bound using segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:17.586696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Bound port: 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:17.586921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.610808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:security_group and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:17.660415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:17.695949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:17.705958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Attempting to bind port fceaaa92-0388-4de8-a246-c71f3e89b312 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:17.706375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Attempting to bind port fceaaa92-0388-4de8-a246-c71f3e89b312 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:17.706747 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Attempting to bind port fceaaa92-0388-4de8-a246-c71f3e89b312 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:17.730228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:17.741594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.745980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Usage tracker for resource:security_group_rule and project:6648401989b34cfaa063e3e336fd3e82 is out of sync, need to count used quota {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 24 04:08:17.755281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:17.755763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.838190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.quota.resource [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103381) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 24 04:08:17.867668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:17.867668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:17.868437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.868543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:17.869206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Bound port: fceaaa92-0388-4de8-a246-c71f3e89b312, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:17.869587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.893293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.925229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.937759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.960089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:17.964868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Pushing event updated for resources: {'Port': ['ID=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:17.989318 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-33d0be33-7188-4a9b-af6e-3aa235df299c tempest-QuotasTest-299417203 tempest-QuotasTest-299417203-project-admin] 10.222.0.48 "GET /v2.0/quotas/6648401989b34cfaa063e3e336fd3e82/details.json HTTP/1.1" status: 200 len: 703 time: 2.3006568 Nov 24 04:08:18.002016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-5e2ee65d-d6cd-44a3-bb7c-95d872e79f96', 'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96', 'tenant_id': '351e7d4c69be4ad8825078ca51ac45b4', 'fixed_ips': [{'subnet_id': '5fc8b036-8420-4810-b0e9-31b877c8e3c3'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:18.002930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.013334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Made reservation on behalf of 351e7d4c69be4ad8825078ca51ac45b4 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:18.019406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.058532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Allocated IP 172.20.0.2 (bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30/d6b900d5-6e1c-467d-a80c-b932fd4e77fd/70b28543-0e73-41ab-be7f-487bfec19b39) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:18.074033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.074348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.079368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.080831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > port after_create 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.081489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > port after_delete 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.081970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > port after_update 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.082480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.082976 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.083607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.084096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.099960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] For port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:18.104877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] For port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:18.120441 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.163516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:18.168550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=aede96d2-5d6c-45b5-8c19-5d520ff7835c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:18.203518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:18.207520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:18.210696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] For port fceaaa92-0388-4de8-a246-c71f3e89b312, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:18.213143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:18.213774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.239701 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0eca3135-6dc9-420a-8e0f-68835b0c8611 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 2.4981749 Nov 24 04:08:18.243387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56634) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:18.300010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Allocated IP 172.26.5.177 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/56919873-aabb-4651-947d-5d6a306972db) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:18.383821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.384442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.384562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.384807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=103381) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:18.385169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d154fac7-3fe4-4efb-aeca-8064aef25ee4']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:18.403883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.416493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] For port fceaaa92-0388-4de8-a246-c71f3e89b312, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fceaaa92-0388-4de8-a246-c71f3e89b312,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:18.433220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.435597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.449301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49c0bd4c-865c-4b15-9a54-3d032ee019ea') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:18.449598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49c0bd4c-865c-4b15-9a54-3d032ee019ea') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:18.485023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-533c7464-920d-4b51-99d3-1b3b9d1daa02 None None] Provisioning complete for port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:18.485645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-533c7464-920d-4b51-99d3-1b3b9d1daa02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.486718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.519609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.521889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90d5c4c0-c669-4781-939e-1a8c04a20805 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:18.529375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] device_id is not set on port f688eefe-d86f-4b9a-a7e2-b373c097c325 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:18.534212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:18.538123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-533c7464-920d-4b51-99d3-1b3b9d1daa02 None None] Port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:18.539253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90d5c4c0-c669-4781-939e-1a8c04a20805 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:18.539436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.543175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad91d3a1-27d5-40fd-9299-63c36e923935 None None] Pushing event updated for resources: {'Port': ['ID=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:18.543333 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-90d5c4c0-c669-4781-939e-1a8c04a20805 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.2961185 Nov 24 04:08:18.547975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56640) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:18.594211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:18.598741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:18.677406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.740509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Releasing vlan 159 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:18.740930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.746373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56644) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: from cryptography.utils import int_from_bytes Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: from cryptography.utils import int_from_bytes Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:18.748992 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:18.830001 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Allocated IP 172.20.0.2 (5e2ee65d-d6cd-44a3-bb7c-95d872e79f96/5fc8b036-8420-4810-b0e9-31b877c8e3c3/b6867c2e-06aa-430e-b4c2-d9e4227ffa74) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:18.841312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Attempting to bind port 70b28543-0e73-41ab-be7f-487bfec19b39 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:18.841816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Attempting to bind port 70b28543-0e73-41ab-be7f-487bfec19b39 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:18.842527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Attempting to bind port 70b28543-0e73-41ab-be7f-487bfec19b39 on network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:18.845022 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4776ad47-2183-43c4-b597-aa14e4e585a5 None None] Pushing event updated for resources: {'Port': ['ID=fceaaa92-0388-4de8-a246-c71f3e89b312,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:18.893323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:18.893969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Checking segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:18.893969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.897433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Bound using segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:18.898065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Bound port: 70b28543-0e73-41ab-be7f-487bfec19b39, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:18.898517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.906695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b16f6f22-9ec8-455b-bfdc-56955cdb66ff up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:18.911038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:18.940195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port aede96d2-5d6c-45b5-8c19-5d520ff7835c {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:18.940521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.096947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.121701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for aede96d2-5d6c-45b5-8c19-5d520ff7835c owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:19.131745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Pushing event updated for resources: {'Port': ['ID=70b28543-0e73-41ab-be7f-487bfec19b39,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.136864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.220314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Pushing event updated for resources: {'Port': ['ID=0bfae97a-e6f4-4ac5-aa66-cacea5e62825,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.235546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] For port 70b28543-0e73-41ab-be7f-487bfec19b39, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:19.239977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b16f6f22-9ec8-455b-bfdc-56955cdb66ff triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:19.240524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.247372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] For port 70b28543-0e73-41ab-be7f-487bfec19b39, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70b28543-0e73-41ab-be7f-487bfec19b39,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:19.263246 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.268586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a57be2f6-3951-4ce5-8068-662f0f62bc4d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.287563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.289984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.319364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.320733 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e1a8932e-7395-4e4f-ac11-666917cf8f85 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.2312689 Nov 24 04:08:19.328964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.331958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56648) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:19.340712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-1461656675', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'fixed_ips': [{'ip_address': '172.26.5.162'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:19.355496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network d154fac7-3fe4-4efb-aeca-8064aef25ee4 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:08:19.382968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.392113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.396470 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/networks/d154fac7-3fe4-4efb-aeca-8064aef25ee4 HTTP/1.1" status: 204 len: 168 time: 2.1167636 Nov 24 04:08:19.402372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.406940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d6d09f-f08a-4931-81a2-7284f27fb8e8 None None] Pushing event updated for resources: {'Port': ['ID=70b28543-0e73-41ab-be7f-487bfec19b39,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.418576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56650) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:19.421673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48052bd0-0072-4da4-b581-296c81b303e5 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Network': ['ID=d154fac7-3fe4-4efb-aeca-8064aef25ee4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.435145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'network': {'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:19.449645 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:19.455643 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Pushing event updated for resources: {'Port': ['ID=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.489089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:19.503123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:19.507725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Pushing event updated for resources: {'Port': ['ID=56919873-aabb-4651-947d-5d6a306972db,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.510013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:19.521566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:19.525540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:19.533325 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.584689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.595211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port b16f6f22-9ec8-455b-bfdc-56955cdb66ff, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:19.604511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.611438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Attempting to bind port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:19.611438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Attempting to bind port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:19.611684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Attempting to bind port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 on network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:19.652711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:19.653084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Checking segment: {'id': 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:19.653490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.653890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Bound using segment: {'id': 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:19.654413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Bound port: b6867c2e-06aa-430e-b4c2-d9e4227ffa74, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '5e2ee65d-d6cd-44a3-bb7c-95d872e79f96'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:19.654939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.683927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.702216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.768311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Made reservation on behalf of 6bbeea287c51485fab52a581918dbccc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:19.770852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.772235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] For port b6867c2e-06aa-430e-b4c2-d9e4227ffa74, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:19.775385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] For port b6867c2e-06aa-430e-b4c2-d9e4227ffa74, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,segment=NetworkSegment(be98b3c0-70b2-46fe-b3aa-474dfd2bede2),segment_id=be98b3c0-70b2-46fe-b3aa-474dfd2bede2)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:19.785925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.795736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Made reservation on behalf of fa1ebb6cf4e14903a7c63687524e28eb for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:19.798099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.829052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:19.869850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] vlan segment allocate from pool success with {'vlan_id': 196, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:19.877289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Allocated IP 172.20.0.13 (5e2ee65d-d6cd-44a3-bb7c-95d872e79f96/5fc8b036-8420-4810-b0e9-31b877c8e3c3/f688eefe-d86f-4b9a-a7e2-b373c097c325) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:19.898016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b43082-21fd-4429-aefb-38b2eb274888 None None] Pushing event updated for resources: {'Port': ['ID=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:19.901990 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=aede96d2-5d6c-45b5-8c19-5d520ff7835c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:20.009607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.010040 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Added segment fae71bb8-94f2-4971-92fd-8011d637e68a of type vlan for network 96a1d837-87e8-4a7b-a567-7c86c310fda7 Nov 24 04:08:20.178346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.255027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.258499 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fedc33f3-c0aa-49f6-a816-8037e7d0319d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/aede96d2-5d6c-45b5-8c19-5d520ff7835c HTTP/1.1" status: 204 len: 168 time: 1.7097211 Nov 24 04:08:20.267995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a57be2f6-3951-4ce5-8068-662f0f62bc4d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.269148 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56652) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:20.339873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a57be2f6-3951-4ce5-8068-662f0f62bc4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.343858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.347396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.421759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.427420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a09fbb5-b05c-4d6f-9ab9-db4369694a21 None None] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:20.478618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.507306 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Allocated IP 172.26.5.108 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/5503f0ee-7113-45e0-8806-1eb6b4320966) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:20.514711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.546726 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a57be2f6-3951-4ce5-8068-662f0f62bc4d admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=108a677e65004a4781365c05ce08bd57&name=default HTTP/1.1" status: 200 len: 2996 time: 1.7727478 Nov 24 04:08:20.553886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-cf27d425-2f55-497c-8eeb-cc2bbd09e28c None None] Provisioning complete for port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:20.555596 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf27d425-2f55-497c-8eeb-cc2bbd09e28c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.556423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56654) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:20.568643 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57be2f6-3951-4ce5-8068-662f0f62bc4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a96468e-8d5e-4cf5-b1b5-107fea1fbc98,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:20.586183 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98f92ae0-32db-4edb-85ab-dea91007a8c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:20.587724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98f92ae0-32db-4edb-85ab-dea91007a8c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:20.590988 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-98f92ae0-32db-4edb-85ab-dea91007a8c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.3177979 Nov 24 04:08:20.596398 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56656) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:20.623048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.626328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:20.627066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.660506 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.702205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Pushing event updated for resources: {'Port': ['ID=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:20.714930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.791932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf27d425-2f55-497c-8eeb-cc2bbd09e28c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.873302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cf27d425-2f55-497c-8eeb-cc2bbd09e28c None None] For port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:20.884744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf27d425-2f55-497c-8eeb-cc2bbd09e28c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:20.943096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Network': ['ID=96a1d837-87e8-4a7b-a567-7c86c310fda7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:20.943283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:20.972696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:20.982005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 96a1d837-87e8-4a7b-a567-7c86c310fda7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:20.995295 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ad0f0321-d512-47fb-a52b-718e52d9334f tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 1.5737257 Nov 24 04:08:21.016298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56658) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:21.023622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'subnet': {'network_id': '96a1d837-87e8-4a7b-a567-7c86c310fda7', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:21.027934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc98bb9b-42d2-4230-a295-f571405f2a15 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.041520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:21.043279 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet ba411cff-abfe-421c-93a3-cc27adcca313 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:08:21.050325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.081708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6a2e720-4cf7-44e8-ab82-c58f7d5ec0eb None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:21.138527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event updated for resources: {'Port': ['ID=f688eefe-d86f-4b9a-a7e2-b373c097c325,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:21.247489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.260346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:21.261009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.276145 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.292520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] device_id is not set on port 1cf301b0-68f5-4481-9aa8-4d4dd501efc6 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:21.322563 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.323190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:21.344713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:21.382392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b16f6f22-9ec8-455b-bfdc-56955cdb66ff up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:21.391442 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fca25595-f300-414e-a349-085c4bdedecc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.1637864 Nov 24 04:08:21.420634 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa120a1d-3794-45cb-a3bd-15e1b2ea6aba,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:21.431180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f74f9d7d-4b40-4f09-a4ba-1a78a47f35ae None None] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:21.431483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56660) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:21.445875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.449460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.540014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.545898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc98bb9b-42d2-4230-a295-f571405f2a15 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.547491 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-dd4c3961-e8bf-43c2-a6fd-9fa492c861eb None None] Provisioning complete for port fceaaa92-0388-4de8-a246-c71f3e89b312 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:21.547907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-dd4c3961-e8bf-43c2-a6fd-9fa492c861eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.549796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.562891 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Made reservation on behalf of 6bbeea287c51485fab52a581918dbccc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:21.565423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.632195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf27d425-2f55-497c-8eeb-cc2bbd09e28c None None] Pushing event updated for resources: {'Port': ['ID=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:21.670425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=ba411cff-abfe-421c-93a3-cc27adcca313,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:21.689696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.696047 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b9852638-7be8-4a98-8da8-685a2454a729 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ba411cff-abfe-421c-93a3-cc27adcca313 HTTP/1.1" status: 204 len: 168 time: 1.0936980 Nov 24 04:08:21.717697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56662) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:21.834427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc98bb9b-42d2-4230-a295-f571405f2a15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.837291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc98bb9b-42d2-4230-a295-f571405f2a15 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.840880 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cc98bb9b-42d2-4230-a295-f571405f2a15 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/6a96468e-8d5e-4cf5-b1b5-107fea1fbc98 HTTP/1.1" status: 204 len: 168 time: 1.2711070 Nov 24 04:08:21.867420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc98bb9b-42d2-4230-a295-f571405f2a15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a96468e-8d5e-4cf5-b1b5-107fea1fbc98,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:21.886489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-dd4c3961-e8bf-43c2-a6fd-9fa492c861eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.934696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Router 4f8aa7cd-415d-4905-bed0-488cc84270e3 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:08:21.942497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b16f6f22-9ec8-455b-bfdc-56955cdb66ff triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:21.942959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:21.983055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23fd9ff2-5424-40e3-99ed-0d17d4484ec8 None None] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:22.034972 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-981d265d-ae7f-4519-80ec-005f145756cf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.3116500 Nov 24 04:08:22.041471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56666) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:22.052408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:22.173475 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-dd4c3961-e8bf-43c2-a6fd-9fa492c861eb None None] For port fceaaa92-0388-4de8-a246-c71f3e89b312, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fceaaa92-0388-4de8-a246-c71f3e89b312,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:22.191473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-dd4c3961-e8bf-43c2-a6fd-9fa492c861eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.197586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:22.237384 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.240218 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d771b0e2-ef64-4128-a964-1e2c43d156c6 admin admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 5.6953254 Nov 24 04:08:22.245525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56670) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:22.254069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.267145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4c3961-e8bf-43c2-a6fd-9fa492c861eb None None] Pushing event updated for resources: {'Port': ['ID=fceaaa92-0388-4de8-a246-c71f3e89b312,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:22.271197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Sync routers for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:22.333602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:22.334280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:22.338404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Router 3d0d90ae-c638-4277-9998-3fafd099dea4 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:08:22.382221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a68c2fd8-a5c8-415d-b06d-3f88d871baf2 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:22.387767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:22.388411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:08:22.388888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.410066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:22.424273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:22.438746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56672) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:22.443943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Subnet': ['ID=8b2dc85e-9eb8-4d86-87fe-ee1ca6ec680f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:22.473803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eed91697-1e14-47a7-a8b3-beee5836fac1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.481432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Pushing event updated for resources: {'Port': ['ID=5503f0ee-7113-45e0-8806-1eb6b4320966,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:22.487630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Deleting port f688eefe-d86f-4b9a-a7e2-b373c097c325 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:22.488554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.499202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Provisioning complete for port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:22.499579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.511727 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 24 04:08:22.512769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:08:22.593346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Checking segment: {'id': 'fae71bb8-94f2-4971-92fd-8011d637e68a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': '96a1d837-87e8-4a7b-a567-7c86c310fda7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:22.593639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Network hostable DHCP agents. Network: 96a1d837-87e8-4a7b-a567-7c86c310fda7, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:22.597510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:22.611771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.634495 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70b28543-0e73-41ab-be7f-487bfec19b39 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:22.700470 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-26e29e7e-dd39-41d9-9972-1837ed7e0c48 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 409 len: 372 time: 3.3657813 Nov 24 04:08:22.732522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:22.746934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56674) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:22.758079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:22.785710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eed91697-1e14-47a7-a8b3-beee5836fac1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.826967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Provisioning complete for port 70b28543-0e73-41ab-be7f-487bfec19b39 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:22.827980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.844201 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eed91697-1e14-47a7-a8b3-beee5836fac1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.881939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed91697-1e14-47a7-a8b3-beee5836fac1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6659332f-8ed5-41d9-8388-78b16903cea1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:22.954936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.979308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 70b28543-0e73-41ab-be7f-487bfec19b39 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:22.979723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:22.992461 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Calling delete_port for f688eefe-d86f-4b9a-a7e2-b373c097c325 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:22.996517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:23.016069 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9643c2f0-baef-41e7-a736-0956e640a026 admin admin] 10.222.0.48 "PUT /v2.0/routers/3d0d90ae-c638-4277-9998-3fafd099dea4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5661142 Nov 24 04:08:23.019590 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Sync routers for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:23.058255 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:23.058906 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:23.123711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Network 96a1d837-87e8-4a7b-a567-7c86c310fda7 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:23.183508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 96a1d837-87e8-4a7b-a567-7c86c310fda7) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:23.188935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:23.189795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.206033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.232349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:08:23.232871 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eed91697-1e14-47a7-a8b3-beee5836fac1 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=6648401989b34cfaa063e3e336fd3e82&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7852659 Nov 24 04:08:23.240637 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e1ddd8be-59ce-47f9-a897-4560290fee94 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.2208493 Nov 24 04:08:23.241598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56678) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:23.253251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56680) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:23.286016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'floatingip': {'floating_network_id': '96a1d837-87e8-4a7b-a567-7c86c310fda7'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:23.288148 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:23.315085 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-df229cbb-7272-46fd-980b-9a030390906c None None] For port 70b28543-0e73-41ab-be7f-487bfec19b39, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70b28543-0e73-41ab-be7f-487bfec19b39,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:23.315314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08e86f9c-ea43-4c5c-8359-02d71900a28e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.340125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08e86f9c-ea43-4c5c-8359-02d71900a28e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.348478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12d8c1bf-607c-44b9-9da2-be85c1638a8b None None] Network 96a1d837-87e8-4a7b-a567-7c86c310fda7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:23.414673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.416399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08e86f9c-ea43-4c5c-8359-02d71900a28e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.419354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08e86f9c-ea43-4c5c-8359-02d71900a28e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.420666 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-08e86f9c-ea43-4c5c-8359-02d71900a28e admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/6659332f-8ed5-41d9-8388-78b16903cea1 HTTP/1.1" status: 204 len: 168 time: 0.1734314 Nov 24 04:08:23.439384 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e86f9c-ea43-4c5c-8359-02d71900a28e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6659332f-8ed5-41d9-8388-78b16903cea1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:23.448970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Deleting port 0bfae97a-e6f4-4ac5-aa66-cacea5e62825 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:23.449389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.491959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.566734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.592478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.687748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Pushing event updated for resources: {'Port': ['ID=70b28543-0e73-41ab-be7f-487bfec19b39,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:23.721783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.733147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:23.771215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:23.783547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.783879 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.785562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.801978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:23.803048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:23.815490 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=5bb4c713-c27b-470a-888a-694f63a7aaab,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:23.857539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Calling delete_port for 0bfae97a-e6f4-4ac5-aa66-cacea5e62825 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:23.868434 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 2, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:23.939312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event deleted for resources: {'Port': ['ID=f688eefe-d86f-4b9a-a7e2-b373c097c325,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:23.959045 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Checking router: 3d0d90ae-c638-4277-9998-3fafd099dea4 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:23.959411 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Updating router 3d0d90ae-c638-4277-9998-3fafd099dea4 port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:23.994171 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.031948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-840c3546-f5f9-4385-a3b9-de74249b11bb None None] Network 96a1d837-87e8-4a7b-a567-7c86c310fda7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:24.033661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Provisioning complete for port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:24.034027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.095389 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dea3a4e4-b342-4b72-a9f5-ef2b1900adae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.0510197 Nov 24 04:08:24.101865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56700) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:24.111900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'name': 'tempest-NetworksTestDHCPv6-583581721'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:24.271320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Allocated IP 172.20.0.1 (bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30/d6b900d5-6e1c-467d-a80c-b932fd4e77fd/6df9846b-1643-450c-93a1-74fa97e85511) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:24.316596 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:24.348290 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.358801 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.532315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.533281 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb4fefe-ce28-45fd-ab80-d5336d6a9424 None None] Pushing event updated for resources: {'Port': ['ID=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:24.571650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 3, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:24.575963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Pushing event deleted for resources: {'Port': ['ID=0bfae97a-e6f4-4ac5-aa66-cacea5e62825,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:24.612344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] Deleting port fceaaa92-0388-4de8-a246-c71f3e89b312 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:24.613385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.649798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:24.672125 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Attempting to bind port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:24.672259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.672497 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Attempting to bind port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:24.672859 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Attempting to bind port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 on network 4064fe6e-1a4a-440d-8829-8ec4922458b8 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:24.679262 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:24.679642 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Checking segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:24.680045 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.680428 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Bound using segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:24.680902 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Bound port: 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:24.681368 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.704635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56716) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:24.727345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1207125185', 'description': 'tempest-description--425700169'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:24.750490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] For port fceaaa92-0388-4de8-a246-c71f3e89b312, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fceaaa92-0388-4de8-a246-c71f3e89b312,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:24.751148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.756598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.764581 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.764581 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3e78adf5-7060-4e9e-930b-af55f9be66e6 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021 tempest-ExternalNetworksAdminNegativeTestJSON-1309658021-project-admin] 10.222.0.48 "DELETE /v2.0/floatingips/f255ff5a-935b-438c-8b2f-3eaf071c4a48 HTTP/1.1" status: 204 len: 168 time: 2.0120249 Nov 24 04:08:24.776850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] Calling delete_port for fceaaa92-0388-4de8-a246-c71f3e89b312 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:24.807072 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] For port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:24.810935 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] For port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:24.821968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.822910 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.826131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 2d1223b5-a664-49ff-a1ca-75e4bc515541 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:24.831096 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4af4132d-4530-4304-87d1-f205fe0db30c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "DELETE /v2.0/ports/f688eefe-d86f-4b9a-a7e2-b373c097c325 HTTP/1.1" status: 204 len: 168 time: 3.3771284 Nov 24 04:08:24.856352 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56722) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:24.859882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.913440 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb4fefe-ce28-45fd-ab80-d5336d6a9424 None None] Pushing event updated for resources: {'Port': ['ID=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:24.927464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.950079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:24.951475 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Checking router: 4f8aa7cd-415d-4905-bed0-488cc84270e3 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:24.951475 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Updating router 4f8aa7cd-415d-4905-bed0-488cc84270e3 port 56919873-aabb-4651-947d-5d6a306972db binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:24.986024 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:24.989361 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:25.037092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:25.037648 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.039854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.074634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.149624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::310 (a2b36c78-43a6-4954-8102-cb5638999bb1/5bb4c713-c27b-470a-888a-694f63a7aaab/2d1223b5-a664-49ff-a1ca-75e4bc515541) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:25.190575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:25.198959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:25.234247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Pushing event updated for resources: {'Port': ['ID=6df9846b-1643-450c-93a1-74fa97e85511,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:25.236761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:25.237176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.297282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.301759 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:25.324442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.405961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.433763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.435285 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.7190809 Nov 24 04:08:25.463680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56732) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:25.466055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb93326e-18ed-447f-b2df-dabe5759b38e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fcf99b5f-7951-4261-91bc-7f9e9857a9fd,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:25.489758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.496591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.515600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Request body: {'security_group_rule': {'security_group_id': 'fcf99b5f-7951-4261-91bc-7f9e9857a9fd', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:25.591210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.598166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56734) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:25.623830 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d2d8ecf7-a006-480d-8bae-e1c23ab07c45 tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4560 time: 0.7619293 Nov 24 04:08:25.630742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56738) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:25.636319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1809868916'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:25.649991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.656980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] No DVR routers for this DVR port fceaaa92-0388-4de8-a246-c71f3e89b312 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:08:25.658510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Provisioning complete for port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:25.659364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.704559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdec786-f3f4-4b51-b3bd-57398733b9ac None None] Pushing event deleted for resources: {'Port': ['ID=fceaaa92-0388-4de8-a246-c71f3e89b312,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:25.808679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.815370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.826138 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:24Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:25.831993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.850658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fab00ab9-acf2-4956-aff3-cdd563ec5348 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:25.854269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed77fd8e-77e9-447a-89ff-107e08c9d514 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:25.862848 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69dd6a74-bd95-42ae-8d59-fbd4a0631c2e None None] The sync data for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv is: [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:24Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:25.956264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Allocated IP 172.20.0.13 (96a1d837-87e8-4a7b-a567-7c86c310fda7/8b2dc85e-9eb8-4d86-87fe-ee1ca6ec680f/3e4bfeb4-ef66-4174-aac2-81cab5247bb5) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:25.964558 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Attempting to bind port 56919873-aabb-4651-947d-5d6a306972db on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:25.965670 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Attempting to bind port 56919873-aabb-4651-947d-5d6a306972db by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:25.965845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Attempting to bind port 56919873-aabb-4651-947d-5d6a306972db on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:26.008331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:26.008705 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:26.009176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.009669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:26.010427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Bound port: 56919873-aabb-4651-947d-5d6a306972db, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:26.010882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.012577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b776364-74c9-4e85-982f-8e14a4f0addc None None] Pushing event updated for resources: {'Port': ['ID=56919873-aabb-4651-947d-5d6a306972db,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.106365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.145298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Made reservation on behalf of 351e7d4c69be4ad8825078ca51ac45b4 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:26.150109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.181909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.191830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.215015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.242128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e89876c6-8209-4909-934a-7fe1ce5f2e05,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.244476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.259748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.261155 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ab94e085-3597-4949-a9fe-86fc9bcc80f9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7853346 Nov 24 04:08:26.279699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] For port 56919873-aabb-4651-947d-5d6a306972db, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:26.294657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56750) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:26.295019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56752) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:26.296539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fceaaa92-0388-4de8-a246-c71f3e89b312 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:26.301192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Request body: {'security_group_rule': {'security_group_id': 'fcf99b5f-7951-4261-91bc-7f9e9857a9fd', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:26.329115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Port': ['ID=3e4bfeb4-ef66-4174-aac2-81cab5247bb5,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.334038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Network 96a1d837-87e8-4a7b-a567-7c86c310fda7 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:26.337144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:26.350757 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.351466 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Added segment 2359e222-3fa2-4b08-ab75-556c26401c40 of type vlan for network 0477ad1b-a572-41ba-a77d-9c53ed029fe6 Nov 24 04:08:26.373613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] For port 56919873-aabb-4651-947d-5d6a306972db, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56919873-aabb-4651-947d-5d6a306972db,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:26.379363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fceaaa92-0388-4de8-a246-c71f3e89b312 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:26.379532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fceaaa92-0388-4de8-a246-c71f3e89b312 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:08:26.393780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.412948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.445745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port fceaaa92-0388-4de8-a246-c71f3e89b312 not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:08:26.446377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6867c2e-06aa-430e-b4c2-d9e4227ffa74 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:26.450779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.454968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:26.463646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:26.484654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-95671785', 'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:26.490106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.492543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.493617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.496110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:26.496703 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.510095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-df229cbb-7272-46fd-980b-9a030390906c None None] For port b6867c2e-06aa-430e-b4c2-d9e4227ffa74, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,segment=NetworkSegment(be98b3c0-70b2-46fe-b3aa-474dfd2bede2),segment_id=be98b3c0-70b2-46fe-b3aa-474dfd2bede2)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:26.524937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:26.542782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.547718 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.577735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:26.584141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b776364-74c9-4e85-982f-8e14a4f0addc None None] Pushing event updated for resources: {'Port': ['ID=56919873-aabb-4651-947d-5d6a306972db,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.595491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=2d1223b5-a664-49ff-a1ca-75e4bc515541,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.598105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:26.604317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:26.605107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.630433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:26.632411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:26.656496 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.0246718 Nov 24 04:08:26.657224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12424b10-bd37-4ec2-ac50-9d4558d4542c tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event updated for resources: {'Network': ['ID=0477ad1b-a572-41ba-a77d-9c53ed029fe6,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.659186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56756) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:26.685776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.688017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Router 8f58b51f-193c-43f1-ae94-d69a879a0453 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:08:26.750105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 0477ad1b-a572-41ba-a77d-9c53ed029fe6 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:26.752366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.754347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df229cbb-7272-46fd-980b-9a030390906c None None] Pushing event updated for resources: {'Port': ['ID=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.773761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '5bb4c713-c27b-470a-888a-694f63a7aaab'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:26.776476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.802345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Made reservation on behalf of cbb7c05c40054eb690b9e741395338ee for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:26.804820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.812511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed77fd8e-77e9-447a-89ff-107e08c9d514 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.819670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.821033 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5250404 Nov 24 04:08:26.831497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Could not find standard attr ID for object f688eefe-d86f-4b9a-a7e2-b373c097c325. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:26.834135 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d6090007-3d34-4354-934f-12a2568df77f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.7310095 Nov 24 04:08:26.840190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56758) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:26.840663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56760) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:26.841511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:26.842036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.844661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed77fd8e-77e9-447a-89ff-107e08c9d514 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.847373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26909a16-1252-4c61-a898-5359105078dd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d4722ad-4be1-49d6-97a4-0eb681df8dfe,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:26.849624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:26.868546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:26.904602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Pushing event updated for resources: {'Port': ['ID=6df9846b-1643-450c-93a1-74fa97e85511,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:27.000291 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ed77fd8e-77e9-447a-89ff-107e08c9d514 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=0837f835a79f4a8e833980f3e0cb1546&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4006155 Nov 24 04:08:27.001281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed77fd8e-77e9-447a-89ff-107e08c9d514 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07d08d97-eacc-4e87-9305-eeea92771b08,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:27.004169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56762) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:27.007860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:27.019783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.027392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:27.085022 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e758903-20df-4df5-9fe5-d8ce5f1ae4dc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:27.086791 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6e758903-20df-4df5-9fe5-d8ce5f1ae4dc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.2431750 Nov 24 04:08:27.106375 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56764) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:27.158526 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c20d96a5-cb42-42ba-a739-28eabf49a60b tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/agents/2017f21b-d647-4a6e-b306-49195b4c6afd/dhcp-networks HTTP/1.1" status: 200 len: 7243 time: 0.4955232 Nov 24 04:08:27.161453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56766) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:27.185269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:27.216872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.222214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.228478 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c73952f6-b4ec-4864-a2d2-22e44cf69f0a admin admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 917 time: 11.3053558 Nov 24 04:08:27.228882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Sync routers for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:27.232169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56768) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:27.255072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Provisioning complete for port 6df9846b-1643-450c-93a1-74fa97e85511 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:27.255427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.294873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.365588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:27.368276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b42cb3e-0b54-4475-8a0d-4338bfc02594 tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] Network 0477ad1b-a572-41ba-a77d-9c53ed029fe6 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:27.369017 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:27.369414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:27.387473 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b42cb3e-0b54-4475-8a0d-4338bfc02594 tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "POST /v2.0/agents/2017f21b-d647-4a6e-b306-49195b4c6afd/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.2250302 Nov 24 04:08:27.390362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56770) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:27.410235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-508ac60b-3d6d-45eb-990b-9a9f211a2668 None None] Network 0477ad1b-a572-41ba-a77d-9c53ed029fe6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:27.432810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.473965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Port 6df9846b-1643-450c-93a1-74fa97e85511 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:27.479798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.489218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f784b9ed-ce32-4c06-baaa-fc41e6601884 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.503755 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/5bb4c713-c27b-470a-888a-694f63a7aaab/5f909c7e-09a8-4b7c-9d7b-d65e94f448c9) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:27.511175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Could not find standard attr ID for object fceaaa92-0388-4de8-a246-c71f3e89b312. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:27.604114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] vlan segment allocate from pool success with {'vlan_id': 178, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:27.630049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f784b9ed-ce32-4c06-baaa-fc41e6601884 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.644604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81f22f8f-2786-45c3-ad7d-6a6398f7af17,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:27.657463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Router 4f8aa7cd-415d-4905-bed0-488cc84270e3 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:08:27.662050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.662576 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Added segment 0451bee4-7ffd-476c-a911-9a7fe64d0f9a of type vlan for network 189c11b3-8b23-4af9-bb88-8b84a0f455ec Nov 24 04:08:27.716421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:27.781306 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e1e801aa-85b0-47f7-b89f-3fc375299d2d tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/agents/2017f21b-d647-4a6e-b306-49195b4c6afd/dhcp-networks HTTP/1.1" status: 200 len: 8013 time: 0.3836625 Nov 24 04:08:27.781927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56772) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:27.805940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.821792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.848073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 2d1223b5-a664-49ff-a1ca-75e4bc515541 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:27.848623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.855135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.943054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Provisioning complete for port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:27.943941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:27.996471 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0e225440-adb6-47ce-b22d-65003524849a tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "DELETE /v2.0/agents/2017f21b-d647-4a6e-b306-49195b4c6afd/dhcp-networks/0477ad1b-a572-41ba-a77d-9c53ed029fe6 HTTP/1.1" status: 204 len: 168 time: 0.2120476 Nov 24 04:08:27.997583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Port': ['ID=3e4bfeb4-ef66-4174-aac2-81cab5247bb5,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:28.002024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56774) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.020090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.021729 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f784b9ed-ce32-4c06-baaa-fc41e6601884 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.024316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f784b9ed-ce32-4c06-baaa-fc41e6601884 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.027956 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f784b9ed-ce32-4c06-baaa-fc41e6601884 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/07d08d97-eacc-4e87-9305-eeea92771b08 HTTP/1.1" status: 204 len: 168 time: 1.0151560 Nov 24 04:08:28.080583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.084060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f784b9ed-ce32-4c06-baaa-fc41e6601884 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07d08d97-eacc-4e87-9305-eeea92771b08,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:28.085553 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3144807-a15f-4a9a-81c7-6aa36491e9c8 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.8277183 Nov 24 04:08:28.089844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56778) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.095373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.096311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:28.096892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.107992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.149057 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70b28543-0e73-41ab-be7f-487bfec19b39 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:28.233348 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c5064904-59cd-47c8-af08-e85c6c410c5c tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "GET /v2.0/floatingips?floating_network_id=96a1d837-87e8-4a7b-a567-7c86c310fda7 HTTP/1.1" status: 200 len: 690 time: 0.1395464 Nov 24 04:08:28.236199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56780) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.340227 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f6f1d668-ff81-4a06-8c5a-8f08ca322b14 tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/agents/2017f21b-d647-4a6e-b306-49195b4c6afd/dhcp-networks HTTP/1.1" status: 200 len: 7243 time: 0.3367538 Nov 24 04:08:28.343277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56782) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.381534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.384064 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-203f0b69-cb70-40f5-ad3b-b23874653405 tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/networks/5e2ee65d-d6cd-44a3-bb7c-95d872e79f96/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.0396636 Nov 24 04:08:28.386800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56784) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.396752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:28.399596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.401064 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 869 time: 2.1033208 Nov 24 04:08:28.404422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56786) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.410097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'subnet': {'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:28.412551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 70b28543-0e73-41ab-be7f-487bfec19b39 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:28.413044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.414946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.417562 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-47df6686-3fd0-4590-9db3-5a73aa90a21b admin admin] 10.222.0.48 "PUT /v2.0/routers/4f8aa7cd-415d-4905-bed0-488cc84270e3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1707752 Nov 24 04:08:28.450777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.486123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.491646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 2d1223b5-a664-49ff-a1ca-75e4bc515541 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:28.528480 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7de443f4-b1ce-4fca-9669-a5b6b039e576 tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/networks/5e2ee65d-d6cd-44a3-bb7c-95d872e79f96/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.1404946 Nov 24 04:08:28.534772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] For port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:28.540578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-55107c64-edc7-4e53-a09c-11036404293d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:26Z', 'revision_number': 2, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:28.549590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56792) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.554843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.558279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Made reservation on behalf of cbb7c05c40054eb690b9e741395338ee for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:28.560985 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.581680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:28.598238 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55107c64-edc7-4e53-a09c-11036404293d None None] The sync data for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv is: [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:26Z', 'revision_number': 2, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:28.600159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:28.606619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5663ab-914d-4170-ad93-7c68d849de17 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Network': ['ID=189c11b3-8b23-4af9-bb88-8b84a0f455ec,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:28.610400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:28.619609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:22Z', 'revision_number': 3, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:28.631578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Pushing event updated for resources: {'Port': ['ID=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:28.706852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 189c11b3-8b23-4af9-bb88-8b84a0f455ec details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:28.736410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56800) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:28.747879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Checking router: 8f58b51f-193c-43f1-ae94-d69a879a0453 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:28.748337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Updating router 8f58b51f-193c-43f1-ae94-d69a879a0453 port 5503f0ee-7113-45e0-8806-1eb6b4320966 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:28.774406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Deleting port 3e4bfeb4-ef66-4174-aac2-81cab5247bb5 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:28.774758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.801234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Provisioning complete for port 70b28543-0e73-41ab-be7f-487bfec19b39 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:28.801569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:28.885874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Allocated IP 172.26.5.167 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/821066e1-70dd-43b3-8e94-cc706e3bbd45) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:29.004530 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-288fd5e3-c8c7-4ef5-8f02-ac363c2dbca7 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=fa1ebb6cf4e14903a7c63687524e28eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2669094 Nov 24 04:08:29.008612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56806) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:29.026066 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-02d480ee-0a0a-4c55-a60b-f2359eb653fd tempest-DHCPAgentSchedulersTestJSON-524628397 tempest-DHCPAgentSchedulersTestJSON-524628397-project-admin] 10.222.0.48 "GET /v2.0/agents/2017f21b-d647-4a6e-b306-49195b4c6afd/dhcp-networks HTTP/1.1" status: 200 len: 7243 time: 0.4753523 Nov 24 04:08:29.042777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56808) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:29.090246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.090578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.105336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.146344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6867c2e-06aa-430e-b4c2-d9e4227ffa74 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:29.203263 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Attempting to bind port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:29.203695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Attempting to bind port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:29.204115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Attempting to bind port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:29.208783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.232369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Calling delete_port for 3e4bfeb4-ef66-4174-aac2-81cab5247bb5 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:29.238516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Pushing event updated for resources: {'Port': ['ID=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:29.270245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:29.270525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:29.270835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.271235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:29.271722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Bound port: 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:29.272106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.272227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.491303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.500240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:29.500609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.502577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Allocated IP 172.20.0.1 (9279fc65-0f7e-4ac5-8fda-e94ff426a487/ac08ee4f-45d7-4c2e-ab90-055d80970c38/6f666d10-1f35-49b9-8b78-f904cf455c7c) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:29.519298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0477ad1b-a572-41ba-a77d-9c53ed029fe6']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:29.529212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2359e222-3fa2-4b08-ab75-556c26401c40') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:29.529597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2359e222-3fa2-4b08-ab75-556c26401c40') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:29.539118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.539327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] For port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:29.552684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.558795 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Releasing vlan 182 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:29.559172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.590092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] For port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:29.592666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Provisioning complete for port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:29.593293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f81d6d6b-384b-4c60-955a-01b770a310df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.622507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:29.632760 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:29.667858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.679539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.706059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2ff63067-8e77-42d7-abf1-dab695d6b9cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.708523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.716431 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "DELETE /v2.0/networks/0477ad1b-a572-41ba-a77d-9c53ed029fe6 HTTP/1.1" status: 204 len: 168 time: 0.6643620 Nov 24 04:08:29.746187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56812) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:29.757504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd5cf0a0-87ba-4e55-9aa6-a58fe4d5119d None None] Pushing event updated for resources: {'Port': ['ID=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:29.764221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.800170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7131333e-ac24-421f-bfc9-37f893840114 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event deleted for resources: {'Network': ['ID=0477ad1b-a572-41ba-a77d-9c53ed029fe6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:29.831726 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:29.877974 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b98c006-c580-470c-ba3e-8bf73d6b07ee tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] DELETE failed (client error): The resource could not be found. Nov 24 04:08:29.879659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b98c006-c580-470c-ba3e-8bf73d6b07ee tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:08:29.891678 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1b98c006-c580-470c-ba3e-8bf73d6b07ee tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "DELETE /v2.0/ports/f688eefe-d86f-4b9a-a7e2-b373c097c325 HTTP/1.1" status: 404 len: 333 time: 0.1339645 Nov 24 04:08:29.898863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.919077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=2d1223b5-a664-49ff-a1ca-75e4bc515541,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:29.922522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56814) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:29.941139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.941139 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2a541297-747b-4213-9188-87eb13f1f521 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/2d1223b5-a664-49ff-a1ca-75e4bc515541 HTTP/1.1" status: 204 len: 168 time: 2.8212852 Nov 24 04:08:29.943360 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56816) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:29.943688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56818) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:29.955491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2ff63067-8e77-42d7-abf1-dab695d6b9cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:29.982546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:29.983162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.003971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:30.008368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Request body: {'security_group': {'name': 'tempest-securitygroup--500632814', 'description': 'tempest-description--1238582999'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:30.090312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:30.093476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:30.094252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.129075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:30.175297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4f0de498-8063-4231-9a87-58db468a9af4 None None] Provisioning complete for port 6df9846b-1643-450c-93a1-74fa97e85511 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:30.175722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f0de498-8063-4231-9a87-58db468a9af4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.222656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.251088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4f0de498-8063-4231-9a87-58db468a9af4 None None] Port 6df9846b-1643-450c-93a1-74fa97e85511 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:30.289032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:30.289473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.309302 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.326279 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2ffbb57-29b2-45f3-8180-c7da86d3cf96 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:30.328373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2ffbb57-29b2-45f3-8180-c7da86d3cf96 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:30.333355 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b2ffbb57-29b2-45f3-8180-c7da86d3cf96 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.3657386 Nov 24 04:08:30.334364 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56820) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:30.371650 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:08:30.390485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.437724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 5bb4c713-c27b-470a-888a-694f63a7aaab {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:08:30.444653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Deleting subnet 5fc8b036-8420-4810-b0e9-31b877c8e3c3 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:08:30.454005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.472905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.476946 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.5280406 Nov 24 04:08:30.476946 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.509027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56822) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:30.525580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.526563 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Request body: {'security_group_rule': {'security_group_id': 'c44ed4b6-b064-46c5-b181-829da0b490b1', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:30.533331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-673ed27b-1d86-473c-9c7d-412be0b65ff0 None None] Provisioning complete for port 6f666d10-1f35-49b9-8b78-f904cf455c7c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:30.534315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-673ed27b-1d86-473c-9c7d-412be0b65ff0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.545653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Pushing event updated for resources: {'Port': ['ID=6f666d10-1f35-49b9-8b78-f904cf455c7c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:30.557326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.569968 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.589458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Port': ['ID=3e4bfeb4-ef66-4174-aac2-81cab5247bb5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:30.602661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-673ed27b-1d86-473c-9c7d-412be0b65ff0 None None] Port 6f666d10-1f35-49b9-8b78-f904cf455c7c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:30.605989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2ff63067-8e77-42d7-abf1-dab695d6b9cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.609914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2ff63067-8e77-42d7-abf1-dab695d6b9cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.611292 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2ff63067-8e77-42d7-abf1-dab695d6b9cb admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/fa120a1d-3794-45cb-a3bd-15e1b2ea6aba HTTP/1.1" status: 204 len: 168 time: 1.5979638 Nov 24 04:08:30.615435 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fceaaa92-0388-4de8-a246-c71f3e89b312 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:08:30.625723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.630940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df764a3-c789-4ecf-8a7f-d6f7d5f05a06 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c44ed4b6-b064-46c5-b181-829da0b490b1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:30.650279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fceaaa92-0388-4de8-a246-c71f3e89b312 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:30.650715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fceaaa92-0388-4de8-a246-c71f3e89b312 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:08:30.654880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.667464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.722541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff63067-8e77-42d7-abf1-dab695d6b9cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa120a1d-3794-45cb-a3bd-15e1b2ea6aba,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:30.855818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.875493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.908285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.976114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.980512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:30.982023 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4701016 Nov 24 04:08:30.982877 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6324a9c-24c6-46f7-9d4c-c7ba839bc3ad tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66f9de70-c48c-44b6-8317-a6076f157384,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:30.987528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56826) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:31.038551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Request body: {'security_group_rule': {'security_group_id': 'c44ed4b6-b064-46c5-b181-829da0b490b1', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:31.085640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:31.087187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event updated for resources: {'Port': ['ID=821066e1-70dd-43b3-8e94-cc706e3bbd45,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:31.087319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56919873-aabb-4651-947d-5d6a306972db up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:31.095943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:31.098635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:31.148145 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:08:31.148952 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.168631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.238380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.251585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.272649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.312818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 56919873-aabb-4651-947d-5d6a306972db triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:31.313409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.333897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.345894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.351535 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=5bb4c713-c27b-470a-888a-694f63a7aaab,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:31.356771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.360552 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ba158ca3-a7f1-453d-b333-c2116af58f32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/5bb4c713-c27b-470a-888a-694f63a7aaab HTTP/1.1" status: 204 len: 168 time: 1.0200968 Nov 24 04:08:31.367030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.367922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.373656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56836) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:31.410765 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.414797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01d0da20-b5e2-4cee-83e7-1468a9edf455 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:31.432520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Subnet': ['ID=d77a702d-35de-44c6-8fe9-03bced4d3eba,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:31.442005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.447683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.479903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Checking segment: {'id': '0451bee4-7ffd-476c-a911-9a7fe64d0f9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:31.480547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network hostable DHCP agents. Network: 189c11b3-8b23-4af9-bb88-8b84a0f455ec, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:31.485033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.489147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event deleted for resources: {'Subnet': ['ID=5fc8b036-8420-4810-b0e9-31b877c8e3c3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:31.491725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.495613 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b0e5d460-eb12-4b56-97a9-8417159de406 tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "DELETE /v2.0/subnets/5fc8b036-8420-4810-b0e9-31b877c8e3c3 HTTP/1.1" status: 204 len: 168 time: 1.5680404 Nov 24 04:08:31.500669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56838) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:31.535106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ea71947-4e50-4b8a-89a4-25c0b65f4a49 None None] Network 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:31.615176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network 189c11b3-8b23-4af9-bb88-8b84a0f455ec is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:31.624849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] Provisioning complete for port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:31.625472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.627462 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Attempting to bind port 5503f0ee-7113-45e0-8806-1eb6b4320966 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:31.627928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Attempting to bind port 5503f0ee-7113-45e0-8806-1eb6b4320966 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:31.628375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Attempting to bind port 5503f0ee-7113-45e0-8806-1eb6b4320966 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:31.636920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ae8e97-e7d2-401b-aaaf-9ba0f6c41ae9 None None] Pushing event updated for resources: {'Port': ['ID=5503f0ee-7113-45e0-8806-1eb6b4320966,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:31.649283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.656683 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 189c11b3-8b23-4af9-bb88-8b84a0f455ec) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:31.666345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:31.666917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.681753 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.712496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-343c92d5-73ce-4a17-bd7b-f6f2851cd4ef None None] Network 189c11b3-8b23-4af9-bb88-8b84a0f455ec requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:31.717292 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-946ba0cd-3539-4819-a542-ab18a1031250 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 3.3118427 Nov 24 04:08:31.720326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.726993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:31.727509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:31.727909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.728302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:31.728783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Bound port: 5503f0ee-7113-45e0-8806-1eb6b4320966, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:31.729159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.733894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56844) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:31.734798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=8b2dc85e-9eb8-4d86-87fe-ee1ca6ec680f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:31.746394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-1302027780', 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:31.848351 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.853514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Made reservation on behalf of cbb7c05c40054eb690b9e741395338ee for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:31.855755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.866176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.879275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 56919873-aabb-4651-947d-5d6a306972db, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56919873-aabb-4651-947d-5d6a306972db,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:31.907698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] device_id is not set on port 7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:31.917040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96a1d837-87e8-4a7b-a567-7c86c310fda7']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:31.927183 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.928159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:31.930076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fae71bb8-94f2-4971-92fd-8011d637e68a') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:31.937618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fae71bb8-94f2-4971-92fd-8011d637e68a') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:31.941744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Deleting port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:31.942083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:31.978865 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f04cd257-345b-4f1c-959f-e5b3b7faaf4c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.5981679 Nov 24 04:08:31.982684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56852) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:31.993503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:32.012458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.087941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.129952 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56854) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:32.130125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.153659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Pushing event updated for resources: {'Port': ['ID=6f666d10-1f35-49b9-8b78-f904cf455c7c,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:32.162463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Releasing vlan 196 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:32.162889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.169082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:32.169245 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:32.174910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.177409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] For port 5503f0ee-7113-45e0-8806-1eb6b4320966, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:32.234652 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] For port 5503f0ee-7113-45e0-8806-1eb6b4320966, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=5503f0ee-7113-45e0-8806-1eb6b4320966,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:32.241310 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] For port b6867c2e-06aa-430e-b4c2-d9e4227ffa74, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,segment=NetworkSegment(be98b3c0-70b2-46fe-b3aa-474dfd2bede2),segment_id=be98b3c0-70b2-46fe-b3aa-474dfd2bede2)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:32.244821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.255386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.283385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.304291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.315357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=16586f2d-26ee-4278-a466-a5c902c83b87,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:32.330328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=56919873-aabb-4651-947d-5d6a306972db,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:32.331838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event updated for resources: {'Port': ['ID=821066e1-70dd-43b3-8e94-cc706e3bbd45,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:32.357736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:32.360355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:32.368188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Calling delete_port for b6867c2e-06aa-430e-b4c2-d9e4227ffa74 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:32.380062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Allocated IP 172.20.0.3 (189c11b3-8b23-4af9-bb88-8b84a0f455ec/d77a702d-35de-44c6-8fe9-03bced4d3eba/7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:32.386261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.388597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:08:32.429035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.441820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1323139430'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:32.462263 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.463909 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-be734e3a-0d88-4229-8bf0-eb444213bb30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4285309 Nov 24 04:08:32.474808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1fcdc75-3475-4b30-b8b7-a6bf6d061b49 None None] Network 189c11b3-8b23-4af9-bb88-8b84a0f455ec requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:32.475868 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Sync routers for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:32.485889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:32.486428 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.489944 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:32.491656 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:32.492957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 96a1d837-87e8-4a7b-a567-7c86c310fda7 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:08:32.500927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:32.504540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.510899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56858) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:32.512070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.517955 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/networks/96a1d837-87e8-4a7b-a567-7c86c310fda7 HTTP/1.1" status: 204 len: 168 time: 4.2807839 Nov 24 04:08:32.522344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.532898 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-840e55d7-2945-4b37-b4ba-be195c568991 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.6824009 Nov 24 04:08:32.532898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56860) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:32.554222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:32.569829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] DHCP port deletion for 5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:08:32.583392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce93bf5-d981-4aee-b56e-4e89045e587b tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Network': ['ID=96a1d837-87e8-4a7b-a567-7c86c310fda7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:32.590389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:32.591046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:32.728076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Made reservation on behalf of d37a09eae8f64345857dfee0a8e964ab for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:32.737597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.765159 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:32.768547 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ae8e97-e7d2-401b-aaaf-9ba0f6c41ae9 None None] Pushing event updated for resources: {'Port': ['ID=5503f0ee-7113-45e0-8806-1eb6b4320966,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:32.774394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] For port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:32.793558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.797136 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1f0e3319-c3b9-4275-bf29-990c2b1f77cf tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 691 time: 0.2451661 Nov 24 04:08:32.799900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56866) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:32.860043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Router 8f58b51f-193c-43f1-ae94-d69a879a0453 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:08:32.862669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:32.865316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.019427 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.041893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] Could not find standard attr ID for object 2d1223b5-a664-49ff-a1ca-75e4bc515541. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:33.121326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:33.126941 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b44c91f4-ff1d-4cb9-bc8e-80cab0347a59 admin admin] 10.222.0.48 "PUT /v2.0/routers/8f58b51f-193c-43f1-ae94-d69a879a0453/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8835702 Nov 24 04:08:33.133201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] Deleting port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:33.133818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.146605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event deleted for resources: {'Port': ['ID=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:33.170444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] No DVR routers for this DVR port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:08:33.203863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.204315 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.204771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.205249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.205690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.206118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.206582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.208345 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6eac98eb-6e59-434d-b8c3-641e59cfc541 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4607 time: 0.3965173 Nov 24 04:08:33.211326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56886) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:33.272603 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:26Z', 'revision_number': 2, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:33.286954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56894) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:33.289121 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 04:08:33.290334 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-221cdce3-c6b3-4a8a-bb21-5d9cac6bdf58 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] delete failed (client error): The resource could not be found. Nov 24 04:08:33.294171 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-221cdce3-c6b3-4a8a-bb21-5d9cac6bdf58 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/floatingips/3a70abec-8428-41c1-9c67-2724a0ba4454 HTTP/1.1" status: 404 len: 345 time: 0.0818028 Nov 24 04:08:33.294745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56896) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:33.302023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:33.325784 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Checking router: 4f8aa7cd-415d-4905-bed0-488cc84270e3 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:33.326400 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Updating router 4f8aa7cd-415d-4905-bed0-488cc84270e3 port 6df9846b-1643-450c-93a1-74fa97e85511 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:33.365244 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.406486 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-b12c2e9a-f5c2-4d15-aceb-f06d4063f2bf tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-securitygroup--1207125185&fields=id&tenant_id=db5849637d02441e8e7822da79f37b83 HTTP/1.1" status: 200 len: 267 time: 0.1182487 Nov 24 04:08:33.408795 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-1ba9c986-1e71-4a58-9d0a-97a1f70a3356 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] DELETE failed (client error): The resource could not be found. Nov 24 04:08:33.409363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1ba9c986-1e71-4a58-9d0a-97a1f70a3356 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:08:33.428604 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1ba9c986-1e71-4a58-9d0a-97a1f70a3356 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/networks/96a1d837-87e8-4a7b-a567-7c86c310fda7 HTTP/1.1" status: 404 len: 339 time: 0.1101484 Nov 24 04:08:33.429298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56902) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:33.454205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Deleting port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:33.454842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.454944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'network': {'name': 'tempest-network--2067127121', 'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:33.525143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] For port b6867c2e-06aa-430e-b4c2-d9e4227ffa74, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:33.525855 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.554294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Calling delete_port for b6867c2e-06aa-430e-b4c2-d9e4227ffa74 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:33.559941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:08:33.572861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.582292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-00cdc273-6384-4d92-8d76-49c85fc1afb4 None None] Provisioning complete for port 6f666d10-1f35-49b9-8b78-f904cf455c7c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:33.582983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00cdc273-6384-4d92-8d76-49c85fc1afb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.603715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.626013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:33.629298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-00cdc273-6384-4d92-8d76-49c85fc1afb4 None None] Port 6f666d10-1f35-49b9-8b78-f904cf455c7c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:33.669940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Made reservation on behalf of 6bbeea287c51485fab52a581918dbccc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:33.672860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.685369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adecb29-3f96-4d1d-a904-2ed4008d8dd7 None None] Pushing event updated for resources: {'Port': ['ID=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:33.736696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] No DVR routers for this DVR port b6867c2e-06aa-430e-b4c2-d9e4227ffa74 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:08:33.744100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1906fa-1d8c-4acd-bcb0-e6004da7e5b4 None None] Pushing event deleted for resources: {'Port': ['ID=b6867c2e-06aa-430e-b4c2-d9e4227ffa74,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:33.747255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] For port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:33.748245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.758883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] vlan segment allocate from pool success with {'vlan_id': 196, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:33.771719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.776860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] Calling delete_port for 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:33.788364 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-b9bc23a1-9c05-43eb-97de-dd6a3b18abaa tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:33.789909 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-b9bc23a1-9c05-43eb-97de-dd6a3b18abaa tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 812 time: 0.3826571 Nov 24 04:08:33.798915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.799260 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Added segment 98be9fa8-d199-45db-8e24-b3f28110b7e9 of type vlan for network 017f7205-bbf6-4f5b-9385-01d50a724b19 Nov 24 04:08:33.818632 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.821408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:33.821961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.830812 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.884523 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f72a8dee-649c-410a-8975-515c28ddb6d1 None None] Pushing event updated for resources: {'Port': ['ID=6df9846b-1643-450c-93a1-74fa97e85511,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:33.899604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5e2ee65d-d6cd-44a3-bb7c-95d872e79f96']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:33.914754 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-31c335eb-6ca9-4d1e-89c6-c84dc26f20bc tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/quotas/db5849637d02441e8e7822da79f37b83 HTTP/1.1" status: 200 len: 375 time: 0.1148608 Nov 24 04:08:33.917771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.925481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:33.925774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'be98b3c0-70b2-46fe-b3aa-474dfd2bede2') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:33.936537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.947088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.951558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:33.977267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.023902 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.025735 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Attempting to bind port 6df9846b-1643-450c-93a1-74fa97e85511 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:34.026345 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Attempting to bind port 6df9846b-1643-450c-93a1-74fa97e85511 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:34.029259 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Attempting to bind port 6df9846b-1643-450c-93a1-74fa97e85511 on network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:34.039574 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:34.041158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:34.041647 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Checking segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:34.042069 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.043732 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Bound using segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:34.047057 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Bound port: 6df9846b-1643-450c-93a1-74fa97e85511, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:34.048114 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.118067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56906) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:34.125702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.132826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Port': ['ID=7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.135658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Request body: {'security_group': {'name': 'tempest-securitygroup--986033370', 'description': 'tempest-description--615754489'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:34.151054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.151901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:34.156230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Releasing vlan 162 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:34.156629 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.160707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.161113 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Added segment 618719f6-5c1e-4e4c-a80a-f0df7b7e1abe of type vlan for network 5d869497-2705-4cc2-b36d-4dea3a8792ca Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:34.164561 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:34.166577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e228570a-9e92-47dd-99b7-6170101f999e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.175829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:08:34.191346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.202942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:34.203180 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] For port 6df9846b-1643-450c-93a1-74fa97e85511, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:34.220403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] Pushing event deleted for resources: {'Port': ['ID=5f909c7e-09a8-4b7c-9d7b-d65e94f448c9,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.226695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:34.227265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.232907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network 189c11b3-8b23-4af9-bb88-8b84a0f455ec is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:34.233427 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=6f314de2-454e-4f08-bee4-baf05f5a736b,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.265208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d53c8ce7-04bb-4b5b-a234-ac68f5f9e748 None None] No DVR routers for this DVR port 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:08:34.292060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8929b269-6bbe-4c9c-9c38-dc6fb633f305 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:34.314899 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-77142df6-3bb2-4407-870a-25e0719893a8 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3156660 Nov 24 04:08:34.326195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.328596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:34.335776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 2, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:34.377265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:34.380757 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.382780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.389916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:34.390576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.401955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.405854 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] For port 6df9846b-1643-450c-93a1-74fa97e85511, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6df9846b-1643-450c-93a1-74fa97e85511,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:34.417072 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.418484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.429982 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-02731a04-1872-45a9-b953-5e57b86d31c2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.4392428 Nov 24 04:08:34.464443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56912) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:34.468710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.496493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.502949 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:34.502949 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:07Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:34.503703 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] 10.222.0.48 "DELETE /v2.0/networks/5e2ee65d-d6cd-44a3-bb7c-95d872e79f96 HTTP/1.1" status: 204 len: 168 time: 2.9847152 Nov 24 04:08:34.553409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c72eef-84b0-4a6d-9406-3894226ebffc tempest-DHCPAgentSchedulersTestJSON-1748948870 tempest-DHCPAgentSchedulersTestJSON-1748948870-project] Pushing event deleted for resources: {'Network': ['ID=5e2ee65d-d6cd-44a3-bb7c-95d872e79f96,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.579162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'name': 'tempest-NetworksTestDHCPv6-497317582'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:34.584665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Network': ['ID=017f7205-bbf6-4f5b-9385-01d50a724b19,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.596470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:34.599253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.658862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56919873-aabb-4651-947d-5d6a306972db up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:34.664381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 017f7205-bbf6-4f5b-9385-01d50a724b19 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:34.688821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Allocated IP 172.26.5.125 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/8aac0b0c-6dbb-49ea-85cb-46c26161b754) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:34.710266 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:34.761477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ebf4a6-bd8e-430b-9e38-7e85ffe34f19 None None] The sync data for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv is: [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 2, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:34.783060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-bdc6739e-de47-4418-865c-83d76142941b service neutron] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:08:34.793520 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-bdc6739e-de47-4418-865c-83d76142941b service neutron] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2046854 Nov 24 04:08:34.835744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event updated for resources: {'SecurityGroup': ['ID=76b249c4-619a-41db-83bc-ecf04415e0cf,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:34.842942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.854843 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2dab502a-2a6d-45ab-b43c-3ecaa10782fa tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 1.4127517 Nov 24 04:08:34.875578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56918) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:34.885175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:34.885524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.886730 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a1f857c4-5fab-40e4-85c7-c064a44937ac tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.7578859 Nov 24 04:08:34.894717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.903163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56922) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:34.911942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ce26ad84-4264-47d1-963e-40f43ca9abc6 None None] Provisioning complete for port 6df9846b-1643-450c-93a1-74fa97e85511 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:34.912464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ce26ad84-4264-47d1-963e-40f43ca9abc6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:34.939019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Request body: {'security_group_rule': {'security_group_id': '76b249c4-619a-41db-83bc-ecf04415e0cf', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:35.019739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d2b2548e-a4ec-4673-bf46-24e7f9a0b071 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.023338 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0ddfe614-14b5-4665-8152-8b789434f068 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1023 time: 3.2825308 Nov 24 04:08:35.044295 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f72a8dee-649c-410a-8975-515c28ddb6d1 None None] Pushing event updated for resources: {'Port': ['ID=6df9846b-1643-450c-93a1-74fa97e85511,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:35.063205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56924) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:35.078646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 56919873-aabb-4651-947d-5d6a306972db triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:35.083471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.126391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56926) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:35.157526 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:34Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:35.191284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '6f314de2-454e-4f08-bee4-baf05f5a736b'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:35.192407 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.246907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.272766 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2224c6be-66b8-4543-b81e-7c92c2b3adae None None] The sync data for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv is: [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:34Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:35.295601 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 3.1596453 Nov 24 04:08:35.348136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56930) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:35.377995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'subnet': {'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:35.400824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549aea61-aa7c-494a-9904-6b797568c584 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Network': ['ID=5d869497-2705-4cc2-b36d-4dea3a8792ca,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:35.458380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.492226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:35.494382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ce26ad84-4264-47d1-963e-40f43ca9abc6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.524873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89c44917-22d5-438e-87f1-c210d1f2814e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:35.528600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6867c2e-06aa-430e-b4c2-d9e4227ffa74 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:08:35.531836 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89c44917-22d5-438e-87f1-c210d1f2814e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:35.539071 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89c44917-22d5-438e-87f1-c210d1f2814e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:35.545198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89c44917-22d5-438e-87f1-c210d1f2814e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:35.551615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89c44917-22d5-438e-87f1-c210d1f2814e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:35.553397 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-89c44917-22d5-438e-87f1-c210d1f2814e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3056 time: 0.6656563 Nov 24 04:08:35.557604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56932) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:35.577788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b6867c2e-06aa-430e-b4c2-d9e4227ffa74 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:35.578395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6867c2e-06aa-430e-b4c2-d9e4227ffa74 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:08:35.578968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:08:35.631329 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-f76c6518-05e1-46b6-a1c4-dfc035b7ddfd service neutron] 10.222.0.48 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8358688 Nov 24 04:08:35.644407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.653262 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f566914a-f991-47e7-ad05-54d9ca9c9324 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=351e7d4c69be4ad8825078ca51ac45b4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5201156 Nov 24 04:08:35.659393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56934) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:35.668517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.672444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Deleting port 7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:35.672444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.672711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:35.672982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5f909c7e-09a8-4b7c-9d7b-d65e94f448c9 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:08:35.681827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ce26ad84-4264-47d1-963e-40f43ca9abc6 None None] For port 6df9846b-1643-450c-93a1-74fa97e85511, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6df9846b-1643-450c-93a1-74fa97e85511,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:35.696630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ce26ad84-4264-47d1-963e-40f43ca9abc6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.718372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.743285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/6f314de2-454e-4f08-bee4-baf05f5a736b/05640fa5-dcdb-4fd8-8486-ce2d71c67728) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:35.744177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d865034b-f8c0-47c6-886c-c1ebde1d2a32,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:35.780320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Made reservation on behalf of d37a09eae8f64345857dfee0a8e964ab for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:35.782598 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce26ad84-4264-47d1-963e-40f43ca9abc6 None None] Pushing event updated for resources: {'Port': ['ID=6df9846b-1643-450c-93a1-74fa97e85511,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:35.784197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.821731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.829101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:35.833431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.852717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 1ed2eb12-2b94-4c06-bba4-5eab6337ce53 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:35.867224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:35.880940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:35.882287 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c7ef58cb-0b46-46e6-b0e6-76bd57ded768 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9531469 Nov 24 04:08:35.887744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:35.893129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56936) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:35.898391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event updated for resources: {'Port': ['ID=8aac0b0c-6dbb-49ea-85cb-46c26161b754,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:35.911045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Request body: {'security_group_rule': {'security_group_id': '76b249c4-619a-41db-83bc-ecf04415e0cf', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:35.951695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:35.953356 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-f855c191-35f5-43f0-b654-d21a252b2329 service neutron] 10.222.0.48 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3036470 Nov 24 04:08:36.012697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-00948590-d30e-4663-b80f-039ce469c623 None None] Provisioning complete for port 6df9846b-1643-450c-93a1-74fa97e85511 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:36.013367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00948590-d30e-4663-b80f-039ce469c623 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.045342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.051692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cda782e2-9592-424d-a6de-40df8d2fd37a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.059980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.096012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.097770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.099484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.099484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > port after_create 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.101056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > port after_delete 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.102368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > port after_update 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.103451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.106805 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.107510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.107664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.107759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.122715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Calling delete_port for 7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:36.126703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.150215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cda782e2-9592-424d-a6de-40df8d2fd37a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.243035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.248846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:36.306332 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:36.309650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Pushing event updated for resources: {'Port': ['ID=05640fa5-dcdb-4fd8-8486-ce2d71c67728,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:36.312333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:36.392125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Attempting to bind port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:36.392839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Attempting to bind port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:36.397658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Attempting to bind port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:36.425991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:36.426711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:36.427339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.432754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:36.433291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Bound port: 05640fa5-dcdb-4fd8-8486-ce2d71c67728, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:36.433809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.443120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.550744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cda782e2-9592-424d-a6de-40df8d2fd37a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.554041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cda782e2-9592-424d-a6de-40df8d2fd37a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.554823 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6df9846b-1643-450c-93a1-74fa97e85511 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:36.558132 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cda782e2-9592-424d-a6de-40df8d2fd37a admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/d2a3b840-78f2-4610-8861-f432196f14d9 HTTP/1.1" status: 204 len: 168 time: 0.8980312 Nov 24 04:08:36.569908 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.573651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.585405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.586487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.586987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.587477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=103380) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 04:08:36.588049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['017f7205-bbf6-4f5b-9385-01d50a724b19']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:36.597017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda782e2-9592-424d-a6de-40df8d2fd37a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2a3b840-78f2-4610-8861-f432196f14d9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:36.600409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.634200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '98be9fa8-d199-45db-8e24-b3f28110b7e9') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:36.634876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '98be9fa8-d199-45db-8e24-b3f28110b7e9') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:36.651201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.672464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.684490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] For port 05640fa5-dcdb-4fd8-8486-ce2d71c67728, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:36.691697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] For port 05640fa5-dcdb-4fd8-8486-ce2d71c67728, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=05640fa5-dcdb-4fd8-8486-ce2d71c67728,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:36.708902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.720994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4b47dbcf-80b1-466e-9221-7ca8c1b77f1c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:36.729374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56960) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:36.735402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.736616 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3aa7b904-7e2f-41b2-a657-6cd06fff5c60 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8394263 Nov 24 04:08:36.741909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Subnet': ['ID=36a855ec-1766-47fd-a2f1-cb38daa5cac1,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:36.751863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.759091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 56962) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:36.763507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:36.773577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::93 (a2b36c78-43a6-4954-8102-cb5638999bb1/6f314de2-454e-4f08-bee4-baf05f5a736b/1ed2eb12-2b94-4c06-bba4-5eab6337ce53) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:36.781883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.839920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event deleted for resources: {'Port': ['ID=7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:36.850327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Checking segment: {'id': '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:36.850530 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network hostable DHCP agents. Network: 5d869497-2705-4cc2-b36d-4dea3a8792ca, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:08:36.877353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b068cb07-4b01-4a24-bec4-a2c8f9ed58fa None None] Pushing event updated for resources: {'Port': ['ID=05640fa5-dcdb-4fd8-8486-ce2d71c67728,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:36.897898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6df9846b-1643-450c-93a1-74fa97e85511 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:36.898306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.923390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Releasing vlan 196 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:36.923796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.926517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: from cryptography.utils import int_from_bytes Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: from cryptography.utils import int_from_bytes Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:36.927863 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:37.198184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.210605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 017f7205-bbf6-4f5b-9385-01d50a724b19 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:08:37.237330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Network': ['ID=017f7205-bbf6-4f5b-9385-01d50a724b19,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:37.245419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.259490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e78c8a14-62af-4a94-a67e-999ede2dab10 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/networks/017f7205-bbf6-4f5b-9385-01d50a724b19 HTTP/1.1" status: 204 len: 168 time: 1.6984763 Nov 24 04:08:37.264047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56968) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.303381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'network': {'name': 'tempest-network--1194968448', 'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:37.351315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.363599 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 04:08:37.372437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Made reservation on behalf of 6bbeea287c51485fab52a581918dbccc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:37.375060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.378189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56974) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.416461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df26748a-54b6-43f4-9008-1faeeaab4fc8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.435185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] vlan segment allocate from pool success with {'vlan_id': 154, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:37.449724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.462607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.462957 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Added segment 9a702aa5-5569-4939-b883-7a4740df6e66 of type vlan for network 48fbb99c-5b19-47b2-b015-14104bf42e5f Nov 24 04:08:37.477477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.553076 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-77b9d50f-ed48-48d6-bb8e-c300fc8c50be req-c078e431-7909-4e8b-a169-793ee8a648bb tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.8151519 Nov 24 04:08:37.559650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:37.575093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:37.578035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.582564 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f2990f72-07ac-4867-99e2-898819a5cc51 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/ports/7e7bfbe4-2f37-4ed2-98b7-29b8ea9994ca HTTP/1.1" status: 204 len: 168 time: 2.5141587 Nov 24 04:08:37.586613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56982) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.587651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:37.591894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.593842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:37.594402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.609489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=1ed2eb12-2b94-4c06-bba4-5eab6337ce53,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:37.621751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'external_fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3'}]}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:37.627326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.641492 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:08:37.704711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.706136 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.711347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df26748a-54b6-43f4-9008-1faeeaab4fc8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.722103 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4aad23ed-a523-4b61-ba4a-41a7ca19285f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.1519396 Nov 24 04:08:37.724477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56984) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.727845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df26748a-54b6-43f4-9008-1faeeaab4fc8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.753867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.754827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:37.755407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.761254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.771410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event updated for resources: {'Port': ['ID=8aac0b0c-6dbb-49ea-85cb-46c26161b754,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:37.794407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 5d869497-2705-4cc2-b36d-4dea3a8792ca) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:37.800239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:37.800887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.806342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-791a3bb7-ebcd-49ce-bca6-a7865ada8ed7 None None] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:37.865243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.874889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-31ea0aac-0fa9-4ba2-86ac-d02896dd2438 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.3344138 Nov 24 04:08:37.908387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:37.913395 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-df26748a-54b6-43f4-9008-1faeeaab4fc8 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=96b9f0ee38034cabb3802e348a1f9546&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5332305 Nov 24 04:08:37.935153 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.6693265 Nov 24 04:08:37.943852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56990) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.944343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56992) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.946918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 56994) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:37.947034 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eda3488b-8d40-49a8-a04d-b0117cd6706d tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5917444 Nov 24 04:08:37.952176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df26748a-54b6-43f4-9008-1faeeaab4fc8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd285aaa-f724-468a-9e5e-7333aa4203f7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:38.024136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.121045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a42c8623-f44c-4975-8b02-1ac218ae8ee6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.160640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-995838866', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:38.235037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-5d869497-2705-4cc2-b36d-4dea3a8792ca', 'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca', 'tenant_id': 'd37a09eae8f64345857dfee0a8e964ab', 'fixed_ips': [{'subnet_id': '36a855ec-1766-47fd-a2f1-cb38daa5cac1'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:38.236212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.330217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Allocated IP 172.26.5.8 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/c7e79400-9389-41db-8a8d-3154de89f8c1) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:38.364355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9051319-4e84-4722-9c4c-41de0a499615 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:38.370726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9051319-4e84-4722-9c4c-41de0a499615 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:38.372308 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b9051319-4e84-4722-9c4c-41de0a499615 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1667 time: 0.6456265 Nov 24 04:08:38.386294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57012) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:38.410962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a6f421-e019-4d77-8215-e0ffae8533d2 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Network': ['ID=48fbb99c-5b19-47b2-b015-14104bf42e5f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:38.425993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 48fbb99c-5b19-47b2-b015-14104bf42e5f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:38.468077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b697c8aa-299d-4edf-9246-f143a5be2746 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:38.469774 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b697c8aa-299d-4edf-9246-f143a5be2746 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] 10.222.0.48 "GET /v2.0/networks/48fbb99c-5b19-47b2-b015-14104bf42e5f HTTP/1.1" status: 200 len: 757 time: 0.4891734 Nov 24 04:08:38.480139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57014) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:38.521810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.524686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5503f0ee-7113-45e0-8806-1eb6b4320966 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:38.549589 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.551351 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.623883 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-e2515087-b318-475c-935b-373b2622841a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-securitygroup--500632814&fields=id&tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49 HTTP/1.1" status: 200 len: 267 time: 0.2751467 Nov 24 04:08:38.632130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd452ca-2030-4fc8-b22c-d7bc0d1be166 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.773101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 1ed2eb12-2b94-4c06-bba4-5eab6337ce53 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:38.773451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.877896 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:38.892294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 1ed2eb12-2b94-4c06-bba4-5eab6337ce53 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:38.929142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8752511-a61c-4824-8bec-1aa373dfa095 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:38.932530 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e8752511-a61c-4824-8bec-1aa373dfa095 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] 10.222.0.48 "GET /v2.0/networks/e7b1bbe2-91db-433d-bb88-8704668a680f HTTP/1.1" status: 200 len: 768 time: 0.4513171 Nov 24 04:08:38.967865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57020) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:38.997693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.042458 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.046208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Allocated IP 172.20.0.2 (5d869497-2705-4cc2-b36d-4dea3a8792ca/36a855ec-1766-47fd-a2f1-cb38daa5cac1/fa45325c-186b-458f-b38b-9b6163076cd2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:39.048823 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4a8f751d-4f69-463e-ad10-e2c53bcbb3ee None None] Provisioning complete for port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:39.049526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4a8f751d-4f69-463e-ad10-e2c53bcbb3ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.090987 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8076488c-1666-46ba-8021-f85ed2ffe6ae req-249e1cc0-22f1-4dc3-960e-2f5ee0978e2f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.1474602 Nov 24 04:08:39.177193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 5503f0ee-7113-45e0-8806-1eb6b4320966 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:39.177689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.309070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.332145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd452ca-2030-4fc8-b22c-d7bc0d1be166 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.334422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.345339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.373166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.466554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:39.495613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:39.498029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:39.514360 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.515846 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4d64702f-1253-4c04-992f-af0fec1303c1 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 714 time: 1.5368338 Nov 24 04:08:39.522629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57022) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:39.596457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.600231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event updated for resources: {'Port': ['ID=c7e79400-9389-41db-8a8d-3154de89f8c1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:39.603086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.610461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4a8f751d-4f69-463e-ad10-e2c53bcbb3ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.625058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.635512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.640788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48fbb99c-5b19-47b2-b015-14104bf42e5f']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:39.654164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.673769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a702aa5-5569-4939-b883-7a4740df6e66') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:39.674116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a702aa5-5569-4939-b883-7a4740df6e66') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:39.688285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-4a02834c-4cb0-485e-9852-ce022115ff75 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:39.690181 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-4a02834c-4cb0-485e-9852-ce022115ff75 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/networks?id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 HTTP/1.1" status: 200 len: 811 time: 1.0638988 Nov 24 04:08:39.694256 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 5503f0ee-7113-45e0-8806-1eb6b4320966, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=5503f0ee-7113-45e0-8806-1eb6b4320966,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:39.711367 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd452ca-2030-4fc8-b22c-d7bc0d1be166 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.713522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd452ca-2030-4fc8-b22c-d7bc0d1be166 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.714764 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-afd452ca-2030-4fc8-b22c-d7bc0d1be166 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/dd285aaa-f724-468a-9e5e-7333aa4203f7 HTTP/1.1" status: 204 len: 168 time: 1.7416773 Nov 24 04:08:39.723825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.744104 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.21', 52617) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:39.776791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=1ed2eb12-2b94-4c06-bba4-5eab6337ce53,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:39.814509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Pushing event updated for resources: {'Port': ['ID=fa45325c-186b-458f-b38b-9b6163076cd2,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:39.821144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.821990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.824597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 05640fa5-dcdb-4fd8-8486-ce2d71c67728 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:39.826974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.830786 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e3645c5e-5065-4d0b-98bd-2eb9ba62b4ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/1ed2eb12-2b94-4c06-bba4-5eab6337ce53 HTTP/1.1" status: 204 len: 168 time: 1.4391961 Nov 24 04:08:39.831650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd452ca-2030-4fc8-b22c-d7bc0d1be166 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd285aaa-f724-468a-9e5e-7333aa4203f7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:39.844972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57026) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:39.889522 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-3b318a10-7c6d-4dd8-b69d-05e1cfaba79b tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/quotas/f983a1d6cdc44b639c49bee8aa3a5f49 HTTP/1.1" status: 200 len: 375 time: 0.1850412 Nov 24 04:08:39.955404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=5503f0ee-7113-45e0-8806-1eb6b4320966,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:39.956925 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Releasing vlan 154 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:39.958561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:39.995161 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:40.017657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:40.031194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4a8f751d-4f69-463e-ad10-e2c53bcbb3ee None None] For port 05640fa5-dcdb-4fd8-8486-ce2d71c67728, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=05640fa5-dcdb-4fd8-8486-ce2d71c67728,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:40.044487 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:40.060561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4a8f751d-4f69-463e-ad10-e2c53bcbb3ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.069624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:40.089026 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.141180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-4a4326d1-b082-4b8b-b8d9-371297703e91 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:40.142918 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-4a4326d1-b082-4b8b-b8d9-371297703e91 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 812 time: 0.3966506 Nov 24 04:08:40.183497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.185704 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11adca8c-4c88-486a-afb7-f753609d7b26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:40.188499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11adca8c-4c88-486a-afb7-f753609d7b26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:40.190299 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-11adca8c-4c88-486a-afb7-f753609d7b26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.3405302 Nov 24 04:08:40.246602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57038) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:40.268223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-845e9e4c-d10e-443b-b52d-92e26e8471d7 None None] Could not find standard attr ID for object aede96d2-5d6c-45b5-8c19-5d520ff7835c. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:40.276744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Attempting to bind port fa45325c-186b-458f-b38b-9b6163076cd2 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:40.277131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Attempting to bind port fa45325c-186b-458f-b38b-9b6163076cd2 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:40.277506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Attempting to bind port fa45325c-186b-458f-b38b-9b6163076cd2 on network 5d869497-2705-4cc2-b36d-4dea3a8792ca {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:40.315902 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-845e9e4c-d10e-443b-b52d-92e26e8471d7 None None] Could not find standard attr ID for object 1ed2eb12-2b94-4c06-bba4-5eab6337ce53. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:40.330634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-845e9e4c-d10e-443b-b52d-92e26e8471d7 None None] Could not find standard attr ID for object 2d1223b5-a664-49ff-a1ca-75e4bc515541. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:40.333025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:40.333631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Checking segment: {'id': '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:40.334194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.334991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Bound using segment: {'id': '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:40.335987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Bound port: fa45325c-186b-458f-b38b-9b6163076cd2, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:40.336623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.343411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:40.344023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.391588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 6f314de2-454e-4f08-bee4-baf05f5a736b {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:08:40.408006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.415890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 48fbb99c-5b19-47b2-b015-14104bf42e5f {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:08:40.425915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.433767 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/networks/48fbb99c-5b19-47b2-b015-14104bf42e5f HTTP/1.1" status: 204 len: 168 time: 1.4574354 Nov 24 04:08:40.436940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.462244 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-e6d077ba-9eed-4172-9a87-ee97137a0abc tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5631118 Nov 24 04:08:40.476413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a8f751d-4f69-463e-ad10-e2c53bcbb3ee None None] Pushing event updated for resources: {'Port': ['ID=05640fa5-dcdb-4fd8-8486-ce2d71c67728,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:40.500067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57048) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:40.510178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.517395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'network': {'name': 'tempest-network--1078728513'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:40.570397 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a5323938-9f33-480e-ba54-5868cd7126e1 req-52bbdba4-d166-4598-92be-88e7599b8e33 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.2024271 Nov 24 04:08:40.588209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530b63b2-0274-485f-9f34-e3910d92fe09 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Network': ['ID=48fbb99c-5b19-47b2-b015-14104bf42e5f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:40.617532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.619143 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-17f20396-f594-40d3-8117-bd188463afb8 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db5849637d02441e8e7822da79f37b83 HTTP/1.1" status: 200 len: 380 time: 0.3222563 Nov 24 04:08:40.651058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Request body: {'port': {'device_id': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'admin_state_up': True, 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'security_groups': ['fcf99b5f-7951-4261-91bc-7f9e9857a9fd']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:40.669680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] For port fa45325c-186b-458f-b38b-9b6163076cd2, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:40.683355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] For port fa45325c-186b-458f-b38b-9b6163076cd2, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fa45325c-186b-458f-b38b-9b6163076cd2,segment=NetworkSegment(618719f6-5c1e-4e4c-a80a-f0df7b7e1abe),segment_id=618719f6-5c1e-4e4c-a80a-f0df7b7e1abe)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:40.710555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.822905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.835211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.911615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.923847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.959313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0aa48e8-cbca-42b9-8790-2b9f80bc794e None None] Pushing event updated for resources: {'Port': ['ID=fa45325c-186b-458f-b38b-9b6163076cd2,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:40.972227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Made reservation on behalf of 6bbeea287c51485fab52a581918dbccc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:40.983668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:40.986666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.111289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.194658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5503f0ee-7113-45e0-8806-1eb6b4320966 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:41.211199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.212846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=6f314de2-454e-4f08-bee4-baf05f5a736b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:41.223125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.305770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 5503f0ee-7113-45e0-8806-1eb6b4320966 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:41.306603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.340065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event updated for resources: {'Port': ['ID=c7e79400-9389-41db-8a8d-3154de89f8c1,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:41.360783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.378880 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ccc231e3-d879-48b9-a483-fc29364f1040 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/6f314de2-454e-4f08-bee4-baf05f5a736b HTTP/1.1" status: 204 len: 168 time: 1.1295931 Nov 24 04:08:41.382998 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57078) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:41.448156 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-76a33f16-037e-442f-8af9-5cb85c0d1950 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0618565 Nov 24 04:08:41.448584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57082) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:41.473627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Allocated IP 172.20.0.3 (189c11b3-8b23-4af9-bb88-8b84a0f455ec/d77a702d-35de-44c6-8fe9-03bced4d3eba/1e5f9a77-8f74-4200-a69d-a72fbd560409) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:41.478980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56432a76-a880-42aa-a908-d12cdd138130 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:41.591139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.617595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f6e0e4c-69c6-4e75-96e9-039beeda8b1a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:41.619697 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6f6e0e4c-69c6-4e75-96e9-039beeda8b1a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1701338 Nov 24 04:08:41.623982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.636182 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-05c213ca-d960-4dd9-a293-e493a030f953 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 4.8758414 Nov 24 04:08:41.636949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57086) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:41.678922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.772625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 05640fa5-dcdb-4fd8-8486-ce2d71c67728 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:41.796440 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0e315cf3-7b6e-4995-bc91-6dd626e739bd req-4867255a-37ff-4804-b69d-b1a157722026 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.0517089 Nov 24 04:08:41.799679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:41.802174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c588da86-36c4-46ec-a57b-53a279131141 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:41.803875 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c588da86-36c4-46ec-a57b-53a279131141 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1659367 Nov 24 04:08:41.811031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57090) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:41.860041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:08:41.928025 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fc07b262-ae36-470d-8c76-8c93d137873c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1153274 Nov 24 04:08:41.955861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57096) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:41.976643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:42.039605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.045198 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Added segment 2ed4c642-6e64-4551-a47d-b9faae3b7937 of type vlan for network 845fffcc-929a-4cf2-bed6-b63bc28d158b Nov 24 04:08:42.144792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.150531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:42.151276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.255404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:08:42.475996 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-00428a0d-25d4-4f5d-be40-3e5478976fff tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-securitygroup--986033370&fields=id&tenant_id=ca64a4f493b349449d44be7e1d9fb98c HTTP/1.1" status: 200 len: 267 time: 0.3149395 Nov 24 04:08:42.628527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.666319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] Deleting port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:42.669224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.691480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.699864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:42.700578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.757468 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Sync routers for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:42.772414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network 189c11b3-8b23-4af9-bb88-8b84a0f455ec is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:42.850288 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-486ae44e-dc9c-4cfa-b899-20e3c6b62912 service neutron] 10.222.0.48 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=segments HTTP/1.1" status: 200 len: 212 time: 2.3466551 Nov 24 04:08:42.901175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:42.907269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71e6d9bf-1a33-45ab-aa2b-93c5b4698b8b None None] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:42.976607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] For port 05640fa5-dcdb-4fd8-8486-ce2d71c67728, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=05640fa5-dcdb-4fd8-8486-ce2d71c67728,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:42.978482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:42.981899 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Made reservation on behalf of db5849637d02441e8e7822da79f37b83 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:42.987222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:43.003945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57122) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:43.012927 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:43.021782 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 2.5180213 Nov 24 04:08:43.031618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] Calling delete_port for 05640fa5-dcdb-4fd8-8486-ce2d71c67728 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:43.036368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Port': ['ID=1e5f9a77-8f74-4200-a69d-a72fbd560409,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:43.084624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57124) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:43.173710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Request body: {'network': {'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:43.233876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:43.236067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:43.238642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:43.250328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fa45325c-186b-458f-b38b-9b6163076cd2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:43.253879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:43.279379 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:43.282097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6497612f-fe7a-43cc-adc8-f979ba87b585 None None] Provisioning complete for port fa45325c-186b-458f-b38b-9b6163076cd2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:43.282561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6497612f-fe7a-43cc-adc8-f979ba87b585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:43.421989 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-9c9fcc1b-ca8f-4044-8f80-0e10e32a1852 service neutron] 10.222.0.48 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5072079 Nov 24 04:08:43.441613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1956ff10-f249-4203-b8ae-ddccbf4351d1 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-267671060'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:43.442916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1956ff10-f249-4203-b8ae-ddccbf4351d1 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Unknown quota resources ['metering_label']. {{(pid=103380) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:08:43.567054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] No DVR routers for this DVR port 05640fa5-dcdb-4fd8-8486-ce2d71c67728 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:08:43.593907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80f0f3e-66b5-411b-85bc-b8ebc32dfe07 None None] Pushing event deleted for resources: {'Port': ['ID=05640fa5-dcdb-4fd8-8486-ce2d71c67728,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:43.681712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-0c3c60b3-912e-405b-a0e4-4845aa60e309 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:43.689986 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-0c3c60b3-912e-405b-a0e4-4845aa60e309 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/networks?id=9279fc65-0f7e-4ac5-8fda-e94ff426a487 HTTP/1.1" status: 200 len: 805 time: 1.2026939 Nov 24 04:08:43.715818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946847b2-04b7-4151-85af-5ad21971e61a tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Network': ['ID=845fffcc-929a-4cf2-bed6-b63bc28d158b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:43.740903 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-435cd8db-d706-413d-851f-ed5f1f8b5744 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/quotas/ca64a4f493b349449d44be7e1d9fb98c HTTP/1.1" status: 200 len: 375 time: 0.0449762 Nov 24 04:08:43.761187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 845fffcc-929a-4cf2-bed6-b63bc28d158b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:08:43.884960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:43.909244 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-67490f2a-e830-4f1b-b760-7689f89e4329 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=ca64a4f493b349449d44be7e1d9fb98c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1719260 Nov 24 04:08:43.960927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:43.965144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:43.970067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:43.970743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:43.991973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=73ae8a6d-17d2-4316-adf9-8d55606b46cd,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:44.005172 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ccbe2c24-3002-4cfb-845c-97a660aecb46 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.0467906 Nov 24 04:08:44.007970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57140) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:44.027367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '73ae8a6d-17d2-4316-adf9-8d55606b46cd', 'ip_address': '2001:db8::7518:9376:869:a78b'}], 'name': 'tempest-NetworksTestDHCPv6-1036438365'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:44.076503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-445c57da-70d2-4876-96e6-ff8bcf77556d None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:44.175821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:44.207388 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-17d12092-8186-4bdf-a135-e943722e94d0 service neutron] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:08:44.221563 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-17d12092-8186-4bdf-a135-e943722e94d0 service neutron] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1469257 Nov 24 04:08:44.256698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port fa45325c-186b-458f-b38b-9b6163076cd2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:44.257232 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:44.424038 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4a3c2aaa-b7c4-455b-a9fb-3d5f2ece6dd9 req-4ee52a66-1360-4ed4-ac26-110d74dc3f76 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.2942424 Nov 24 04:08:44.523174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6497612f-fe7a-43cc-adc8-f979ba87b585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:44.614164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:44.651871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:44.680746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-8a8c2d21-b751-4647-875f-2ce4d5bec05a service neutron] 10.222.0.48 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4580865 Nov 24 04:08:44.804578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1956ff10-f249-4203-b8ae-ddccbf4351d1 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:44.805990 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1956ff10-f249-4203-b8ae-ddccbf4351d1 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 477 time: 1.7908323 Nov 24 04:08:44.811819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57158) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:44.817204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0bc1afb7-0f71-4496-9156-db62f5aa4102 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': 'bcac4503-911e-43da-8dc2-c342dc8cba15'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:44.818030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0bc1afb7-0f71-4496-9156-db62f5aa4102 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103381) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:08:44.909710 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b86f6c21-8677-4d3e-8959-63954bb09bb0 req-cdd87f42-e08e-45d7-85bb-290d11ab7e33 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.1018271 Nov 24 04:08:44.936113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-6497612f-fe7a-43cc-adc8-f979ba87b585 None None] For port fa45325c-186b-458f-b38b-9b6163076cd2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fa45325c-186b-458f-b38b-9b6163076cd2,segment=NetworkSegment(618719f6-5c1e-4e4c-a80a-f0df7b7e1abe),segment_id=618719f6-5c1e-4e4c-a80a-f0df7b7e1abe)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:44.947845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Allocated IP 172.20.0.5 (4064fe6e-1a4a-440d-8829-8ec4922458b8/df7e7408-6a2c-4f38-aa9d-4f7793f54ec8/bd0cfc7f-154f-4dba-bb4b-86d1245efb06) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:44.989221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.005661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6497612f-fe7a-43cc-adc8-f979ba87b585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.130238 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Allocated IP 172.20.0.1 (5d869497-2705-4cc2-b36d-4dea3a8792ca/36a855ec-1766-47fd-a2f1-cb38daa5cac1/2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:45.149823 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.services.metering.metering_plugin [None req-0bc1afb7-0f71-4496-9156-db62f5aa4102 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 24 04:08:45.154748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port fb1d0dc5-8998-4696-88ee-137f1fc79b6d yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:45.177855 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-b242fd9d-27f2-4daf-8830-8e0f15f75b72 service neutron] 10.222.0.48 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4954042 Nov 24 04:08:45.190799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.454313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6497612f-fe7a-43cc-adc8-f979ba87b585 None None] Pushing event updated for resources: {'Port': ['ID=fa45325c-186b-458f-b38b-9b6163076cd2,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:45.594460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:08:45.595768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:08:45.675800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0bc1afb7-0f71-4496-9156-db62f5aa4102 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.677129 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0bc1afb7-0f71-4496-9156-db62f5aa4102 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.8637042 Nov 24 04:08:45.677597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '73ae8a6d-17d2-4316-adf9-8d55606b46cd'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:45.681774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.697949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57174) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:45.703545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-54a4b743-2df6-44f4-a622-5f180ed57fd7 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': 'bcac4503-911e-43da-8dc2-c342dc8cba15'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:45.713289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-54a4b743-2df6-44f4-a622-5f180ed57fd7 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103381) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:08:45.724380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-754ab167-c40c-4df4-b84e-2e595c11fae9 None None] Provisioning complete for port fa45325c-186b-458f-b38b-9b6163076cd2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:45.727989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-754ab167-c40c-4df4-b84e-2e595c11fae9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.738690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.886841 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2cbf23d5-88c6-42d2-8f02-68fbea998025 req-3116866d-fd13-40aa-a618-d703038527dc tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0618434 Nov 24 04:08:45.912743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Network 845fffcc-929a-4cf2-bed6-b63bc28d158b is not hosted by any dhcp agent {{(pid=103380) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:08:45.915572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:45.921758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:45.923653 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "PUT /v2.0/networks/845fffcc-929a-4cf2-bed6-b63bc28d158b HTTP/1.1" status: 200 len: 858 time: 2.7845268 Nov 24 04:08:45.952454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 2, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:45.996443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Checking router: 8f58b51f-193c-43f1-ae94-d69a879a0453 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:45.996970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Updating router 8f58b51f-193c-43f1-ae94-d69a879a0453 port 6f666d10-1f35-49b9-8b78-f904cf455c7c binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:46.023393 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.033212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57178) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:46.062791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.180646 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.services.metering.metering_plugin [None req-54a4b743-2df6-44f4-a622-5f180ed57fd7 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 24 04:08:46.206532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/73ae8a6d-17d2-4316-adf9-8d55606b46cd/28ae2840-3e30-46c9-897c-a195554e7bbb) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:46.328664 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d9022126-b9f3-4e73-b924-1ecbd3842f3d req-9d8bd1e4-888d-44f4-85fe-1d0fbeb2ae3b tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.2275622 Nov 24 04:08:46.369214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 05640fa5-dcdb-4fd8-8486-ce2d71c67728 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:08:46.378094 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-54a4b743-2df6-44f4-a622-5f180ed57fd7 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.382656 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-54a4b743-2df6-44f4-a622-5f180ed57fd7 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.6829464 Nov 24 04:08:46.383517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57186) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:46.400604 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f9a02cc8-8b59-451b-b7ed-637c93424cf8 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules?id=59b9564d-e397-4bc9-ac25-e494ca6216cd HTTP/1.1" status: 200 len: 462 time: 0.0132332 Nov 24 04:08:46.403418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57188) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:46.473515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 05640fa5-dcdb-4fd8-8486-ce2d71c67728 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:46.475213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 05640fa5-dcdb-4fd8-8486-ce2d71c67728 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:08:46.480203 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47cfcdce-0461-4bde-9214-8b602ff4e920 req-cd40316e-297a-4943-b9da-39a62f60d9ea tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.6295409 Nov 24 04:08:46.569182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e533f3f5-7340-4033-9bd4-f9acbc682f44 tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event updated for resources: {'Network': ['ID=845fffcc-929a-4cf2-bed6-b63bc28d158b,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:46.571717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.710535 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.762823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.783997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.808124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fa45325c-186b-458f-b38b-9b6163076cd2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:46.962508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:46.979138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:46.987639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:46.999921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:47.027977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.079076 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-71cff718-8b3e-4a35-92a8-7553185e1b16 req-d4c29d32-0213-4d9f-98d5-864aa2ca6d83 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0699818 Nov 24 04:08:47.086766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3664fbb-043e-4d91-b664-2b2f53082130 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.102136 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b3664fbb-043e-4d91-b664-2b2f53082130 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-label-rules/59b9564d-e397-4bc9-ac25-e494ca6216cd HTTP/1.1" status: 204 len: 168 time: 0.6974709 Nov 24 04:08:47.104905 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57194) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:47.120090 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event updated for resources: {'Port': ['ID=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:47.125686 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-61a3ac3f-54a8-4017-b16e-a50fbb4cb74d tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules?id=59b9564d-e397-4bc9-ac25-e494ca6216cd HTTP/1.1" status: 200 len: 221 time: 0.0146713 Nov 24 04:08:47.125686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57196) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:47.129706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a2c2c028-1940-4180-baf3-21100f02d830 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--2130827675', 'description': 'label created by tempest'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:47.130399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a2c2c028-1940-4180-baf3-21100f02d830 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Unknown quota resources ['metering_label']. {{(pid=103381) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:08:47.138078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.216328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.260593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port fa45325c-186b-458f-b38b-9b6163076cd2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:47.260973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.432249 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.545050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::7518:9376:869:a78b (a2b36c78-43a6-4954-8102-cb5638999bb1/73ae8a6d-17d2-4316-adf9-8d55606b46cd/fb1d0dc5-8998-4696-88ee-137f1fc79b6d) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:47.580032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.586651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a2c2c028-1940-4180-baf3-21100f02d830 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.588133 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a2c2c028-1940-4180-baf3-21100f02d830 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.4652121 Nov 24 04:08:47.588620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6d6ac0-a64f-4b07-b557-322fa3383a14 None None] Pushing event updated for resources: {'Port': ['ID=6f666d10-1f35-49b9-8b78-f904cf455c7c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:47.592274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57202) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:47.598197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:47.598950 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.645105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:47.684063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:47.695074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:47.733294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Attempting to bind port 6f666d10-1f35-49b9-8b78-f904cf455c7c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:47.733915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Attempting to bind port 6f666d10-1f35-49b9-8b78-f904cf455c7c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:47.734496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Attempting to bind port 6f666d10-1f35-49b9-8b78-f904cf455c7c on network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:47.749396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d69ad2d0-3633-4522-990b-d1aa60ec036b None None] Provisioning complete for port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:47.750023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d69ad2d0-3633-4522-990b-d1aa60ec036b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.766977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Pushing event updated for resources: {'Port': ['ID=28ae2840-3e30-46c9-897c-a195554e7bbb,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:47.784287 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bfad3629-51c9-4244-aa38-bc9d297d0b1f req-02e2dfc9-db48-4049-b83e-3d0cf092d399 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.2141232 Nov 24 04:08:47.794179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:47.795876 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-318c3dc2-c086-4967-877d-dada5019409a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 7.1642559 Nov 24 04:08:47.797257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['845fffcc-929a-4cf2-bed6-b63bc28d158b']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:47.807560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:47.832072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:47.832072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ed4c642-6e64-4551-a47d-b9faae3b7937') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:47.832072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ed4c642-6e64-4551-a47d-b9faae3b7937') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:47.833607 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c6b25c75-60aa-4ef1-9f23-e719041a0974 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels?id=0f423b0b-346b-4293-a60c-2dc8b6b6f157 HTTP/1.1" status: 200 len: 468 time: 0.2318137 Nov 24 04:08:47.845982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57204) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:47.852672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Attempting to bind port 28ae2840-3e30-46c9-897c-a195554e7bbb on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:47.853192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Attempting to bind port 28ae2840-3e30-46c9-897c-a195554e7bbb by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:47.853403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Attempting to bind port 28ae2840-3e30-46c9-897c-a195554e7bbb on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:47.863238 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.928399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:47.928782 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Checking segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:47.929187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.929582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Bound using segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:47.930066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Bound port: 6f666d10-1f35-49b9-8b78-f904cf455c7c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:47.930476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:47.957691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Port': ['ID=2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:48.039675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:48.040055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:48.041162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.041162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:48.041482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Bound port: 28ae2840-3e30-46c9-897c-a195554e7bbb, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:48.041877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.043787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d69ad2d0-3633-4522-990b-d1aa60ec036b None None] Port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:48.051377 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.056018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.209370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Releasing vlan 163 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:48.209766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:48.212023 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:48.214046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.218235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.259826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] For port 28ae2840-3e30-46c9-897c-a195554e7bbb, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:48.265433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] For port 28ae2840-3e30-46c9-897c-a195554e7bbb, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=28ae2840-3e30-46c9-897c-a195554e7bbb,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:48.304094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.324613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.373883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Provisioning complete for port 2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:48.374285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.425735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] For port 6f666d10-1f35-49b9-8b78-f904cf455c7c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:48.436002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da15d75-5d29-4986-a03f-40a61b8a3f7e req-dea268e8-f22c-4ff2-a1e1-b52b7835db78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:48.440300 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5da15d75-5d29-4986-a03f-40a61b8a3f7e req-dea268e8-f22c-4ff2-a1e1-b52b7835db78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 931 time: 0.6041167 Nov 24 04:08:48.446097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:48.452908 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:48.470580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:48.471987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] For port 6f666d10-1f35-49b9-8b78-f904cf455c7c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6f666d10-1f35-49b9-8b78-f904cf455c7c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:48.478354 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fc2b367e-5f74-4513-ac6e-b84be4ab8dce req-5336bdb0-dbe0-445c-8df2-a9a070f792c7 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.2535679 Nov 24 04:08:48.482218 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:48.483171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.497761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Port 2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:48.507240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d7b1c2b-46e8-4a98-b6c3-776f431a7dca None None] Pushing event updated for resources: {'Port': ['ID=28ae2840-3e30-46c9-897c-a195554e7bbb,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:48.515558 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.569510 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 4.5495574 Nov 24 04:08:48.569510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57208) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:48.573042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75cbc9d-ba70-4be5-911b-6339600d955f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=fb1d0dc5-8998-4696-88ee-137f1fc79b6d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:48.641201 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5da15d75-5d29-4986-a03f-40a61b8a3f7e req-a30f5208-9f97-42d1-9a94-31be353f8e1c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1901710 Nov 24 04:08:48.657233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5cfa387-c37a-45c6-b616-89c2f30eb793 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:48.664666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5cfa387-c37a-45c6-b616-89c2f30eb793 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:48.666983 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d5cfa387-c37a-45c6-b616-89c2f30eb793 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.1028824 Nov 24 04:08:48.667940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Provisioning complete for port 6f666d10-1f35-49b9-8b78-f904cf455c7c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:48.668460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.678607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57210) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:48.725035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d78b1a78-78d1-4efc-b381-1a0412d14895 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.741234 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d78b1a78-78d1-4efc-b381-1a0412d14895 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-labels/0f423b0b-346b-4293-a60c-2dc8b6b6f157 HTTP/1.1" status: 204 len: 168 time: 0.8934135 Nov 24 04:08:48.751076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57212) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:48.772814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.781456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:48.781982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:48.816158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port fb1d0dc5-8998-4696-88ee-137f1fc79b6d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:48.816904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.878353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Pushing event deleted for resources: {'Network': ['ID=845fffcc-929a-4cf2-bed6-b63bc28d158b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:48.899525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 845fffcc-929a-4cf2-bed6-b63bc28d158b {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:08:48.915468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:48.940428 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-450467a3-dc39-422e-a266-fc7b0e03f99d tempest-ExternalNetworksTestJSON-841438237 tempest-ExternalNetworksTestJSON-841438237-project-admin] 10.222.0.48 "DELETE /v2.0/networks/845fffcc-929a-4cf2-bed6-b63bc28d158b HTTP/1.1" status: 204 len: 168 time: 2.8920605 Nov 24 04:08:48.942095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6d6ac0-a64f-4b07-b557-322fa3383a14 None None] Pushing event updated for resources: {'Port': ['ID=6f666d10-1f35-49b9-8b78-f904cf455c7c,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:48.948787 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57216) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:48.955834 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3581c3a6-9ccb-435e-a5f2-23084dfab5c4 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels?id=0f423b0b-346b-4293-a60c-2dc8b6b6f157 HTTP/1.1" status: 200 len: 216 time: 0.1984611 Nov 24 04:08:49.003522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57218) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.125862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.134116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.156324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:49.165151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for fb1d0dc5-8998-4696-88ee-137f1fc79b6d owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:49.206841 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-09761242-d4ed-4004-a0da-d7de0ee33744 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.1938276 Nov 24 04:08:49.208465 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-aa8be035-1330-4e21-8c9d-9d7dfdbd168e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] DELETE failed (client error): The resource could not be found. Nov 24 04:08:49.208465 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aa8be035-1330-4e21-8c9d-9d7dfdbd168e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:08:49.213512 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-aa8be035-1330-4e21-8c9d-9d7dfdbd168e tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] 10.222.0.48 "DELETE /v2.0/subnets/8b2dc85e-9eb8-4d86-87fe-ee1ca6ec680f HTTP/1.1" status: 404 len: 337 time: 0.2440383 Nov 24 04:08:49.213512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57220) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.219339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] For port 6f666d10-1f35-49b9-8b78-f904cf455c7c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6f666d10-1f35-49b9-8b78-f904cf455c7c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:49.219558 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-72f4e006-dc4b-4d0e-81c4-cac402d0ce45 req-acf9379c-4ee9-4526-b2ee-1f6ca42ac570 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.2433777 Nov 24 04:08:49.220271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57222) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.233349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.310905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.321975 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a8027a8a-4d72-422c-b2eb-053484a5e588 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.1050513 Nov 24 04:08:49.371205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57224) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.407756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.481909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-598dda0e-5236-4d50-b476-0904b0d5e192 None None] Pushing event updated for resources: {'Port': ['ID=6f666d10-1f35-49b9-8b78-f904cf455c7c,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:49.496350 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=fb1d0dc5-8998-4696-88ee-137f1fc79b6d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:49.534027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.536819 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-846fd2fe-147a-4cae-b420-1a4a3eee42b9 None None] Provisioning complete for port 6f666d10-1f35-49b9-8b78-f904cf455c7c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:49.537297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-846fd2fe-147a-4cae-b420-1a4a3eee42b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.542693 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f8e8a579-d988-4688-8d24-2b6b9415d1c5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/fb1d0dc5-8998-4696-88ee-137f1fc79b6d HTTP/1.1" status: 204 len: 168 time: 0.8628366 Nov 24 04:08:49.543584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57228) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.613538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2824638c-8a59-48f9-89da-56ebdfc78739 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:49.624823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2824638c-8a59-48f9-89da-56ebdfc78739 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:49.626888 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e2c9584a-af2f-4a7f-b829-f725be938311 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels/bcac4503-911e-43da-8dc2-c342dc8cba15 HTTP/1.1" status: 200 len: 472 time: 0.2356458 Nov 24 04:08:49.630811 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2824638c-8a59-48f9-89da-56ebdfc78739 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0857968 Nov 24 04:08:49.635764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57230) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.636109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57232) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.665650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:49.669402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Router 818f1f58-e821-4327-8315-255ec192c7ee is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:08:49.678124 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-56fb35d1-b5f6-4762-bdc7-bc12929f3b3c tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules/11f33236-b067-44e3-868d-97107eb2e51d HTTP/1.1" status: 200 len: 459 time: 0.0406852 Nov 24 04:08:49.720407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57238) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:49.744745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-1c568ea6-8274-4517-bdea-352cf670c0cd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:08:49.745844 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-1c568ea6-8274-4517-bdea-352cf670c0cd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0074589 Nov 24 04:08:49.857207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:48Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:49.908763 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-419f36d3-0998-475e-94cb-964165ad86a0 req-fefc9237-24fd-4ebe-9624-da47874b47d3 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.2720094 Nov 24 04:08:49.985106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 73ae8a6d-17d2-4316-adf9-8d55606b46cd {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:08:49.996149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:50.010294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f4782e-8db3-429b-a46d-3443b8a90988 None None] The sync data for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv is: [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:48Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:50.155969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.21', 52627) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:50.230251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-922ffeb7-adc5-4c4b-bec5-db93a135c699 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:50.235544 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-922ffeb7-adc5-4c4b-bec5-db93a135c699 tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-label-rules/11f33236-b067-44e3-868d-97107eb2e51d HTTP/1.1" status: 204 len: 168 time: 0.5020814 Nov 24 04:08:50.241268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:50.258553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57244) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:50.401948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-92518bf7-a9bd-43e5-9a37-b4068b8c039a None None] Provisioning complete for port 28ae2840-3e30-46c9-897c-a195554e7bbb triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:50.402394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-92518bf7-a9bd-43e5-9a37-b4068b8c039a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:50.519875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Request body: {'port': {'device_id': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:50.597335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-eea71c44-d1d3-4717-8ddd-3f2820bfbe9b req-d6369405-a443-4758-9bb2-552e6c2451e2 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.1432722 Nov 24 04:08:50.754902 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-92518bf7-a9bd-43e5-9a37-b4068b8c039a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:50.851756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-92518bf7-a9bd-43e5-9a37-b4068b8c039a None None] For port 28ae2840-3e30-46c9-897c-a195554e7bbb, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=28ae2840-3e30-46c9-897c-a195554e7bbb,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:50.860487 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-92518bf7-a9bd-43e5-9a37-b4068b8c039a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:50.973693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92518bf7-a9bd-43e5-9a37-b4068b8c039a None None] Pushing event updated for resources: {'Port': ['ID=28ae2840-3e30-46c9-897c-a195554e7bbb,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:50.983113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 28ae2840-3e30-46c9-897c-a195554e7bbb up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:51.050526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.101533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-07a006f9-4652-46b9-bab0-fbb50cff57fd None None] Could not find standard attr ID for object fb1d0dc5-8998-4696-88ee-137f1fc79b6d. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:08:51.169149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.21', 52630) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:51.195302 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.214138 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 28ae2840-3e30-46c9-897c-a195554e7bbb triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:51.214586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.222781 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a0a5762-28b2-49f3-96a3-d8c3b0d29429 req-cb18e3fe-166a-44e4-afc7-9c193ebebbb1 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0772226 Nov 24 04:08:51.349997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510f362a-6272-4cd9-b405-6840ebed9412 req-6b7b6a1b-b34d-4e34-abb8-0cf40639e85b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:51.351623 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-510f362a-6272-4cd9-b405-6840ebed9412 req-6b7b6a1b-b34d-4e34-abb8-0cf40639e85b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 931 time: 1.1114557 Nov 24 04:08:51.370264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.448336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6f666d10-1f35-49b9-8b78-f904cf455c7c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:51.456985 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-db5e362f-a6df-4c23-8bf9-9c79d46fff2f tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.458319 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-db5e362f-a6df-4c23-8bf9-9c79d46fff2f tempest-MeteringIpV6TestJSON-1703326267 tempest-MeteringIpV6TestJSON-1703326267-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-labels/bcac4503-911e-43da-8dc2-c342dc8cba15 HTTP/1.1" status: 204 len: 168 time: 1.1962552 Nov 24 04:08:51.514526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7b1bbe2-91db-433d-bb88-8704668a680f']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:51.534534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6f666d10-1f35-49b9-8b78-f904cf455c7c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:51.535106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.591171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-4b13e270-cf86-4c5d-a92c-892a1c4f070d tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:51.595864 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-4b13e270-cf86-4c5d-a92c-892a1c4f070d tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.21 "GET /v2.0/networks?id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 HTTP/1.1" status: 200 len: 811 time: 1.1643658 Nov 24 04:08:51.619373 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-510f362a-6272-4cd9-b405-6840ebed9412 req-a962069c-e661-4087-9893-099a6aee4c06 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2311885 Nov 24 04:08:51.707295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.735797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e7d0e62f-5325-42e8-b488-cd8455aea1cc') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:51.736272 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e7d0e62f-5325-42e8-b488-cd8455aea1cc') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:51.738563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-b74e5091-e5fd-4a99-b42f-eaf5f315d986 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:51.740145 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-b74e5091-e5fd-4a99-b42f-eaf5f315d986 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.21 "GET /v2.0/networks?id=9279fc65-0f7e-4ac5-8fda-e94ff426a487 HTTP/1.1" status: 200 len: 805 time: 0.3989570 Nov 24 04:08:51.752335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.781122 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.790439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Releasing vlan 187 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:51.791356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:51.810419 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:51.830941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.832013 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ebb63699-290b-4a1a-837c-fa324de5c61c req-63831650-622d-47e2-aeb1-ec9ba8845c43 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.0908701 Nov 24 04:08:51.886025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.906548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.923847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57270) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:51.936290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-099bd7a5-da30-404b-abcc-4863cc913b66 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:51.936479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=73ae8a6d-17d2-4316-adf9-8d55606b46cd,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:51.952130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:51.959445 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f206138a-ec7e-41e4-8f3c-204d17b80424 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/73ae8a6d-17d2-4316-adf9-8d55606b46cd HTTP/1.1" status: 204 len: 168 time: 2.3180323 Nov 24 04:08:51.965259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57274) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:51.987843 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-1071f336-5d29-4043-a376-19e4f38c4eaa tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49 HTTP/1.1" status: 200 len: 379 time: 0.2646711 Nov 24 04:08:52.093170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Request body: {'port': {'device_id': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'admin_state_up': True, 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'security_groups': ['c44ed4b6-b064-46c5-b181-829da0b490b1']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:52.097944 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4ee33527-85e7-4fcf-8f5c-399ea372a4c1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1313965 Nov 24 04:08:52.103312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Port': ['ID=2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:52.107409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57276) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:52.150216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:52.162880 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Sync routers for ids ['818f1f58-e821-4327-8315-255ec192c7ee'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:52.176397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:52.182904 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Routers {'818f1f58-e821-4327-8315-255ec192c7ee'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:52.184762 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['818f1f58-e821-4327-8315-255ec192c7ee'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:52.196041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:52.274840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:52.291482 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] 10.222.0.48 "DELETE /v2.0/networks/e7b1bbe2-91db-433d-bb88-8704668a680f HTTP/1.1" status: 204 len: 168 time: 3.0469024 Nov 24 04:08:52.292566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b40f3c8-243f-4364-9d81-3431e0832295 tempest-ExternalNetworksTestJSON-1748530378 tempest-ExternalNetworksTestJSON-1748530378-project] Pushing event deleted for resources: {'Network': ['ID=e7b1bbe2-91db-433d-bb88-8704668a680f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:52.300677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6561066-5fb6-4d9d-8377-0ad6c97d348e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:52.341047 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-49f94af9-d189-4477-91fa-5af7ef6e39d6 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ca64a4f493b349449d44be7e1d9fb98c HTTP/1.1" status: 200 len: 379 time: 0.5144682 Nov 24 04:08:52.436627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:52.444580 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a9502a46-f605-477c-a748-e8f4accaaf0d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 875 time: 14.8455939 Nov 24 04:08:52.470796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57282) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:52.502676 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Set router 818f1f58-e821-4327-8315-255ec192c7ee gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:52.552959 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a5222066-040b-41a1-90c0-effdd06aae5b req-3916ce15-e8f5-4176-aae8-496a7232e578 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.1511648 Nov 24 04:08:52.564605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:08:52.663763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:52.673157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:52.713726 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 28ae2840-3e30-46c9-897c-a195554e7bbb no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:08:52.922667 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:52.963380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57290) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:52.969897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] Deleting port 28ae2840-3e30-46c9-897c-a195554e7bbb {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:52.970438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.036262 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '818f1f58-e821-4327-8315-255ec192c7ee', 'name': '', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'external_fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3'}], 'enable_snat': True}, 'gw_port_id': '1e5f9a77-8f74-4200-a69d-a72fbd560409', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:37Z', 'updated_at': '2021-11-24T04:08:44Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '1e5f9a77-8f74-4200-a69d-a72fbd560409', 'name': '', 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:01:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '818f1f58-e821-4327-8315-255ec192c7ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 187, 'fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:40Z', 'updated_at': '2021-11-24T04:08:41Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:53.096328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bd0cfc7f-154f-4dba-bb4b-86d1245efb06 {{(pid=103380) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:08:53.125483 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Checking router: 818f1f58-e821-4327-8315-255ec192c7ee for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:08:53.127565 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Updating router 818f1f58-e821-4327-8315-255ec192c7ee port 1e5f9a77-8f74-4200-a69d-a72fbd560409 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:08:53.188802 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.214445 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ebce3aa3-d999-42f6-b5fe-30150d407729 req-fd6fce07-bd97-4dcd-baf4-0559f952bf5a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.1966555 Nov 24 04:08:53.227038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.289267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] For port 28ae2840-3e30-46c9-897c-a195554e7bbb, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=28ae2840-3e30-46c9-897c-a195554e7bbb,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:53.289831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.322549 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.provisioning_blocks [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Transition to ACTIVE for port object bd0cfc7f-154f-4dba-bb4b-86d1245efb06 will not be triggered until provisioned by entity L2. {{(pid=103380) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:08:53.325758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] Calling delete_port for 28ae2840-3e30-46c9-897c-a195554e7bbb owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:53.338002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.356703 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Request body: {'port': {'device_id': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'admin_state_up': True, 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'security_groups': ['76b249c4-619a-41db-83bc-ecf04415e0cf']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:53.369045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 28ae2840-3e30-46c9-897c-a195554e7bbb, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=28ae2840-3e30-46c9-897c-a195554e7bbb,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:53.412876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Router 6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:08:53.456605 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bd91e700-003f-40b1-9ec0-655f5f0f031e admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=a4afce0633f04eb685f1a50117b7159d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4899826 Nov 24 04:08:53.457530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.462123 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57296) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:53.477842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Pushing event updated for resources: {'Port': ['ID=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:53.492334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b1a31593-ee93-47e2-ab5a-35023a78e046 None None] Provisioning complete for port 2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:53.494787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b1a31593-ee93-47e2-ab5a-35023a78e046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.536367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b1a31593-ee93-47e2-ab5a-35023a78e046 None None] Port 2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:53.540630 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.565654 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.620608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=28ae2840-3e30-46c9-897c-a195554e7bbb,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:53.649676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.675186 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:08:53.687949 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3f56b00e-9299-4061-a5eb-cfe5dbd85e26 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "PUT /v2.0/routers/6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 14.1603057 Nov 24 04:08:53.688786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57300) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:53.694794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'port': {'network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca', 'name': 'tempest-FloatingIPNegativeTestJSON-1268539572'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:53.708941 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Attempting to bind port 1e5f9a77-8f74-4200-a69d-a72fbd560409 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:53.709236 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Attempting to bind port 1e5f9a77-8f74-4200-a69d-a72fbd560409 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '0451bee4-7ffd-476c-a911-9a7fe64d0f9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:53.709615 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Attempting to bind port 1e5f9a77-8f74-4200-a69d-a72fbd560409 on network 189c11b3-8b23-4af9-bb88-8b84a0f455ec {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:53.710654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] No DVR routers for this DVR port 28ae2840-3e30-46c9-897c-a195554e7bbb on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:08:53.717653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Attempting to bind port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:53.731432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a2a65543-fcff-4bae-a69b-2623f8a6f7e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.737214 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1563ae25-0ac2-4df3-ba55-763272be95f3 None None] Pushing event updated for resources: {'Port': ['ID=1e5f9a77-8f74-4200-a69d-a72fbd560409,revision_number=2']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:53.746135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] Sync routers for ids ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:08:53.751042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a405628-8033-417f-94aa-fe6af6594f4c None None] Pushing event deleted for resources: {'Port': ['ID=28ae2840-3e30-46c9-897c-a195554e7bbb,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:53.753783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Attempting to bind port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:53.754244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Attempting to bind port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 on network 4064fe6e-1a4a-440d-8829-8ec4922458b8 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:53.754363 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:53.754635 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Checking segment: {'id': '0451bee4-7ffd-476c-a911-9a7fe64d0f9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:53.756265 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.756932 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Bound using segment: {'id': '0451bee4-7ffd-476c-a911-9a7fe64d0f9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:53.757357 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Bound port: 1e5f9a77-8f74-4200-a69d-a72fbd560409, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0451bee4-7ffd-476c-a911-9a7fe64d0f9a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:53.757772 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.766136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:53.769599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.785998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] Routers {'6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:53.786659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:53.792246 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 on network 4064fe6e-1a4a-440d-8829-8ec4922458b8 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:08:53.792427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Attempting to bind port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 on network 4064fe6e-1a4a-440d-8829-8ec4922458b8 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:53.814032 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7ecf3cca-115c-4b29-aeb0-ab6869c2fee6 req-f0888d05-b569-4626-b64f-cf7b964f79d2 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0512223 Nov 24 04:08:53.820073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:53.820498 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] For port 1e5f9a77-8f74-4200-a69d-a72fbd560409, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:53.823868 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] For port 1e5f9a77-8f74-4200-a69d-a72fbd560409, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e5f9a77-8f74-4200-a69d-a72fbd560409,segment=NetworkSegment(0451bee4-7ffd-476c-a911-9a7fe64d0f9a),segment_id=0451bee4-7ffd-476c-a911-9a7fe64d0f9a)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:53.829853 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:53.830963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] Routers {'6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:53.831578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:53.870376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:53.871019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68c32565-4a95-460d-85d7-facb190bfdb8 None None] The sync data for ids ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:53.935447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2a726e-4da6-4993-a59a-0980ae2c79fd req-8b0e2280-fa25-45f4-a8f1-c6def6009901 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:53.936898 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1563ae25-0ac2-4df3-ba55-763272be95f3 None None] Pushing event updated for resources: {'Port': ['ID=1e5f9a77-8f74-4200-a69d-a72fbd560409,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:53.941482 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Routers {'818f1f58-e821-4327-8315-255ec192c7ee'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:08:53.942108 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['818f1f58-e821-4327-8315-255ec192c7ee'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:53.943285 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5c2a726e-4da6-4993-a59a-0980ae2c79fd req-8b0e2280-fa25-45f4-a8f1-c6def6009901 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 943 time: 0.5823786 Nov 24 04:08:53.975163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a2a65543-fcff-4bae-a69b-2623f8a6f7e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.007572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6561066-5fb6-4d9d-8377-0ad6c97d348e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.037897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Made reservation on behalf of f983a1d6cdc44b639c49bee8aa3a5f49 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:54.041475 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.054027 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] Set router 818f1f58-e821-4327-8315-255ec192c7ee gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:08:54.064846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6561066-5fb6-4d9d-8377-0ad6c97d348e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.076016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:54.076960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Checking segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:54.078124 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Bound using segment: {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'} {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:54.078124 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Bound port: bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '672d840f-137e-4e24-919f-90c802e55efb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8'}}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:54.078383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.084278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.183237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] For port bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host hv-neutron-8190, cleared binding levels {{(pid=103380) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:54.186393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Made reservation on behalf of ca64a4f493b349449d44be7e1d9fb98c for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:54.189691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] For port bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103380) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:54.189836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.193070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Made reservation on behalf of d37a09eae8f64345857dfee0a8e964ab for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:54.197223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.209046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.242338 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '818f1f58-e821-4327-8315-255ec192c7ee', 'name': '', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'external_fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3'}], 'enable_snat': True}, 'gw_port_id': '1e5f9a77-8f74-4200-a69d-a72fbd560409', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:37Z', 'updated_at': '2021-11-24T04:08:44Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '1e5f9a77-8f74-4200-a69d-a72fbd560409', 'name': '', 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:01:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '818f1f58-e821-4327-8315-255ec192c7ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 187, 'fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:40Z', 'updated_at': '2021-11-24T04:08:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:54.259890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:54.260529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.262076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] 10.222.0.21 "PUT /v2.0/ports/bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1093 time: 4.0187984 Nov 24 04:08:54.262459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:08:54.275972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] device_id is not set on port be44ef90-0520-4a24-a3bf-4833265bd1f0 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:54.278536 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6561066-5fb6-4d9d-8377-0ad6c97d348e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae130010-7453-4c05-86dd-8c4c03a320e0,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:54.286554 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c7e68e2-3559-423d-a912-3cdfb3a98360 None None] The sync data for ids ['818f1f58-e821-4327-8315-255ec192c7ee'] in dv-neutron-819049-1-hyperv is: [{'id': '818f1f58-e821-4327-8315-255ec192c7ee', 'name': '', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'external_fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3'}], 'enable_snat': True}, 'gw_port_id': '1e5f9a77-8f74-4200-a69d-a72fbd560409', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:37Z', 'updated_at': '2021-11-24T04:08:44Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '1e5f9a77-8f74-4200-a69d-a72fbd560409', 'name': '', 'network_id': '189c11b3-8b23-4af9-bb88-8b84a0f455ec', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:01:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '818f1f58-e821-4327-8315-255ec192c7ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 187, 'fixed_ips': [{'subnet_id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'ip_address': '172.20.0.3', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:40Z', 'updated_at': '2021-11-24T04:08:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd77a702d-35de-44c6-8fe9-03bced4d3eba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:08:54.355056 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a6561066-5fb6-4d9d-8377-0ad6c97d348e admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=ec87292e3b5248f4a86633dea5096f1b&name=default HTTP/1.1" status: 200 len: 2996 time: 2.4163597 Nov 24 04:08:54.364070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57308) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:54.411073 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5c2a726e-4da6-4993-a59a-0980ae2c79fd req-e7f84e79-fac0-4fe7-aa31-478d5acb3c80 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4665768 Nov 24 04:08:54.501175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9855f4d8-bf86-4161-8d3b-aadd493dc10a service neutron] Pushing event updated for resources: {'Port': ['ID=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:54.510118 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ab6d343-bbf2-4354-8208-ad074b74b893 req-b7016094-5e99-4636-97d1-769c7a9feacb tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.1699331 Nov 24 04:08:54.542468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a" -d '{"events": [{"name": "network-changed", "server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:08:54.573252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.577234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a2a65543-fcff-4bae-a69b-2623f8a6f7e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.579862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a2a65543-fcff-4bae-a69b-2623f8a6f7e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.581963 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a2a65543-fcff-4bae-a69b-2623f8a6f7e8 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/ba3d1711-1062-4b78-be49-de31c4ef69d9 HTTP/1.1" status: 204 len: 168 time: 1.0974097 Nov 24 04:08:54.613631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Allocated IP 172.20.0.8 (5d869497-2705-4cc2-b36d-4dea3a8792ca/36a855ec-1766-47fd-a2f1-cb38daa5cac1/be44ef90-0520-4a24-a3bf-4833265bd1f0) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:54.708545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a65543-fcff-4bae-a69b-2623f8a6f7e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba3d1711-1062-4b78-be49-de31c4ef69d9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:54.825109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.839823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-a8d05b2b-fbfc-40cf-b35c-85bada745a5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:54.841369 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-a8d05b2b-fbfc-40cf-b35c-85bada745a5e service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1096 time: 0.5027204 Nov 24 04:08:54.869583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:08:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-539c54f0-079d-4afb-a5b6-3172ab20c4cf x-openstack-request-id: req-539c54f0-079d-4afb-a5b6-3172ab20c4cf {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:08:54.870245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:08:54.870461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-539c54f0-079d-4afb-a5b6-3172ab20c4cf {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:08:54.870930 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'status': 'completed', 'code': 200} Nov 24 04:08:54.902852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:54.961811 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-93ab2575-afeb-4681-90d5-11bc63883125 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 217 time: 0.1002014 Nov 24 04:08:54.982294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Allocated IP 172.20.0.7 (bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30/d6b900d5-6e1c-467d-a80c-b932fd4e77fd/42e80f9b-33db-4c7f-85ba-50908c286ec3) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:54.986478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Allocated IP 172.20.0.13 (9279fc65-0f7e-4ac5-8fda-e94ff426a487/ac08ee4f-45d7-4c2e-ab90-055d80970c38/a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:55.005784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebba4121-4400-4efa-8099-22ff6ef21d03 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.032532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:55.039462 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.043688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:55.047561 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8b57a708-8e4f-471e-9fe6-12f7cd3285df req-d4af6d2a-ff17-413a-918c-0a134512e500 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0945318 Nov 24 04:08:55.052565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:55.102932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57322) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:55.128885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:55.130069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.136240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebba4121-4400-4efa-8099-22ff6ef21d03 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.144617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Port': ['ID=be44ef90-0520-4a24-a3bf-4833265bd1f0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:55.169570 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9f88a355-b6bf-4bd1-b8e8-7d76e37b1f78 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4775705 Nov 24 04:08:55.173700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Deleting port 1e5f9a77-8f74-4200-a69d-a72fbd560409 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:08:55.174030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-e47a393c-4025-40af-8cd7-40c5dabdcc09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:55.174187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.175562 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-e47a393c-4025-40af-8cd7-40c5dabdcc09 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.1798952 Nov 24 04:08:55.176044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57324) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:55.180941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:55.236180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:55.261505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.276944 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:55.292278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d19bad0-dccc-4944-a037-5e74e478e7ac None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:08:55.297592 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-c3fcc9f6-dfe1-4a5b-b750-e77d36b0bcb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:55.299064 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-c3fcc9f6-dfe1-4a5b-b750-e77d36b0bcb2 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1128025 Nov 24 04:08:55.403296 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e038c864-0486-4b39-a2cb-0b51ef245efb None None] Provisioning complete for port be44ef90-0520-4a24-a3bf-4833265bd1f0 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:55.403900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e038c864-0486-4b39-a2cb-0b51ef245efb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.412430 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] For port 1e5f9a77-8f74-4200-a69d-a72fbd560409, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e5f9a77-8f74-4200-a69d-a72fbd560409,segment=NetworkSegment(0451bee4-7ffd-476c-a911-9a7fe64d0f9a),segment_id=0451bee4-7ffd-476c-a911-9a7fe64d0f9a)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:55.412990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.429273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Calling delete_port for 1e5f9a77-8f74-4200-a69d-a72fbd560409 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:08:55.440794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:55.441395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.448598 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-7b5e15d7-e2e2-460a-ad84-c783d610c2cb service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1416709 Nov 24 04:08:55.496762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=41e43747-a1ce-4657-bc29-b195db1f42a3,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:55.556128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '41e43747-a1ce-4657-bc29-b195db1f42a3'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:08:55.558527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.577212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.582885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e038c864-0486-4b39-a2cb-0b51ef245efb None None] Port be44ef90-0520-4a24-a3bf-4833265bd1f0 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:55.632922 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7fccd859-7d59-49de-b213-984df0b8affb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 3.4738367 Nov 24 04:08:55.637945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57330) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:55.645416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '41e43747-a1ce-4657-bc29-b195db1f42a3', 'ip_address': '2001:db8::ce87:8c3:27f6:46b'}], 'name': 'tempest-NetworksTestDHCPv6-931804315'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:55.666105 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fed0b33b-1527-4471-a499-33d19e067c13 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=6bbeea287c51485fab52a581918dbccc&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5568845 Nov 24 04:08:55.674900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57332) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:55.703525 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6f350b89-d540-4e95-8cb2-e8305a8a3688 req-5e639ac9-7680-46cc-81e4-0179cc7d4543 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.0645072 Nov 24 04:08:55.714506 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebba4121-4400-4efa-8099-22ff6ef21d03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.717149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebba4121-4400-4efa-8099-22ff6ef21d03 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.718536 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ebba4121-4400-4efa-8099-22ff6ef21d03 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/ae130010-7453-4c05-86dd-8c4c03a320e0 HTTP/1.1" status: 204 len: 168 time: 1.3198063 Nov 24 04:08:55.754700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/41e43747-a1ce-4657-bc29-b195db1f42a3/4b4e88d9-60ff-44ef-928e-6e376b083958) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:55.811846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebba4121-4400-4efa-8099-22ff6ef21d03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae130010-7453-4c05-86dd-8c4c03a320e0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:55.827180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.840190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.851244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968b7beb-9f5f-4aeb-9408-502bd032ca40 req-4a67c2ac-9729-4e36-9217-beb93b8949bd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:55.859275 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-968b7beb-9f5f-4aeb-9408-502bd032ca40 req-4a67c2ac-9729-4e36-9217-beb93b8949bd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 943 time: 0.3265085 Nov 24 04:08:55.940455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.951777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:55.952093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:08:55.958912 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-971bfe56-f11e-41c9-b3e1-e99530d0443b req-59a062e4-4565-4117-8916-72438133c32f service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5013089 Nov 24 04:08:55.994759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Allocated IP 172.26.5.218 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/20529798-fc19-4526-8ffd-d298c30fd828) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:56.050817 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Pushing event updated for resources: {'Port': ['ID=4b4e88d9-60ff-44ef-928e-6e376b083958,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:56.060166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:56.063145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:56.071317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:56.171778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Attempting to bind port 4b4e88d9-60ff-44ef-928e-6e376b083958 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:56.172431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Attempting to bind port 4b4e88d9-60ff-44ef-928e-6e376b083958 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:56.172810 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Attempting to bind port 4b4e88d9-60ff-44ef-928e-6e376b083958 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:56.178685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:56.179379 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:56.179516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.179844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:56.180692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Bound port: 4b4e88d9-60ff-44ef-928e-6e376b083958, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:56.181109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.187484 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ec36d81d-5096-4b27-94d8-edbc062ff06f req-b6873d33-d8ed-4ec5-89ca-c6913304fcf0 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0350707 Nov 24 04:08:56.259369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.280230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-648555a3-8cd4-43be-bcd2-0a290a7bf010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:56.281734 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-648555a3-8cd4-43be-bcd2-0a290a7bf010 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1096 time: 0.2137923 Nov 24 04:08:56.286666 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:08:56.289649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] For port 4b4e88d9-60ff-44ef-928e-6e376b083958, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:56.293177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2200272-901f-4195-bd41-05ea7b22bca4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.294701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57340) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:56.339006 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-968b7beb-9f5f-4aeb-9408-502bd032ca40 req-53382c8a-8292-4ac3-88af-afda5795ee03 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4784420 Nov 24 04:08:56.367235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.375138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2200272-901f-4195-bd41-05ea7b22bca4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.385537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41effaa6-bf56-4ad7-bd08-0c622d124cd6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.413374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.470634 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:56.484219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:56.487521 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event updated for resources: {'Port': ['ID=42e80f9b-33db-4c7f-85ba-50908c286ec3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:56.490532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:56.495601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] For port 4b4e88d9-60ff-44ef-928e-6e376b083958, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4b4e88d9-60ff-44ef-928e-6e376b083958,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:56.501949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.508838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:56.512168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.562669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:56.574470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:56.664311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2200272-901f-4195-bd41-05ea7b22bca4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.668554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f2200272-901f-4195-bd41-05ea7b22bca4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.675099 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f2200272-901f-4195-bd41-05ea7b22bca4 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/28a89188-d462-4b94-802f-ae1061d4bdab HTTP/1.1" status: 204 len: 168 time: 0.9977789 Nov 24 04:08:56.700168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event updated for resources: {'Port': ['ID=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:56.757432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:56.758603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.784482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71393706-b327-4c8e-95e8-3131bbfaa0fe None None] Pushing event updated for resources: {'Port': ['ID=4b4e88d9-60ff-44ef-928e-6e376b083958,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:56.859978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e5f9a77-8f74-4200-a69d-a72fbd560409 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:56.869917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event deleted for resources: {'Port': ['ID=1e5f9a77-8f74-4200-a69d-a72fbd560409,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:56.879352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2200272-901f-4195-bd41-05ea7b22bca4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28a89188-d462-4b94-802f-ae1061d4bdab,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:56.881581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:56.916273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 1e5f9a77-8f74-4200-a69d-a72fbd560409 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:56.917175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e5f9a77-8f74-4200-a69d-a72fbd560409 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:08:56.957430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port 1e5f9a77-8f74-4200-a69d-a72fbd560409 not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:08:57.068878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2ce91bee-36ef-4c05-a383-363a075c4c9b None None] Provisioning complete for port 42e80f9b-33db-4c7f-85ba-50908c286ec3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:57.072121 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2ce91bee-36ef-4c05-a383-363a075c4c9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.073406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.094592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:57.094860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.116811 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-0ead4ffb-a038-4651-96b3-6abdf247727f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.0278819 Nov 24 04:08:57.130816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.137832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.143977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2ce91bee-36ef-4c05-a383-363a075c4c9b None None] Port 42e80f9b-33db-4c7f-85ba-50908c286ec3 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:57.151380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Request body: {'port': {'device_id': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:57.193891 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-8cb2d7ce-25b5-4c6c-a97d-65de7e121970 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:57.200439 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-8cb2d7ce-25b5-4c6c-a97d-65de7e121970 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.9041662 Nov 24 04:08:57.248719 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-7583c06e-a8e5-4372-90a4-1c1c74d409af tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.8973804 Nov 24 04:08:57.272329 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Request body: {'port': {'device_id': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:57.274934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7bcf93f3-41fb-4606-8aa6-48e678797014 None None] Provisioning complete for port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:57.278637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7bcf93f3-41fb-4606-8aa6-48e678797014 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.306762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.307628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 818f1f58-e821-4327-8315-255ec192c7ee {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:08:57.315297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.332695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.337776 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-796883e8-ea2f-4d98-b4a9-c209ad0e8b05 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/routers/818f1f58-e821-4327-8315-255ec192c7ee HTTP/1.1" status: 204 len: 168 time: 4.0288479 Nov 24 04:08:57.339611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c2ec09-5af5-4069-81b5-80a85376ea00 req-5a65de76-e51e-4d13-a9e7-966df0bf679b tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:57.342735 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c3c2ec09-5af5-4069-81b5-80a85376ea00 req-5a65de76-e51e-4d13-a9e7-966df0bf679b tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 931 time: 0.3651633 Nov 24 04:08:57.349738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57350) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:57.352786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7bcf93f3-41fb-4606-8aa6-48e678797014 None None] Port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:57.425120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.429339 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-9e737fcf-f7da-409a-91f5-e8d6f2825d56 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 217 time: 0.1420307 Nov 24 04:08:57.452853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:57.501839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.509674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Deleting subnet d77a702d-35de-44c6-8fe9-03bced4d3eba {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:08:57.523559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.533240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:57.539824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:57.563134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::ce87:8c3:27f6:46b (a2b36c78-43a6-4954-8102-cb5638999bb1/41e43747-a1ce-4657-bc29-b195db1f42a3/40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:08:57.564688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffbe935-7543-4a1b-84dc-6092cad6abf7 req-0e03500f-2893-4ab5-b59a-b29414510e27 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:57.566355 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5ffbe935-7543-4a1b-84dc-6092cad6abf7 req-0e03500f-2893-4ab5-b59a-b29414510e27 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 932 time: 0.2401364 Nov 24 04:08:57.575439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Port': ['ID=20529798-fc19-4526-8ffd-d298c30fd828,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:57.633719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41effaa6-bf56-4ad7-bd08-0c622d124cd6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.662387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41effaa6-bf56-4ad7-bd08-0c622d124cd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.680515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.709848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c3c2ec09-5af5-4069-81b5-80a85376ea00 req-141e8b38-b4d8-4787-82a4-3cb8c8ff2c45 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3123038 Nov 24 04:08:57.733232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-74e39b38-f087-4148-aacf-6bf1a9082150 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:57.735016 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-74e39b38-f087-4148-aacf-6bf1a9082150 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.2937474 Nov 24 04:08:57.864526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:57.897619 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-41effaa6-bf56-4ad7-bd08-0c622d124cd6 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=6a3fa17c217947f99d6a1936abbdf969&name=default HTTP/1.1" status: 200 len: 2996 time: 1.5964515 Nov 24 04:08:57.897619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41effaa6-bf56-4ad7-bd08-0c622d124cd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7c4c133-9fb6-417f-9f74-596f51de082e,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:57.898475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57370) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:58.020589 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-15758daa-b7e9-473c-9e3d-36bdc4b01c60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:58.022132 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-15758daa-b7e9-473c-9e3d-36bdc4b01c60 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2743962 Nov 24 04:08:58.051811 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.126694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.157341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fe7497-f152-4bd2-bc44-27e01c8b94d2 req-18d09fee-5d51-4927-b2f3-507fb5661dc8 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:58.158875 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-15fe7497-f152-4bd2-bc44-27e01c8b94d2 req-18d09fee-5d51-4927-b2f3-507fb5661dc8 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 943 time: 0.3110878 Nov 24 04:08:58.165612 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5ffbe935-7543-4a1b-84dc-6092cad6abf7 req-2ba55dba-1906-4667-a52e-c1a8191c3343 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5341415 Nov 24 04:08:58.214605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4bc5fee2-cc74-4943-ae8e-fe7fe47bf3f5 None None] Provisioning complete for port 4b4e88d9-60ff-44ef-928e-6e376b083958 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:58.215552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4bc5fee2-cc74-4943-ae8e-fe7fe47bf3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.303695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4bc5fee2-cc74-4943-ae8e-fe7fe47bf3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.322673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.340737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:08:58.352458 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4bc5fee2-cc74-4943-ae8e-fe7fe47bf3f5 None None] For port 4b4e88d9-60ff-44ef-928e-6e376b083958, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4b4e88d9-60ff-44ef-928e-6e376b083958,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:58.358276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4bc5fee2-cc74-4943-ae8e-fe7fe47bf3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.371700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.399043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=d77a702d-35de-44c6-8fe9-03bced4d3eba,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:58.405870 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.406876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aab161c8-8ad3-4c39-b5a4-5abda71278d1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.409019 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-69d46042-3848-4145-97ca-7553667702d2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/subnets/d77a702d-35de-44c6-8fe9-03bced4d3eba HTTP/1.1" status: 204 len: 168 time: 1.0554042 Nov 24 04:08:58.416265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57378) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:58.428544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.432328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc5fee2-cc74-4943-ae8e-fe7fe47bf3f5 None None] Pushing event updated for resources: {'Port': ['ID=4b4e88d9-60ff-44ef-928e-6e376b083958,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:58.443183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 42e80f9b-33db-4c7f-85ba-50908c286ec3 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:08:58.459236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Transition to ACTIVE for port object a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:08:58.463444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.475750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aab161c8-8ad3-4c39-b5a4-5abda71278d1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.476645 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.489316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.521242 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.549881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Transition to ACTIVE for port object 42e80f9b-33db-4c7f-85ba-50908c286ec3 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:08:58.586190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.601625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.619111 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-8ac0f114-e710-40ce-8319-bf814c4e9234 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5789719 Nov 24 04:08:58.642058 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-15fe7497-f152-4bd2-bc44-27e01c8b94d2 req-51ac4b95-11bd-4d6d-92a0-fb310a276f74 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4385703 Nov 24 04:08:58.643431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Pushing event updated for resources: {'Port': ['ID=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:58.706584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4b4e88d9-60ff-44ef-928e-6e376b083958 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:08:58.727181 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aab161c8-8ad3-4c39-b5a4-5abda71278d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.729755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aab161c8-8ad3-4c39-b5a4-5abda71278d1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:58.734510 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-aab161c8-8ad3-4c39-b5a4-5abda71278d1 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/f7c4c133-9fb6-417f-9f74-596f51de082e HTTP/1.1" status: 204 len: 168 time: 0.8039515 Nov 24 04:08:58.762685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device bd0cfc7f-154f-4dba-bb4b-86d1245efb06 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:08:58.817401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab161c8-8ad3-4c39-b5a4-5abda71278d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7c4c133-9fb6-417f-9f74-596f51de082e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:58.828135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Pushing event updated for resources: {'Port': ['ID=42e80f9b-33db-4c7f-85ba-50908c286ec3,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:58.892325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Port': ['ID=20529798-fc19-4526-8ffd-d298c30fd828,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:58.926964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Attempting to bind port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:58.927554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Attempting to bind port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:58.928112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Attempting to bind port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b on network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:58.964280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b on network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:08:58.964916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Attempting to bind port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b on network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:58.984687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.006624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.010773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:59.011422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Checking segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:59.012221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Bound using segment: {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:59.012902 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Bound port: a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '667b698e-2807-47a4-bcfc-45f0f3202512', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 158, 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:59.013525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.028164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.031038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57392) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:59.054826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 4b4e88d9-60ff-44ef-928e-6e376b083958 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:59.058192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.070962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['189c11b3-8b23-4af9-bb88-8b84a0f455ec']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:59.083307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb0e4fa-8a56-4574-8cbf-ad2b987da0bd req-29c5fe1f-141a-4ffe-8be2-577b0b69e59f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:59.085140 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-edb0e4fa-8a56-4574-8cbf-ad2b987da0bd req-29c5fe1f-141a-4ffe-8be2-577b0b69e59f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 943 time: 0.2466190 Nov 24 04:08:59.086281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Attempting to bind port 42e80f9b-33db-4c7f-85ba-50908c286ec3 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:08:59.086827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Attempting to bind port 42e80f9b-33db-4c7f-85ba-50908c286ec3 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:08:59.087380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Attempting to bind port 42e80f9b-33db-4c7f-85ba-50908c286ec3 on network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:59.127954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:08:59.141588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.142980 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-18232f32-d4f2-4988-80cc-d66aa17da4db tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.9659343 Nov 24 04:08:59.157873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57396) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:59.158830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:08:59.166597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2bc6846b-fcb1-42d4-91c8-d2a12fcd0846 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'floatingip': {'port_id': 'be44ef90-0520-4a24-a3bf-4833265bd1f0', 'fixed_ip_address': '172.20.0.8'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:59.169296 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:08:59.175081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:59.175744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.198488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:59.214038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:59.228816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'port_id': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'mac_address': 'fa:16:3e:b4:1c:6f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 157, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:08:59.347464 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-788a0d1b-bc4e-42a7-8ad3-7701db2aec3a req-bc0ddbc7-230d-4f56-8b34-fe502e952f50 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7040164 Nov 24 04:08:59.405113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2bc6846b-fcb1-42d4-91c8-d2a12fcd0846 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.439890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0451bee4-7ffd-476c-a911-9a7fe64d0f9a') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:59.440392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0451bee4-7ffd-476c-a911-9a7fe64d0f9a') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:08:59.456277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Port 42e80f9b-33db-4c7f-85ba-50908c286ec3 on network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:08:59.456894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.457447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Attempting to bind port 42e80f9b-33db-4c7f-85ba-50908c286ec3 on network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:08:59.478462 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.479573 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-42448a4c-5f5f-4b55-a661-c02fa30f1135 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 945 time: 3.8381321 Nov 24 04:08:59.485627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bd0cfc7f-154f-4dba-bb4b-86d1245efb06 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:08:59.490608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57408) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:59.496317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c3cc0023-27b7-41ac-99ae-c606d10e0a99 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1829136165'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:59.496774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c3cc0023-27b7-41ac-99ae-c606d10e0a99 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Unknown quota resources ['metering_label']. {{(pid=103380) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:08:59.510345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:08:59.510982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Checking segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:08:59.511478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Bound using segment: {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:08:59.512019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Bound port: 42e80f9b-33db-4c7f-85ba-50908c286ec3, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cbe779b8-68a9-4f40-be0b-27da35492bc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:08:59.512498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.536421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:08:59.546254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.573622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.635748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Releasing vlan 178 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:08:59.636287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:08:59.642333 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:08:59.659454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e5f9a77-8f74-4200-a69d-a72fbd560409 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:08:59.664062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] For port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:59.688812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 1e5f9a77-8f74-4200-a69d-a72fbd560409 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:08:59.689377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e5f9a77-8f74-4200-a69d-a72fbd560409 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:08:59.700708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea1bdc1-0f53-4b68-a565-dce914b52769 req-632b0f80-fbaa-4cd2-afbc-4c462be6a1c2 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:59.707649 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8ea1bdc1-0f53-4b68-a565-dce914b52769 req-632b0f80-fbaa-4cd2-afbc-4c462be6a1c2 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 944 time: 0.3680129 Nov 24 04:08:59.708621 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-edb0e4fa-8a56-4574-8cbf-ad2b987da0bd req-648f186d-cb4c-40f6-92df-688de4808c19 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6101820 Nov 24 04:08:59.713977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:08:59.719919 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8b27a127-b516-42a7-9ef5-e6d0b6629c40 None None] Provisioning complete for port 40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:08:59.720294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b27a127-b516-42a7-9ef5-e6d0b6629c40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.758834 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] For port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:08:59.772384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.782510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d32b1f72-9ee9-4b79-b2ed-c56a780ef0b7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:59.788588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d32b1f72-9ee9-4b79-b2ed-c56a780ef0b7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:59.793228 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d32b1f72-9ee9-4b79-b2ed-c56a780ef0b7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.2956569 Nov 24 04:08:59.793987 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57418) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:59.799351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8b27a127-b516-42a7-9ef5-e6d0b6629c40 None None] Port 40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:08:59.823964 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3cc0023-27b7-41ac-99ae-c606d10e0a99 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.827652 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c3cc0023-27b7-41ac-99ae-c606d10e0a99 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.7689757 Nov 24 04:08:59.834443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57422) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:59.842916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-227b2751-2a8a-4808-8dbb-663336109c7a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': 'aaab4f72-4659-476f-b750-6b9ce165efe4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:08:59.843253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-227b2751-2a8a-4808-8dbb-663336109c7a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103380) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:08:59.846314 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-2bc6846b-fcb1-42d4-91c8-d2a12fcd0846 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] update failed (client error): The resource could not be found. Nov 24 04:08:59.849866 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2bc6846b-fcb1-42d4-91c8-d2a12fcd0846 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "PUT /v2.0/floatingips/b09f1b77-fb5b-41f3-b364-8a96ee59abe6 HTTP/1.1" status: 404 len: 507 time: 0.6863313 Nov 24 04:08:59.854458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57424) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:08:59.868996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.889121 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['bd0cfc7f-154f-4dba-bb4b-86d1245efb06'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:08:59.898083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 189c11b3-8b23-4af9-bb88-8b84a0f455ec {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:08:59.905299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] For port 42e80f9b-33db-4c7f-85ba-50908c286ec3, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:08:59.923036 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8ea1bdc1-0f53-4b68-a565-dce914b52769 req-c5d08551-9892-4066-835d-d43710ec6567 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2141831 Nov 24 04:08:59.947931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.953477 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/networks/189c11b3-8b23-4af9-bb88-8b84a0f455ec HTTP/1.1" status: 204 len: 168 time: 1.5362184 Nov 24 04:08:59.967551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:08:59.969210 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:08:59.969897 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] 10.222.0.21 "PUT /v2.0/ports/a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b HTTP/1.1" status: 200 len: 1094 time: 2.7110758 Nov 24 04:08:59.988380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:00.018114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc29059f-3385-4d82-ac59-60d170a96167 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event deleted for resources: {'Network': ['ID=189c11b3-8b23-4af9-bb88-8b84a0f455ec,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:00.047819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] For port 42e80f9b-33db-4c7f-85ba-50908c286ec3, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:00.137280 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.services.metering.metering_plugin [None req-227b2751-2a8a-4808-8dbb-663336109c7a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 24 04:09:00.178072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.179946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fade08d3-c52f-4103-8156-3c15ab4f2cf3 service neutron] Pushing event updated for resources: {'Port': ['ID=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:00.339070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Pushing event updated for resources: {'Port': ['ID=42e80f9b-33db-4c7f-85ba-50908c286ec3,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:00.425242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ee4405-d760-49b2-97eb-c4884f5a1774 req-53e98df3-6e92-4562-a6b5-7e7248b4ce5c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:00.439130 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f6ee4405-d760-49b2-97eb-c4884f5a1774 req-53e98df3-6e92-4562-a6b5-7e7248b4ce5c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 944 time: 0.5942445 Nov 24 04:09:00.459704 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:00.460331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.471089 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-ee3045dc-d655-42ef-ab5a-6dc9866d5ae2 service neutron] 10.222.0.21 "PUT /v2.0/ports/42e80f9b-33db-4c7f-85ba-50908c286ec3 HTTP/1.1" status: 200 len: 1093 time: 3.3378546 Nov 24 04:09:00.543696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-67890a4c-90d2-4ed3-aea7-1185897b78a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:00.545251 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-67890a4c-90d2-4ed3-aea7-1185897b78a7 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=ca64a4f493b349449d44be7e1d9fb98c&device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 1097 time: 0.5121305 Nov 24 04:09:00.547095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57440) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:00.588263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'name': 'tempest-router--247023635', 'project_id': '9e2ac5db16ce4d02ba0ed81e9eb37ddf'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:00.700052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2433d111-731a-494d-bcd4-1946b2414045" -d '{"events": [{"name": "network-changed", "server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:00.755848 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-ee927b51-a4c3-432f-ac79-b5e8cd2c9947 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b HTTP/1.1" status: 200 len: 217 time: 0.1556513 Nov 24 04:09:00.757855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:00.758230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.767882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-227b2751-2a8a-4808-8dbb-663336109c7a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.769548 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-227b2751-2a8a-4808-8dbb-663336109c7a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.9338715 Nov 24 04:09:00.774294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57450) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:00.786513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2ec92249-9883-4565-b4e5-2b44fba84edb tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': 'aaab4f72-4659-476f-b750-6b9ce165efe4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:00.787314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2ec92249-9883-4565-b4e5-2b44fba84edb tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103380) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:09:00.811753 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Deleting port 20529798-fc19-4526-8ffd-d298c30fd828 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:00.812312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.891563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-cb55fead-6ee9-4c03-87b7-d2fd9587cadd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:00.893088 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-cb55fead-6ee9-4c03-87b7-d2fd9587cadd service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49&device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 1096 time: 0.3618467 Nov 24 04:09:00.896524 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f6ee4405-d760-49b2-97eb-c4884f5a1774 req-db711217-8b18-49c6-8107-c0d243d64499 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4392922 Nov 24 04:09:00.922595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.923656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.928160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:00.954711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:00.996166 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-36c2d437-fae2-42e3-b35a-f3507ecc4f47 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3 HTTP/1.1" status: 200 len: 217 time: 0.0899169 Nov 24 04:09:01.002468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-9fb491ea-f1bb-4165-9f40-d4f2f0e0e099 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.003929 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-9fb491ea-f1bb-4165-9f40-d4f2f0e0e099 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ac08ee4f-45d7-4c2e-ab90-055d80970c38 HTTP/1.1" status: 200 len: 844 time: 0.1685200 Nov 24 04:09:01.051168 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.services.metering.metering_plugin [None req-2ec92249-9883-4565-b4e5-2b44fba84edb tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 24 04:09:01.150012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.159783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3e80064-cd84-497a-8bea-09751ca78313 x-openstack-request-id: req-d3e80064-cd84-497a-8bea-09751ca78313 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:01.160079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:01.160358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-d3e80064-cd84-497a-8bea-09751ca78313 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:01.160812 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'status': 'completed', 'code': 200} Nov 24 04:09:01.169459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.175020 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.175374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.202859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-03a39063-bc7c-4270-ae16-b678c7607c6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.204332 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-03a39063-bc7c-4270-ae16-b678c7607c6e service neutron] 10.222.0.21 "GET /v2.0/subnets?id=d6b900d5-6e1c-467d-a80c-b932fd4e77fd HTTP/1.1" status: 200 len: 850 time: 0.1995366 Nov 24 04:09:01.227323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.227711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090e5c46-41aa-4309-ae39-aff198ee2971 req-25f4bd71-b3d2-46be-a559-aa929c1cb490 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.228534 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b2525cd0-5bb0-4698-9fbf-77e2a3e20977 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.6791122 Nov 24 04:09:01.232164 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-090e5c46-41aa-4309-ae39-aff198ee2971 req-25f4bd71-b3d2-46be-a559-aa929c1cb490 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 943 time: 0.3065524 Nov 24 04:09:01.232808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57464) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.238527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ec92249-9883-4565-b4e5-2b44fba84edb tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.242679 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2ec92249-9883-4565-b4e5-2b44fba84edb tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.4606185 Nov 24 04:09:01.245860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Calling delete_port for 20529798-fc19-4526-8ffd-d298c30fd828 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:01.250519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57466) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.260356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1294832b-d688-4976-8053-a98e66a32934 req-f1bed841-b401-4a0c-9638-00f6e01c13c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.261884 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-f1bed841-b401-4a0c-9638-00f6e01c13c9 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=9279fc65-0f7e-4ac5-8fda-e94ff426a487&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2475073 Nov 24 04:09:01.283907 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ee1c841d-3677-4bfe-8059-c328be6a9fab tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules?id=a22ff02b-78d3-47d0-bc6c-aee55ef5c5f7 HTTP/1.1" status: 200 len: 464 time: 0.0288503 Nov 24 04:09:01.304151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57468) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.354187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57470) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.361266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-e4eed637-eeae-4f64-a3d0-e01cc0b855a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.362898 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-e4eed637-eeae-4f64-a3d0-e01cc0b855a9 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1479738 Nov 24 04:09:01.415160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.517574 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-090e5c46-41aa-4309-ae39-aff198ee2971 req-01d3249e-e448-4838-b108-1e22a81b0d71 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2661157 Nov 24 04:09:01.530292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-952658363'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:01.557529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.566496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0140906f-eaa4-4ce9-b2c7-464bea62839a req-047ec17f-81b4-4e21-8735-b92203812f25 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.567972 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0140906f-eaa4-4ce9-b2c7-464bea62839a req-047ec17f-81b4-4e21-8735-b92203812f25 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 944 time: 0.2855232 Nov 24 04:09:01.589781 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-ab496e88-d471-4a0b-9faf-8bbfb88bba01 service neutron] 10.222.0.21 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3190527 Nov 24 04:09:01.656848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:01.667407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.671103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.672249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89c20134-157b-4b26-a68f-939f9d426899 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.676460 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-89c20134-157b-4b26-a68f-939f9d426899 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-label-rules/a22ff02b-78d3-47d0-bc6c-aee55ef5c5f7 HTTP/1.1" status: 204 len: 168 time: 0.3658037 Nov 24 04:09:01.695323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57474) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.707266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Made reservation on behalf of d6936b011bd74028af2ed1051e1988ab for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:01.711005 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.725198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.730825 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0d76137f-f25b-481c-98b2-b83d8d18c455 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 HTTP/1.1" status: 204 len: 168 time: 1.9265249 Nov 24 04:09:01.735284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57476) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.772357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.802427 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-49982bfd-96a3-4a09-b499-6da17822913e service neutron] 10.222.0.21 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4018567 Nov 24 04:09:01.825310 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0fdc27c9-8877-42fc-bb51-b394983d29a1 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules?id=a22ff02b-78d3-47d0-bc6c-aee55ef5c5f7 HTTP/1.1" status: 200 len: 221 time: 0.1282835 Nov 24 04:09:01.829864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.832473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57478) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:01.859389 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0140906f-eaa4-4ce9-b2c7-464bea62839a req-35db707f-e1ac-4fc1-a843-4f9c7ded9990 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2811410 Nov 24 04:09:01.878125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5d770a7f-5ab8-406f-90ba-97cfdce25e64 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--1545765368', 'description': 'label created by tempest'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:01.878618 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5d770a7f-5ab8-406f-90ba-97cfdce25e64 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Unknown quota resources ['metering_label']. {{(pid=103380) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 24 04:09:01.889285 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1294832b-d688-4976-8053-a98e66a32934 req-de1041bf-d8b8-4d29-9b5e-cd7b7df8624d service neutron] 10.222.0.21 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2716668 Nov 24 04:09:01.925297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Port': ['ID=20529798-fc19-4526-8ffd-d298c30fd828,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:01.937839 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.938400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 0149af66-04c0-4403-a797-30315a78d30e {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:01.945898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:01.947060 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9cc0a46a-0b55-43c2-a23f-3cf98bcebccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/routers/0149af66-04c0-4403-a797-30315a78d30e HTTP/1.1" status: 204 len: 168 time: 0.7030995 Nov 24 04:09:01.968979 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0a9dd393-8210-48a0-bcc9-f95081275258 req-b810d4e5-a38e-46ad-b2cb-5416116aa989 service neutron] 10.222.0.21 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1555030 Nov 24 04:09:01.973034 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca88ee48-f2dd-4547-8a3e-d9ec5b88ce31 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.975518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca88ee48-f2dd-4547-8a3e-d9ec5b88ce31 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:01.982711 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca88ee48-f2dd-4547-8a3e-d9ec5b88ce31 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2426159 Nov 24 04:09:01.982711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57484) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.092090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 41e43747-a1ce-4657-bc29-b195db1f42a3 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:02.097246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.151287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.175000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57486) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.220042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2433d111-731a-494d-bcd4-1946b2414045 req-657e0f82-3e46-4f54-82c7-d83f78bacacb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:02.222117 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-657e0f82-3e46-4f54-82c7-d83f78bacacb service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=ca64a4f493b349449d44be7e1d9fb98c&device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 1097 time: 0.2342741 Nov 24 04:09:02.238137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d770a7f-5ab8-406f-90ba-97cfdce25e64 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.241687 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5d770a7f-5ab8-406f-90ba-97cfdce25e64 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.3675277 Nov 24 04:09:02.248008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57490) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.263224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.266314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.267471 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-41c4623d-90c2-4ad7-bca3-3b53e181594c tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "DELETE /v2.0/floatingips/b09f1b77-fb5b-41f3-b364-8a96ee59abe6 HTTP/1.1" status: 204 len: 168 time: 2.4120903 Nov 24 04:09:02.274961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57492) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.291999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fc344dc7-fa65-4c48-9a6d-81c1e5e96232 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'floatingip': {'floating_network_id': '5d869497-2705-4cc2-b36d-4dea3a8792ca', 'port_id': 'be44ef90-0520-4a24-a3bf-4833265bd1f0', 'fixed_ip_address': '172.20.0.8'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:02.341206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9dd1fd2-eeb0-47c4-9bdd-33d173b79670 req-d45f5f12-bc0d-4f82-a8e5-d86045a7a93b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:02.342845 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9dd1fd2-eeb0-47c4-9bdd-33d173b79670 req-d45f5f12-bc0d-4f82-a8e5-d86045a7a93b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 944 time: 0.2743571 Nov 24 04:09:02.343051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.350752 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1b15f29d-a0a2-4735-9db7-e93ed6de557d tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels?id=c507ca17-29ea-4d20-843c-e5d3114c451e HTTP/1.1" status: 200 len: 468 time: 0.1013923 Nov 24 04:09:02.359046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57494) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.406686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1142161962', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:02.455392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.477320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.491961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fc344dc7-fa65-4c48-9a6d-81c1e5e96232 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.619732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:02.628352 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9dd1fd2-eeb0-47c4-9bdd-33d173b79670 req-8e4c0e46-8aa5-43ba-9ddc-d11651225944 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2765639 Nov 24 04:09:02.636794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.637786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.655517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b39ec71-6b1d-4b03-abf6-300dcc4c629f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:02.665623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.665977 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Added segment 10462bbd-d34e-4c70-949a-31a1e06b54a2 of type vlan for network 1696a733-a969-453a-b9f6-904c0b76edc6 Nov 24 04:09:02.680944 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2433d111-731a-494d-bcd4-1946b2414045 req-be43871a-6750-4e0e-a6e9-36124e61ff11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:02.682411 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-be43871a-6750-4e0e-a6e9-36124e61ff11 service neutron] 10.222.0.21 "GET /v2.0/networks?id=9279fc65-0f7e-4ac5-8fda-e94ff426a487 HTTP/1.1" status: 200 len: 906 time: 0.4294593 Nov 24 04:09:02.728487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12fa98f4-ef4b-414a-99bc-13e337024f1a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.732599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device bd0cfc7f-154f-4dba-bb4b-86d1245efb06 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:02.733090 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-12fa98f4-ef4b-414a-99bc-13e337024f1a tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-labels/c507ca17-29ea-4d20-843c-e5d3114c451e HTTP/1.1" status: 204 len: 168 time: 0.3676288 Nov 24 04:09:02.736529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63827037-320d-4350-a4f2-b7107db8c5fa req-25f3f844-2d3f-4bcd-aef9-dc0e5ea58c89 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:02.738636 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-63827037-320d-4350-a4f2-b7107db8c5fa req-25f3f844-2d3f-4bcd-aef9-dc0e5ea58c89 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 943 time: 0.1227665 Nov 24 04:09:02.740433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57498) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.749884 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-f0216534-78a6-4685-9d10-5b12dfa47812 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b HTTP/1.1" status: 200 len: 217 time: 0.0583363 Nov 24 04:09:02.752635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.786720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:09:02.790611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:02.791564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.795706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.804810 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d638a6eb-76fd-4e81-bd25-fd007d464597 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels?id=c507ca17-29ea-4d20-843c-e5d3114c451e HTTP/1.1" status: 200 len: 216 time: 0.0630264 Nov 24 04:09:02.808278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57500) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.832109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=41e43747-a1ce-4657-bc29-b195db1f42a3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:02.834733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:02.838176 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-88c4b94b-ac4e-4af6-84d9-fa03489d63a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/41e43747-a1ce-4657-bc29-b195db1f42a3 HTTP/1.1" status: 204 len: 168 time: 0.8548768 Nov 24 04:09:02.847488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57502) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.851336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b03c2c78-3930-42d4-ade4-bb23a2cffea9 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:02.862891 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-df795204-46a8-4e1e-a512-d68b53e26eb3 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0535567 Nov 24 04:09:02.899594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57504) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.905598 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-38bd7f47-b4fd-4ca9-94bc-bac04f1b24ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0537164 Nov 24 04:09:02.914116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57508) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:02.931000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:02.940381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2433d111-731a-494d-bcd4-1946b2414045 req-38f53c8d-ac3b-400f-9b87-5b97a2a2e6a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:02.941872 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-38f53c8d-ac3b-400f-9b87-5b97a2a2e6a6 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ac08ee4f-45d7-4c2e-ab90-055d80970c38 HTTP/1.1" status: 200 len: 844 time: 0.1705914 Nov 24 04:09:02.980192 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b577022d-0a27-464f-ad87-827f7db3aa2e tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0760705 Nov 24 04:09:02.989934 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-63827037-320d-4350-a4f2-b7107db8c5fa req-6b7f2780-9f87-4a42-8993-44a25da0e6bb tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2425253 Nov 24 04:09:03.006372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57510) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:03.034952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.064415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.087341 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:03.117949 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bbab92ad-5d8e-47f3-a7fa-02ea30ad85fc tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-labels/aaab4f72-4659-476f-b750-6b9ce165efe4 HTTP/1.1" status: 200 len: 473 time: 0.1072378 Nov 24 04:09:03.118957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57512) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:03.135411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2433d111-731a-494d-bcd4-1946b2414045 req-a8c4c8d3-a86c-4037-be8b-4d950409fb8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:03.136844 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-a8c4c8d3-a86c-4037-be8b-4d950409fb8f service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=9279fc65-0f7e-4ac5-8fda-e94ff426a487&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1726279 Nov 24 04:09:03.143117 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b47457e-38bb-4934-a45b-ef477ed8502e tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "GET /v2.0/metering/metering-label-rules/5e4260f5-b3a2-487b-b1c3-bc1a76aca18b HTTP/1.1" status: 200 len: 461 time: 0.0196164 Nov 24 04:09:03.144568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57514) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:03.169050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:03.172406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7" -d '{"events": [{"name": "network-changed", "server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:03.176260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:03.181110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:03.203601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:03.207216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.210364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.264728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b1d94d-0584-4d3c-a938-e70dae7f1f9b req-e325a129-37f4-4be8-96fe-621e4ec7929b tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:03.266711 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b1d94d-0584-4d3c-a938-e70dae7f1f9b req-e325a129-37f4-4be8-96fe-621e4ec7929b tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 944 time: 0.2009294 Nov 24 04:09:03.267778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.273982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:03.278445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:03.279557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.287184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c248f898-86bc-4fb3-946d-a33f18bd4a22 x-openstack-request-id: req-c248f898-86bc-4fb3-946d-a33f18bd4a22 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:03.287480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:03.287838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-c248f898-86bc-4fb3-946d-a33f18bd4a22 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:03.288409 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'status': 'completed', 'code': 200} Nov 24 04:09:03.288513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] Deleting port 4b4e88d9-60ff-44ef-928e-6e376b083958 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:03.288513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.351937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0273756-bf55-4d1e-9270-123998e791d9" -d '{"events": [{"server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "name": "network-vif-plugged", "status": "completed", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:03.370875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] For port 4b4e88d9-60ff-44ef-928e-6e376b083958, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4b4e88d9-60ff-44ef-928e-6e376b083958,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:03.371285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.386972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] Calling delete_port for 4b4e88d9-60ff-44ef-928e-6e376b083958 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:03.401619 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-48e96a83-beb2-4a79-ab2b-0580dcccff96 service neutron] 10.222.0.21 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2534471 Nov 24 04:09:03.406035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-e9084688-4d57-4b05-a59a-e07f77d4eb2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:03.407455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-e9084688-4d57-4b05-a59a-e07f77d4eb2e service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49&device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 1096 time: 0.1186233 Nov 24 04:09:03.429442 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 802 time: 2.0742989 Nov 24 04:09:03.479226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.510062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-41ba73a6-b32a-448c-a744-9d6f6e225a74 x-openstack-request-id: req-41ba73a6-b32a-448c-a744-9d6f6e225a74 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:03.510489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "name": "network-vif-plugged", "status": "completed", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:03.510820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-41ba73a6-b32a-448c-a744-9d6f6e225a74 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:03.511352 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'code': 200} Nov 24 04:09:03.515168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] Pushing event deleted for resources: {'Port': ['ID=4b4e88d9-60ff-44ef-928e-6e376b083958,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:03.521500 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d538cb1e-ccc8-441e-8ff5-e6b34c58e3eb None None] No DVR routers for this DVR port 4b4e88d9-60ff-44ef-928e-6e376b083958 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:03.551705 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.565910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c0af79-83a8-4586-bb6c-1013695c7ce9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Pushing event updated for resources: {'Network': ['ID=1696a733-a969-453a-b9f6-904c0b76edc6,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:03.583838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 1696a733-a969-453a-b9f6-904c0b76edc6 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:03.646961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8307dbf-9cde-4ca2-9d5d-7d8703f76c26 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.649207 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b8307dbf-9cde-4ca2-9d5d-7d8703f76c26 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-label-rules/5e4260f5-b3a2-487b-b1c3-bc1a76aca18b HTTP/1.1" status: 204 len: 168 time: 0.5021133 Nov 24 04:09:03.652323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57530) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:03.662982 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2433d111-731a-494d-bcd4-1946b2414045 req-7a9faf0f-9379-4d13-97bb-3563ab2ec638 service neutron] 10.222.0.21 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2533028 Nov 24 04:09:03.673131 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-fc344dc7-fa65-4c48-9a6d-81c1e5e96232 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:09:03.674801 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fc344dc7-fa65-4c48-9a6d-81c1e5e96232 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 1.3938060 Nov 24 04:09:03.688858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57534) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:03.702413 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b1d94d-0584-4d3c-a938-e70dae7f1f9b req-9c941148-6845-4ebe-bafc-ccfe24b7a64c tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4098890 Nov 24 04:09:03.715884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': 'be44ef90-0520-4a24-a3bf-4833265bd1f0', 'fixed_ip_address': '172.20.0.8'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:03.791672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-5f573efd-35c5-41d6-9ba0-098b6348dd0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:03.793542 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-5f573efd-35c5-41d6-9ba0-098b6348dd0f service neutron] 10.222.0.21 "GET /v2.0/networks?id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 HTTP/1.1" status: 200 len: 912 time: 0.3747256 Nov 24 04:09:03.814094 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57536) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:03.819466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Request body: {'port': {'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6', 'binding:host_id': 'hv-neutron-8190', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-130994854'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:03.853369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.903199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:09:03.903199 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 24 04:09:03.903199 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'project_id_1': '728830d7da834543a5a2d2274585166f', 'expiration_1': datetime.datetime(2021, 11, 24, 4, 8, 43, 825908)}] Nov 24 04:09:03.903199 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:09:03.903639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:09:03.913883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6fc6a4b-5994-4d03-9d0e-f5296bb33c0a req-2782d957-1548-42f2-8975-668a1363611d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:03.920557 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b6fc6a4b-5994-4d03-9d0e-f5296bb33c0a req-2782d957-1548-42f2-8975-668a1363611d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1385083 Nov 24 04:09:03.930918 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-ee31dd34-640b-4914-8dda-431c1eef0922 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3 HTTP/1.1" status: 200 len: 217 time: 0.0904670 Nov 24 04:09:03.951333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.979350 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:03.984450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.001858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:04.042714 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b6fc6a4b-5994-4d03-9d0e-f5296bb33c0a req-50365c45-9c17-4c95-a8e7-acab118a9c43 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1139426 Nov 24 04:09:04.071152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73045f7a-d6ca-4294-8087-ef27b46baa3d req-61453bea-c627-4297-834a-715a03324b75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:04.071152 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73045f7a-d6ca-4294-8087-ef27b46baa3d req-61453bea-c627-4297-834a-715a03324b75 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.3400168 Nov 24 04:09:04.071152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:04.080245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a2dadcd-3f3e-46a8-8e54-6d409f6a9cd4 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:04.084875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:04.085468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.120286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Allocated IP 172.26.5.215 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/cc1c45ae-3dee-42dd-bf99-5c294229a3b2) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:04.125483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=99e8a855-2923-4474-9465-b5f9427a8d4d,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:04.188340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73045f7a-d6ca-4294-8087-ef27b46baa3d req-5d83dd5d-cb56-4761-b7ca-0c96cb12f709 service neutron] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.207724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f20e91d6-6ef1-496a-9c24-13a9b039ce78 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.209115 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f20e91d6-6ef1-496a-9c24-13a9b039ce78 tempest-MeteringTestJSON-875115248 tempest-MeteringTestJSON-875115248-project-admin] 10.222.0.48 "DELETE /v2.0/metering/metering-labels/aaab4f72-4659-476f-b750-6b9ce165efe4 HTTP/1.1" status: 204 len: 168 time: 0.5531483 Nov 24 04:09:04.213171 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-09053f38-da05-4613-a511-b174b63e6c7b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.2921789 Nov 24 04:09:04.216112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-2e0f1be7-8ef7-4526-8dbd-207787102a1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:04.218108 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-2e0f1be7-8ef7-4526-8dbd-207787102a1b service neutron] 10.222.0.21 "GET /v2.0/subnets?id=d6b900d5-6e1c-467d-a80c-b932fd4e77fd HTTP/1.1" status: 200 len: 850 time: 0.2756348 Nov 24 04:09:04.220879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57542) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:04.238082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '99e8a855-2923-4474-9465-b5f9427a8d4d'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:04.239452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.251604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '99e8a855-2923-4474-9465-b5f9427a8d4d', 'ip_address': '2001:db8::9a6:6950:2577:60f'}], 'name': 'tempest-NetworksTestDHCPv6-539017190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:04.255911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.305304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.353831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:04.357154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:04.366588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:04.389711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1486e6b-98fb-4285-9c37-adec15f07c0a req-e551f8be-803c-488f-bae3-bba60cc756fb tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:04.397103 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f1486e6b-98fb-4285-9c37-adec15f07c0a req-e551f8be-803c-488f-bae3-bba60cc756fb tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 943 time: 0.3255222 Nov 24 04:09:04.403192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/99e8a855-2923-4474-9465-b5f9427a8d4d/329c7013-0e17-418d-9fba-82bf48ba3022) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:04.426694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event updated for resources: {'Port': ['ID=cc1c45ae-3dee-42dd-bf99-5c294229a3b2,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:04.528315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Made reservation on behalf of 728830d7da834543a5a2d2274585166f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:04.529542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-c322c7d9-c012-45e6-a971-e79c4635cef0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:04.531055 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-c322c7d9-c012-45e6-a971-e79c4635cef0 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2750793 Nov 24 04:09:04.531483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.548319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.568117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57546) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:04.643207 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f1486e6b-98fb-4285-9c37-adec15f07c0a req-f956b2fc-544c-4175-8387-2aee717cc97f tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2407649 Nov 24 04:09:04.644116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:04.689693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.694952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4b4e88d9-60ff-44ef-928e-6e376b083958 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:04.727647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.729028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73045f7a-d6ca-4294-8087-ef27b46baa3d req-5d83dd5d-cb56-4761-b7ca-0c96cb12f709 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.735298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.749139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73045f7a-d6ca-4294-8087-ef27b46baa3d req-5d83dd5d-cb56-4761-b7ca-0c96cb12f709 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.778328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 42e80f9b-33db-4c7f-85ba-50908c286ec3 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:09:04.781468 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 4b4e88d9-60ff-44ef-928e-6e376b083958 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:04.781885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4b4e88d9-60ff-44ef-928e-6e376b083958 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:04.806198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Pushing event updated for resources: {'Port': ['ID=329c7013-0e17-418d-9fba-82bf48ba3022,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:04.809186 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7be3995a-2bc7-4218-8926-00f041e6ef0f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.817592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:04.821251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:04.825347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:04.853034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.853608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d83dd5d-cb56-4761-b7ca-0c96cb12f709 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b745f2a2-a378-4078-b4d8-82637bf256ad,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:04.874328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.919409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.932964 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port 635ac3a1-f204-43c1-90f2-cf907c37b244 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:04.942872 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-97f79291-9a37-49f3-913d-c05ecb74d8a5 service neutron] 10.222.0.21 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3980722 Nov 24 04:09:04.951295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Attempting to bind port 329c7013-0e17-418d-9fba-82bf48ba3022 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:04.951759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Attempting to bind port 329c7013-0e17-418d-9fba-82bf48ba3022 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:04.952199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Attempting to bind port 329c7013-0e17-418d-9fba-82bf48ba3022 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:04.959249 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73045f7a-d6ca-4294-8087-ef27b46baa3d req-5d83dd5d-cb56-4761-b7ca-0c96cb12f709 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8827691 Nov 24 04:09:04.963025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 8, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:04.963446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:04.963907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.964439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:04.965065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Bound port: 329c7013-0e17-418d-9fba-82bf48ba3022, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:04.965217 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:04.980877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06617d43-2a7e-455f-9dbf-18e2c66fe62a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.000238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.026526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 42e80f9b-33db-4c7f-85ba-50908c286ec3, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:05.046265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'port_id': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'mac_address': 'fa:16:3e:b2:2d:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 160, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:09:05.076290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d372a2a5-5f53-4761-ac2e-dc7c798658f4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:05.086586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] For port 329c7013-0e17-418d-9fba-82bf48ba3022, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:05.100058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port f5fbb2af-1b51-4f92-bf9b-e85189a935a3 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:05.106131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b18dd2d3-3e2d-4d3b-98c6-ceb6d8781009 req-fcc2ac33-7be2-4bdf-b7d9-7e4904c89ce7 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:05.106418 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] For port 329c7013-0e17-418d-9fba-82bf48ba3022, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=329c7013-0e17-418d-9fba-82bf48ba3022,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:05.107771 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b18dd2d3-3e2d-4d3b-98c6-ceb6d8781009 req-fcc2ac33-7be2-4bdf-b7d9-7e4904c89ce7 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 944 time: 0.2807498 Nov 24 04:09:05.115943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.121954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.166810 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 42e80f9b-33db-4c7f-85ba-50908c286ec3 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:09:05.212762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 42e80f9b-33db-4c7f-85ba-50908c286ec3, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:05.221942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.222581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:09:05.226463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918d6735-6c46-40f9-aee4-a1afed83667f None None] Pushing event updated for resources: {'Port': ['ID=329c7013-0e17-418d-9fba-82bf48ba3022,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:05.287314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7be3995a-2bc7-4218-8926-00f041e6ef0f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.321550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=42e80f9b-33db-4c7f-85ba-50908c286ec3,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:05.332855 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7be3995a-2bc7-4218-8926-00f041e6ef0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.384695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:05.396996 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b18dd2d3-3e2d-4d3b-98c6-ceb6d8781009 req-81b74102-68e5-4dde-ab99-080ae06814ec tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2722056 Nov 24 04:09:05.405289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'port_id': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'mac_address': 'fa:16:3e:6e:0c:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:09:05.494234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.514363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:09:05.521215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be3995a-2bc7-4218-8926-00f041e6ef0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c4e7fe0-a760-4868-964f-827be2a8fada,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:05.528422 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7be3995a-2bc7-4218-8926-00f041e6ef0f admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=3254c69f06364c2f9ec171ad407710c6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9592514 Nov 24 04:09:05.542947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57554) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:05.556412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:05.563827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.580642 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-136add6f-7f5d-4c57-952a-a9f5b8be0cc7 req-9e17c04b-bc9e-4d84-9667-cb57ec16d1d2 service neutron] 10.222.0.21 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6280022 Nov 24 04:09:05.584741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Allocated IP 172.26.5.61 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/ed5cfc50-7c9b-4e5f-9d3b-aa5984e5081f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:05.638853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:05.683024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f3295148-f024-46a2-b95e-1967c8a3f789 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.694182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port 635ac3a1-f204-43c1-90f2-cf907c37b244 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:05.700794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.721208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54799f77-cfaf-4c86-8acb-94da893c3662 req-53479888-6734-481d-8905-5a3ee09ee973 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:05.723415 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-54799f77-cfaf-4c86-8acb-94da893c3662 req-53479888-6734-481d-8905-5a3ee09ee973 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3358793 Nov 24 04:09:05.725749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.753743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f3295148-f024-46a2-b95e-1967c8a3f789 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.762292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:05.773156 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::9a6:6950:2577:60f (a2b36c78-43a6-4954-8102-cb5638999bb1/99e8a855-2923-4474-9465-b5f9427a8d4d/f5fbb2af-1b51-4f92-bf9b-e85189a935a3) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:05.811140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['42e80f9b-33db-4c7f-85ba-50908c286ec3'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:09:05.839941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:09:05.866630 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-54799f77-cfaf-4c86-8acb-94da893c3662 req-49084be6-783e-4412-84f8-8d77800d09a9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1120453 Nov 24 04:09:05.879206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.010308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.066295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:06.084539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:06.088790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.097114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:06.125648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event updated for resources: {'Port': ['ID=ed5cfc50-7c9b-4e5f-9d3b-aa5984e5081f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:06.155499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=635ac3a1-f204-43c1-90f2-cf907c37b244,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:06.190104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.220510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524dcda6-637b-4a4d-b78e-49d415630359 req-e608e644-4c1e-400f-8d97-2b1c815a3489 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:06.222180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-524dcda6-637b-4a4d-b78e-49d415630359 req-e608e644-4c1e-400f-8d97-2b1c815a3489 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 944 time: 0.4882264 Nov 24 04:09:06.261918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f3295148-f024-46a2-b95e-1967c8a3f789 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.265043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f3295148-f024-46a2-b95e-1967c8a3f789 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.268515 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f3295148-f024-46a2-b95e-1967c8a3f789 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/4c4e7fe0-a760-4868-964f-827be2a8fada HTTP/1.1" status: 204 len: 168 time: 0.7143736 Nov 24 04:09:06.285425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:06.289066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Checking segment: {'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:06.289435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Network hostable DHCP agents. Network: 1696a733-a969-453a-b9f6-904c0b76edc6, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:06.291674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:06.297712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3295148-f024-46a2-b95e-1967c8a3f789 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c4e7fe0-a760-4868-964f-827be2a8fada,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:06.305393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:06.310965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:06.311608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.316638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=f5fbb2af-1b51-4f92-bf9b-e85189a935a3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:06.344495 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-524dcda6-637b-4a4d-b78e-49d415630359 req-a16a229e-1433-4b0b-82ee-51ba918fc478 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1134193 Nov 24 04:09:06.354675 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ed645925-737b-41ee-b192-91e4531be7d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 945 time: 2.1114366 Nov 24 04:09:06.355411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57560) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:06.358529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Network 1696a733-a969-453a-b9f6-904c0b76edc6 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:06.364888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Router 3d7560cf-46f6-4f4f-ac2f-a48f0342f627 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:06.383721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 1696a733-a969-453a-b9f6-904c0b76edc6) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:06.393688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bef5b937-6e83-4fb8-97aa-5f9e65e9a41b None None] Network 1696a733-a969-453a-b9f6-904c0b76edc6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:06.417713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:06.442023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:06.444168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f4c8173-5945-49de-a518-d20f7ad8ec47 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:06.444611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:06.445088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:06.453574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f4c8173-5945-49de-a518-d20f7ad8ec47 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:06.455788 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6f4c8173-5945-49de-a518-d20f7ad8ec47 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1682 time: 0.0974300 Nov 24 04:09:06.462759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57564) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:06.464742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Deleting port ed5cfc50-7c9b-4e5f-9d3b-aa5984e5081f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:06.465098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.551455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:06.552426 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:06.558913 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 2 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:06.700971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:06.701420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:06.701875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:06.718726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:06.719376 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:06.724164 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 3 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:06.795648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:06.796403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:06.797110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:06.801290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.801945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.812832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:06.813617 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:06.816264 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 4 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:06.835075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5416362b-f9ca-49fc-b647-e74ba8fd5a7c req-e2346d93-609a-4851-94cf-af00903da0f8 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:06.836626 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5416362b-f9ca-49fc-b647-e74ba8fd5a7c req-e2346d93-609a-4851-94cf-af00903da0f8 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 945 time: 0.2424235 Nov 24 04:09:06.842311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Calling delete_port for ed5cfc50-7c9b-4e5f-9d3b-aa5984e5081f owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:06.844251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:06.845443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:06.846258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:06.849130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:06.860493 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] Sync routers for ids ['3d7560cf-46f6-4f4f-ac2f-a48f0342f627'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:06.865625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:06.866537 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:06.869446 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 5 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:06.890667 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] Routers {'3d7560cf-46f6-4f4f-ac2f-a48f0342f627'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:06.892329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:06.893479 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d7560cf-46f6-4f4f-ac2f-a48f0342f627'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:06.894591 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-18dcfd1a-d3f2-442f-91c7-23458c477ee4 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 4.7176456 Nov 24 04:09:06.897029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57568) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:06.962956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:06.963222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 42e80f9b-33db-4c7f-85ba-50908c286ec3 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:06.963830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:06.964412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:06.975275 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:06.975852 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:06.981403 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 6 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:06.983916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port f5fbb2af-1b51-4f92-bf9b-e85189a935a3 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:06.984436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.002769 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57572) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:07.006684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 329c7013-0e17-418d-9fba-82bf48ba3022 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:07.016988 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:07.034240 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] Routers {'3d7560cf-46f6-4f4f-ac2f-a48f0342f627'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:07.035106 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:08:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d7560cf-46f6-4f4f-ac2f-a48f0342f627'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:07.070341 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:07.071650 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64fd0184-2dfa-4c18-8d40-6b9fb7230121 None None] The sync data for ids ['3d7560cf-46f6-4f4f-ac2f-a48f0342f627'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:07.082745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9588-6c02-49fd-8abf-6ddf8618217d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.111371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 329c7013-0e17-418d-9fba-82bf48ba3022 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:07.111676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.140228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-909122dd-9876-48ad-9a19-2527328baddb None None] Provisioning complete for port 329c7013-0e17-418d-9fba-82bf48ba3022 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:07.140638 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-909122dd-9876-48ad-9a19-2527328baddb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.149997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:07.150370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:07.150713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:07.163051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port 42e80f9b-33db-4c7f-85ba-50908c286ec3 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:09:07.178126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port 42e80f9b-33db-4c7f-85ba-50908c286ec3 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:07.178533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.181292 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5416362b-f9ca-49fc-b647-e74ba8fd5a7c req-4f04f187-0dc4-497c-8a86-9403b74af329 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3114936 Nov 24 04:09:07.187355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:07.187886 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:07.189686 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 7 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:07.211820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.242427 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b7d1b6a4-18e0-4072-a23a-8300a0719548 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/3d7560cf-46f6-4f4f-ac2f-a48f0342f627 HTTP/1.1" status: 200 len: 921 time: 0.3398690 Nov 24 04:09:07.247345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57574) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:07.261434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:07.261755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:07.261862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for f5fbb2af-1b51-4f92-bf9b-e85189a935a3 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:07.262060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:07.294305 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-04445278-4e26-41bd-af75-2ebd9e15ee9f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=3d7560cf-46f6-4f4f-ac2f-a48f0342f627 HTTP/1.1" status: 200 len: 205 time: 0.0358396 Nov 24 04:09:07.296374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57576) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:07.306524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee19340c-e161-48c2-b847-e7fdb62f240d req-32e3e0c8-56a5-441c-94c3-ebb648814656 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:07.308018 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ee19340c-e161-48c2-b847-e7fdb62f240d req-32e3e0c8-56a5-441c-94c3-ebb648814656 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2178504 Nov 24 04:09:07.309973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:07.310363 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:07.313564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.314412 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 8 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:07.352881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:07.353372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:07.353586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:07.382193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9588-6c02-49fd-8abf-6ddf8618217d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.382425 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:09:07.382518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:07.382518 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:07.382518 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 9 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:07.399273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:07.399606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:07.399951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:07.401575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 329c7013-0e17-418d-9fba-82bf48ba3022, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=329c7013-0e17-418d-9fba-82bf48ba3022,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:07.406690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e1f9588-6c02-49fd-8abf-6ddf8618217d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.410131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.422129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-909122dd-9876-48ad-9a19-2527328baddb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.424553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.432432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:07.432635 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:07.438955 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 10 to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 Nov 24 04:09:07.442693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.445418 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ee19340c-e161-48c2-b847-e7fdb62f240d req-c8f3c15a-b2bd-4050-80cc-b2be8eb5f16b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1273816 Nov 24 04:09:07.476492 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6e1f9588-6c02-49fd-8abf-6ddf8618217d admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=7262c61d57b0492e83042495424ebb77&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4728780 Nov 24 04:09:07.481566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:07.481906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:07.482337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:07.487541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57580) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:07.488120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 635ac3a1-f204-43c1-90f2-cf907c37b244 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:07.488449 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 635ac3a1-f204-43c1-90f2-cf907c37b244 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:07.488816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.497391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1f9588-6c02-49fd-8abf-6ddf8618217d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d40d67f-b970-4c83-85ab-fbbe64f367d1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:07.521356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 42e80f9b-33db-4c7f-85ba-50908c286ec3, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:07.526991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:07.531081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b093f1a-bd7e-404d-9755-3b291a742934" -d '{"events": [{"server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "name": "network-vif-plugged", "status": "completed", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:07.539983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.540919 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:07.602688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bbf51d10-db1d-4c1f-ba2c-1e1bd324126a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.619671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=329c7013-0e17-418d-9fba-82bf48ba3022,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:07.625437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bbf51d10-db1d-4c1f-ba2c-1e1bd324126a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.662476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-909122dd-9876-48ad-9a19-2527328baddb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:09:07.662866 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Port': ['ID=ed5cfc50-7c9b-4e5f-9d3b-aa5984e5081f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:07.662984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-909122dd-9876-48ad-9a19-2527328baddb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:09:07.666584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] For port 635ac3a1-f204-43c1-90f2-cf907c37b244, host hv-neutron-8190, cleared binding levels {{(pid=103380) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:07.666964 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempted to set empty binding levels {{(pid=103380) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 04:09:07.677585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.681566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:09:07.687735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bbf51d10-db1d-4c1f-ba2c-1e1bd324126a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.690509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bbf51d10-db1d-4c1f-ba2c-1e1bd324126a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.691786 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bbf51d10-db1d-4c1f-ba2c-1e1bd324126a admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/8d40d67f-b970-4c83-85ab-fbbe64f367d1 HTTP/1.1" status: 204 len: 168 time: 0.2005088 Nov 24 04:09:07.694044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:07.702248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.729982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf51d10-db1d-4c1f-ba2c-1e1bd324126a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d40d67f-b970-4c83-85ab-fbbe64f367d1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:07.756431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:07.757278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.780637 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=635ac3a1-f204-43c1-90f2-cf907c37b244,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:07.797110 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dead7466-a844-475d-a1e8-d47d5c431cdf tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 985 time: 3.9819369 Nov 24 04:09:07.799738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57588) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:07.802229 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=42e80f9b-33db-4c7f-85ba-50908c286ec3,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:07.814516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd3cc86-ec37-4abf-8c89-e4655d91701a req-c12bfc29-504c-4e0e-8758-64d18487e446 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:07.826944 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fcd3cc86-ec37-4abf-8c89-e4655d91701a req-c12bfc29-504c-4e0e-8758-64d18487e446 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1415331 Nov 24 04:09:07.828572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57590) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:07.838886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Request body: {'floatingip': {'port_id': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:07.869527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.906527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1451a324-1a7a-4eda-8dec-3aae64c20760 req-ede2aa32-04d6-489c-940c-3d8c4ac68c7a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:07.909673 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1451a324-1a7a-4eda-8dec-3aae64c20760 req-ede2aa32-04d6-489c-940c-3d8c4ac68c7a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.3986599 Nov 24 04:09:07.937185 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:07.945515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.951843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.962016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.983254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c032a01-019c-4c62-9816-dccd1110472a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:07.988367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63acb347-3956-42c1-8437-7d0dae349adc x-openstack-request-id: req-63acb347-3956-42c1-8437-7d0dae349adc {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:07.988747 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "name": "network-vif-plugged", "status": "completed", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:07.989152 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-63acb347-3956-42c1-8437-7d0dae349adc {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:07.989705 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'code': 200} Nov 24 04:09:08.026172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:08.126853 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] create failed (client error): The resource could not be found. Nov 24 04:09:08.133005 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-96a95afd-2864-4b1f-b217-abca346608b7 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 4.4160731 Nov 24 04:09:08.147947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57596) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:08.158587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Deleting port 635ac3a1-f204-43c1-90f2-cf907c37b244 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:08.158933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.221237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.267240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.316145 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1451a324-1a7a-4eda-8dec-3aae64c20760 req-3e2da97e-cb38-42a0-b475-a0ad3eb7369d tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3897953 Nov 24 04:09:08.339937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] For port 635ac3a1-f204-43c1-90f2-cf907c37b244, host hv-neutron-8190, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:08.340520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.343079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bcbc9ecc-7c0d-4999-aaf4-951f79cd15db None None] Could not find standard attr ID for object f5fbb2af-1b51-4f92-bf9b-e85189a935a3. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:09:08.361759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=f5fbb2af-1b51-4f92-bf9b-e85189a935a3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:08.380625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Calling delete_port for 635ac3a1-f204-43c1-90f2-cf907c37b244 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:08.386404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea5492d-f5e1-42ff-b93c-e1dd825d272b req-0223e736-c73d-4fa1-b2d0-17a0d52621d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:08.388058 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5ea5492d-f5e1-42ff-b93c-e1dd825d272b req-0223e736-c73d-4fa1-b2d0-17a0d52621d7 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 1098 time: 0.1965122 Nov 24 04:09:08.393864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.397106 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-db229ef3-5032-4e18-be49-a188681236e8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/f5fbb2af-1b51-4f92-bf9b-e85189a935a3 HTTP/1.1" status: 204 len: 168 time: 1.9292140 Nov 24 04:09:08.401293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57608) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:08.478700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Deleting port cc1c45ae-3dee-42dd-bf99-5c294229a3b2 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:08.479361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.519519 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5ea5492d-f5e1-42ff-b93c-e1dd825d272b req-6f966f4f-57f4-40dc-bb50-26de1fa76d13 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1212993 Nov 24 04:09:08.535404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7fe0c5f-c464-4d24-92ca-9e1319ea3cf2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:08.537169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7fe0c5f-c464-4d24-92ca-9e1319ea3cf2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:08.539333 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f7fe0c5f-c464-4d24-92ca-9e1319ea3cf2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1327701 Nov 24 04:09:08.541844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57612) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:08.581306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636f0fc5-e98d-466f-b76a-c7ca3d604f80 req-95f218ca-7cc2-4a5f-b354-42cecafedbe6 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:08.582858 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-636f0fc5-e98d-466f-b76a-c7ca3d604f80 req-95f218ca-7cc2-4a5f-b354-42cecafedbe6 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.2708023 Nov 24 04:09:08.637669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Deleting port be44ef90-0520-4a24-a3bf-4833265bd1f0 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:08.638917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.679585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 329c7013-0e17-418d-9fba-82bf48ba3022 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:08.704156 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 99e8a855-2923-4474-9465-b5f9427a8d4d {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:08.719813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.732523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.755851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.775780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Calling delete_port for cc1c45ae-3dee-42dd-bf99-5c294229a3b2 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:08.788955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 329c7013-0e17-418d-9fba-82bf48ba3022 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:08.789697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.822905 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.869437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:08.902868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57620) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:08.920960 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-636f0fc5-e98d-466f-b76a-c7ca3d604f80 req-dc2ba3b8-e3e9-4829-ba43-8ee0109bc7f5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3227069 Nov 24 04:09:08.979481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event deleted for resources: {'Port': ['ID=635ac3a1-f204-43c1-90f2-cf907c37b244,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:09.008249 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.011536 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2d7d0d1d-5a3a-4548-80ea-53109a0d4438 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "DELETE /v2.0/ports/635ac3a1-f204-43c1-90f2-cf907c37b244 HTTP/1.1" status: 204 len: 168 time: 1.2107069 Nov 24 04:09:09.014601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57624) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:09.023428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:09:09.026471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.090424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Calling delete_port for be44ef90-0520-4a24-a3bf-4833265bd1f0 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:09.095721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-1006307436'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:09.147069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.178925 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.222509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:09.225966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.245761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.321761 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b6ae7ce-0af9-4ffd-9caa-e2d47e0bd566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:09:09.323191 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3b6ae7ce-0af9-4ffd-9caa-e2d47e0bd566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "GET /v2.0/ports/635ac3a1-f204-43c1-90f2-cf907c37b244 HTTP/1.1" status: 404 len: 333 time: 0.3077047 Nov 24 04:09:09.328879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:09.331700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.338125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Request body: {'port': {'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-936220215'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:09.350971 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Floating IP f8759b33-13ee-48c5-86ee-0deed077238c associated. External IP: 172.26.5.167, port: bd0cfc7f-154f-4dba-bb4b-86d1245efb06. Nov 24 04:09:09.446573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Made reservation on behalf of 728830d7da834543a5a2d2274585166f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:09.452763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.506270 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port b3af66b8-2e16-4ead-8438-5163397b698f yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:09.510447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.552732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.601074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event deleted for resources: {'Port': ['ID=cc1c45ae-3dee-42dd-bf99-5c294229a3b2,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:09.635939 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2409de1b-6222-4d0d-9f3a-cb263dcc0504 req-90484803-d28d-4f6d-8071-81d6171b263c tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:09.637425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2409de1b-6222-4d0d-9f3a-cb263dcc0504 req-90484803-d28d-4f6d-8071-81d6171b263c tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.2286363 Nov 24 04:09:09.656181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=99e8a855-2923-4474-9465-b5f9427a8d4d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:09.665143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.668271 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3b15fc1-154e-447c-8e70-3e8bf9959f8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/99e8a855-2923-4474-9465-b5f9427a8d4d HTTP/1.1" status: 204 len: 168 time: 1.1253593 Nov 24 04:09:09.672179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57630) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:09.676615 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb1943a8-36b0-4d29-b965-fb9ac40634f8 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:09.730563 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a01678de-90c2-4505-b68d-f75d18eb4661 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0571172 Nov 24 04:09:09.733752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57632) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:09.785198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.809097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.820201 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2409de1b-6222-4d0d-9f3a-cb263dcc0504 req-bcf0b856-2c4a-491e-8258-e4e9cef07468 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1600776 Nov 24 04:09:09.835018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Port': ['ID=be44ef90-0520-4a24-a3bf-4833265bd1f0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:09.840148 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.865484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.927963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:09.931874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] vlan segment allocate from pool success with {'vlan_id': 169, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:09.947271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a9fcfe6a-d533-484b-be97-7f629d915a44,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:09.996867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:09.997232 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Added segment 612ae7b6-3eea-4071-bb84-a200e62ebe64 of type vlan for network 0239996c-49f7-4388-9488-06dcd5d10c2c Nov 24 04:09:10.020692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.024459 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-14c7bc64-eb55-4e91-84b9-33bbaddb95fa tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "DELETE /v2.0/ports/be44ef90-0520-4a24-a3bf-4833265bd1f0 HTTP/1.1" status: 204 len: 168 time: 1.8750930 Nov 24 04:09:10.030207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:10.045163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57636) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.045990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52731f2c-56cb-4dc5-9c74-c3cd3a1118fa" -d '{"events": [{"server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "name": "network-vif-plugged", "status": "completed", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:10.088678 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.101594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.103651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] Deleting port 329c7013-0e17-418d-9fba-82bf48ba3022 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:10.104038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.116512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.120139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.168458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac9a3a12-e143-4b3d-b610-fee0171764d5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.173271 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ac9a3a12-e143-4b3d-b610-fee0171764d5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.4361625 Nov 24 04:09:10.174949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57640) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.189000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.196294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.196294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.211033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] For port 329c7013-0e17-418d-9fba-82bf48ba3022, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=329c7013-0e17-418d-9fba-82bf48ba3022,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:10.211446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.225372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.230925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] Calling delete_port for 329c7013-0e17-418d-9fba-82bf48ba3022 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:10.231422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Router 3d0d90ae-c638-4277-9998-3fafd099dea4 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:10.247928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19648665-a83b-4a0c-8503-1f383003a0de tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.249382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-19648665-a83b-4a0c-8503-1f383003a0de tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "GET /v2.0/ports?device_id=6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c HTTP/1.1" status: 200 len: 913 time: 0.1864481 Nov 24 04:09:10.253420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57642) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.254212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.254784 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a2f11b-0dd3-4c73-ac9c-36248d79e2d9 req-aa470767-74b4-4001-a0ab-fafc80b91233 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.254978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Fanout notify agent at l3_agent the message router_deleted on router 3d7560cf-46f6-4f4f-ac2f-a48f0342f627 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:10.256386 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-83a2f11b-0dd3-4c73-ac9c-36248d79e2d9 req-aa470767-74b4-4001-a0ab-fafc80b91233 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.2062492 Nov 24 04:09:10.262742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.264402 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-020ecc27-dbcc-4a4a-a404-4a1089a4b60f tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/3d7560cf-46f6-4f4f-ac2f-a48f0342f627 HTTP/1.1" status: 204 len: 168 time: 2.9610534 Nov 24 04:09:10.276648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57644) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.295451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1121178664', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': False}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:10.305629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99e85d4b-1bfd-4ef8-ba84-fa7f7e0f8597 x-openstack-request-id: req-99e85d4b-1bfd-4ef8-ba84-fa7f7e0f8597 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:10.305950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "name": "network-vif-plugged", "status": "completed", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:10.306309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-99e85d4b-1bfd-4ef8-ba84-fa7f7e0f8597 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:10.306773 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'code': 200} Nov 24 04:09:10.351182 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.360651 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 1.4550624 Nov 24 04:09:10.370006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57646) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.374268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb86e45f-6700-4637-a059-21a5ebcea068 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.375761 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eb86e45f-6700-4637-a059-21a5ebcea068 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2008379 Nov 24 04:09:10.379470 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd9babf9-8ece-4a35-af74-fbf00ff024ae tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Network': ['ID=0239996c-49f7-4388-9488-06dcd5d10c2c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:10.380522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] Pushing event deleted for resources: {'Port': ['ID=329c7013-0e17-418d-9fba-82bf48ba3022,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:10.382052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'subnet': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:10.383295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57648) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.383983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84597c71-279d-44d3-aac3-aa4145347080 None None] No DVR routers for this DVR port 329c7013-0e17-418d-9fba-82bf48ba3022 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:10.411574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 0239996c-49f7-4388-9488-06dcd5d10c2c details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:10.475000 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ae3562d9-a96f-477d-a5ee-8737d024b392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0848641 Nov 24 04:09:10.477526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57650) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.477648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.477648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.494659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:10.541303 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-83a2f11b-0dd3-4c73-ac9c-36248d79e2d9 req-3b9496d3-1d04-4bd5-8391-3f28ffc96211 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2539330 Nov 24 04:09:10.542275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff57242d-a3fe-4b16-908b-084ea927ce67 req-6fdf2d1d-b5b4-45bc-b332-4c71d857349c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.543768 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ff57242d-a3fe-4b16-908b-084ea927ce67 req-6fdf2d1d-b5b4-45bc-b332-4c71d857349c service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 1099 time: 0.2301047 Nov 24 04:09:10.604108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.606248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.637787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 329c7013-0e17-418d-9fba-82bf48ba3022 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:10.650097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:10.665125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] Sync routers for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:10.667434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 329c7013-0e17-418d-9fba-82bf48ba3022 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:10.667780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 329c7013-0e17-418d-9fba-82bf48ba3022 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:10.677624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:10.678319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:10.691860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.723826 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0bf35225-7512-456f-a792-efa4fb5e6234 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "PUT /v2.0/floatingips/f8759b33-13ee-48c5-86ee-0deed077238c HTTP/1.1" status: 200 len: 991 time: 2.8884578 Nov 24 04:09:10.725985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:10.728413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-109f98f3-e20a-4cd6-9ff3-94696722d3cc" -d '{"events": [{"name": "network-changed", "server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:10.762080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Network 1696a733-a969-453a-b9f6-904c0b76edc6 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:10.775149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:10.796936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=b3af66b8-2e16-4ead-8438-5163397b698f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:10.801295 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ff57242d-a3fe-4b16-908b-084ea927ce67 req-09417744-7ae6-46f8-85b6-17eccfbf84c9 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2141390 Nov 24 04:09:10.804066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:10.804984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:10.805579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.810568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:10.813938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.826933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.836857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76766b35-72f5-4fb2-baca-391a30401266 x-openstack-request-id: req-76766b35-72f5-4fb2-baca-391a30401266 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:10.837446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:10.837754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-76766b35-72f5-4fb2-baca-391a30401266 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:10.838283 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'status': 'completed', 'code': 200} Nov 24 04:09:10.876623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:10.882050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.906625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:10.910493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:10.940182 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-38338b3f-08f8-448a-b723-edac626634ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.6101747 Nov 24 04:09:10.947160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57660) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:10.957344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8190'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:11.071838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5726d1a1-4073-4afd-9165-a50f01d449ea req-8cc39535-33e8-4ace-8175-e1cd795e4bbe tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:11.074133 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-5726d1a1-4073-4afd-9165-a50f01d449ea req-8cc39535-33e8-4ace-8175-e1cd795e4bbe tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.1250823 Nov 24 04:09:11.075525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.184891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-e5a0b9db-fd81-4dc5-9119-892839052720 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:11.187185 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-e5a0b9db-fd81-4dc5-9119-892839052720 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.1546748 Nov 24 04:09:11.266860 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-5726d1a1-4073-4afd-9165-a50f01d449ea req-d6e06175-d80c-4683-b6f8-f0cf6de831a2 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1467416 Nov 24 04:09:11.298872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.330426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.335505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f8759b33-13ee-48c5-86ee-0deed077238c', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'floating_ip_address': '172.26.5.167', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'port_id': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 152, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'mac_address': 'fa:16:3e:b4:1c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:31Z', 'updated_at': '2021-11-24T04:09:08Z', 'revision_number': 1, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:28Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:11.371602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] Checking router: 3d0d90ae-c638-4277-9998-3fafd099dea4 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:11.381156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:11.381759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:11.435259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.496941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:11.507634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port b3af66b8-2e16-4ead-8438-5163397b698f yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:11.522283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.534729 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Allocated IP 172.26.5.201 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/56b27434-6331-4d82-8599-fc31a6e615f0) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:11.536823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.584873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.597521 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-8ff28c7d-1a8f-47e2-a049-ca78fc6f59a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:11.599028 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-8ff28c7d-1a8f-47e2-a049-ca78fc6f59a4 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.3956788 Nov 24 04:09:11.614784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.623736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae19d7b5-51df-473a-b41a-9536557a5fae req-fe1948fc-9850-4840-b051-573e64a8d1ba tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:11.625210 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ae19d7b5-51df-473a-b41a-9536557a5fae req-fe1948fc-9850-4840-b051-573e64a8d1ba tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.2640085 Nov 24 04:09:11.634348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Subnet': ['ID=61d2ee7d-2547-416e-acbd-1eae08042687,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:11.638650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57666) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:11.666260 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Request body: {'floatingip': {'port_id': '42e80f9b-33db-4c7f-85ba-50908c286ec3'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:11.720284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=b3af66b8-2e16-4ead-8438-5163397b698f,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:11.763669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:11.764015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:11.764353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:11.771858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.772762 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.773325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.773633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.774010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.774383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.774724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.775064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.775454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.775974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.776331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.776661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:11.782007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.818673 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f8759b33-13ee-48c5-86ee-0deed077238c', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'floating_ip_address': '172.26.5.167', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'port_id': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 152, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'mac_address': 'fa:16:3e:b4:1c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:31Z', 'updated_at': '2021-11-24T04:09:08Z', 'revision_number': 1, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:28Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:11.820861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:11.821197 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:11.827862 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 2 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:11.865625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-417cc243-ad82-4c8c-9b02-556d9fe003e2 None None] The sync data for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv is: [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f8759b33-13ee-48c5-86ee-0deed077238c', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'floating_ip_address': '172.26.5.167', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'port_id': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 152, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'mac_address': 'fa:16:3e:b4:1c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:31Z', 'updated_at': '2021-11-24T04:09:08Z', 'revision_number': 1, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:28Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:11.906597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acb31fc-2ee9-48a8-833b-d7511aa3bfdb req-33aa9f30-3068-4493-8a43-0f2a99f9d876 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:11.908243 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1acb31fc-2ee9-48a8-833b-d7511aa3bfdb req-33aa9f30-3068-4493-8a43-0f2a99f9d876 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.2803802 Nov 24 04:09:11.908996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:11.909336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:11.909678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:11.959149 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:11.959477 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:11.962456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:11.971634 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 3 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:12.016346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:12.016582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:12.016740 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:12.069791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:12.070780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:12.071118 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:12.077077 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 4 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:12.077845 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:12.090209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Checking segment: {'id': '612ae7b6-3eea-4071-bb84-a200e62ebe64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:12.090535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network hostable DHCP agents. Network: 0239996c-49f7-4388-9488-06dcd5d10c2c, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:12.093707 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1acb31fc-2ee9-48a8-833b-d7511aa3bfdb req-f654f2aa-f9b3-4ae0-8002-dacfc181a0ed tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1581950 Nov 24 04:09:12.095951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:12.096193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f164f11-94ca-4b50-9c88-65078932dccc None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:12.096552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.142860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.158142 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.6816547 Nov 24 04:09:12.165037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57670) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:12.180421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:12.180989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:12.181494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:12.186371 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '82492f48-3952-4ecb-baca-5397eaa51eb6', 'ip_address': '2001:db8::df:26d9:1c76:f7ff'}], 'name': 'tempest-NetworksTestDHCPv6-806121165'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:12.187358 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa7e0a38-d8d0-4c5b-9ed0-f4588eced65b None None] New status for floating IP f8759b33-13ee-48c5-86ee-0deed077238c: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:09:12.195067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:12.195638 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:12.200235 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 5 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:12.208214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.252919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:12.253257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:12.253597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:12.280590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:12.310418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:12.312530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:12.312879 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:12.320765 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 6 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:12.323799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:12.336194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 0239996c-49f7-4388-9488-06dcd5d10c2c) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:12.336496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:12.337688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:12.338818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Port': ['ID=56b27434-6331-4d82-8599-fc31a6e615f0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:12.339828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '82492f48-3952-4ecb-baca-5397eaa51eb6'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:12.349930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.367766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:12.368377 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:12.368766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:12.369066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:12.369656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.384660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=82492f48-3952-4ecb-baca-5397eaa51eb6,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:12.390294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d1a1008-6475-415f-9786-559ec3a2cdb9 None None] Network 0239996c-49f7-4388-9488-06dcd5d10c2c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:12.401157 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.401508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.401851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.402203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.402539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.402872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.403198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.403523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.403881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.404207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.404539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.404847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ce4221e-bd2c-419c-b321-b341b27d8ec7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:12.410671 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4edd2104-7bb5-43b0-9d77-89649fd4f09e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0386295 Nov 24 04:09:12.412433 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-2ee1dca8-3d9a-4333-9fa9-83e4877ecaca service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 999 time: 0.7847385 Nov 24 04:09:12.415434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57672) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:12.423083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1677545608'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:12.427737 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:12.428083 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:12.433400 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 7 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:12.609788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-75fbf87b-7dcc-45db-ae90-ef9730b16ac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:12.611187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-75fbf87b-7dcc-45db-ae90-ef9730b16ac5 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.1677029 Nov 24 04:09:12.630964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.672949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/82492f48-3952-4ecb-baca-5397eaa51eb6/339e31ba-2296-4616-a49a-ec0beaf78314) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:12.695607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port bc4b029e-005d-4daa-a79d-f8abe6be3931 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:12.704803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-0239996c-49f7-4388-9488-06dcd5d10c2c', 'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'tenant_id': 'd10ac043d90d4ae1a587a0fe1fc513d3', 'fixed_ips': [{'subnet_id': '61d2ee7d-2547-416e-acbd-1eae08042687'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:12.705329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.769399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-de92302d-2bfd-4626-b528-0dc1d6c83acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:12.770962 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-de92302d-2bfd-4626-b528-0dc1d6c83acf service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1493020 Nov 24 04:09:12.946660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Allocated IP 2001:db8::2 (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/00c2ffe4-6ef6-41ba-b428-ca62c6002237) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:12.949061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:12.959927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.014302 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-df820b38-1ea4-44c0-8680-edb35b586892 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2224450 Nov 24 04:09:13.016735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:13.019740 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:13.020229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:13.020429 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:13.022077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:13.034079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::df:26d9:1c76:f7ff (a2b36c78-43a6-4954-8102-cb5638999bb1/82492f48-3952-4ecb-baca-5397eaa51eb6/bc4b029e-005d-4daa-a79d-f8abe6be3931) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:13.035829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:13.048203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Deleting port 2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:13.048518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.051663 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Pushing event updated for resources: {'Port': ['ID=339e31ba-2296-4616-a49a-ec0beaf78314,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:13.067544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:13.067937 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:13.072568 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 8 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:13.112621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:13.116141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.125109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.125503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.126009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.126393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.127042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.127042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.127387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.127724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.128791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.128791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.128791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.129132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:13.148220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Attempting to bind port 339e31ba-2296-4616-a49a-ec0beaf78314 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:13.148934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Attempting to bind port 339e31ba-2296-4616-a49a-ec0beaf78314 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:13.149071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Attempting to bind port 339e31ba-2296-4616-a49a-ec0beaf78314 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:13.156895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:13.157235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:13.157347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:13.157585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:13.157684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:13.158038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.158471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:13.159069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Bound port: 339e31ba-2296-4616-a49a-ec0beaf78314, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:13.159329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.248292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] device_id is not set on port c79bb64a-88fe-43e0-a289-45f4c0fba33b yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:13.256372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:13.257039 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:13.258264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.269455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-109f98f3-e20a-4cd6-9ff3-94696722d3cc req-8425aa1a-3d41-4de2-b9e7-ac2a433d1a5a service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2366507 Nov 24 04:09:13.271393 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 9 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:13.291642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.293661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] For port 339e31ba-2296-4616-a49a-ec0beaf78314, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:13.297901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] For port 339e31ba-2296-4616-a49a-ec0beaf78314, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=339e31ba-2296-4616-a49a-ec0beaf78314,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:13.304225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.308441 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.312833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Calling delete_port for 2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:13.385048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:13.386581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Pushing event updated for resources: {'Port': ['ID=00c2ffe4-6ef6-41ba-b428-ca62c6002237,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:13.390513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:13.395628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:13.408794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.435925 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.441152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:13.441621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:13.442089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:13.457088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.470625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:13.470625 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:13.491355 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 10 to bind port b3af66b8-2e16-4ead-8438-5163397b698f Nov 24 04:09:13.500947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Attempting to bind port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:13.501143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Attempting to bind port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '612ae7b6-3eea-4071-bb84-a200e62ebe64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:13.501542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Attempting to bind port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 on network 0239996c-49f7-4388-9488-06dcd5d10c2c {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:13.518928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d1274a9-2430-43c2-9d8d-f51f6b32a348 None None] Pushing event updated for resources: {'Port': ['ID=339e31ba-2296-4616-a49a-ec0beaf78314,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:13.523851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:13.524488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Checking segment: {'id': '612ae7b6-3eea-4071-bb84-a200e62ebe64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:13.525111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.527134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Bound using segment: {'id': '612ae7b6-3eea-4071-bb84-a200e62ebe64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:13.527787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Bound port: 00c2ffe4-6ef6-41ba-b428-ca62c6002237, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '612ae7b6-3eea-4071-bb84-a200e62ebe64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:13.528482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.569725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.632530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] For port 00c2ffe4-6ef6-41ba-b428-ca62c6002237, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:13.636489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] For port 00c2ffe4-6ef6-41ba-b428-ca62c6002237, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=00c2ffe4-6ef6-41ba-b428-ca62c6002237,segment=NetworkSegment(612ae7b6-3eea-4071-bb84-a200e62ebe64),segment_id=612ae7b6-3eea-4071-bb84-a200e62ebe64)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:13.639315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:13.639661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:13.640011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:13.641577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.644267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.661331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b0b8b9-c1c9-4d23-8c40-158aec164e0f req-435b15b0-cb40-4c22-b961-037d9966940c tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:13.662920 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-68b0b8b9-c1c9-4d23-8c40-158aec164e0f req-435b15b0-cb40-4c22-b961-037d9966940c tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.3965476 Nov 24 04:09:13.673672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:13.674820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=bc4b029e-005d-4daa-a79d-f8abe6be3931,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:13.703822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:13.705986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Port': ['ID=2dc87ec0-0d76-4bf4-8ba4-ffbef8431dfa,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:13.719524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:13.720998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Allocated IP 2001:db8::252 (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/c79bb64a-88fe-43e0-a289-45f4c0fba33b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:13.725404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:13.726184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.727143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:13.727486 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port b3af66b8-2e16-4ead-8438-5163397b698f on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:13.727857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.754104 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8562f4f3-0fdb-4fef-8a79-54b251d427f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 945 time: 1.5726209 Nov 24 04:09:13.758706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1fec1f-8b7a-49a7-b5e5-1bbba7f2474b None None] Pushing event updated for resources: {'Port': ['ID=00c2ffe4-6ef6-41ba-b428-ca62c6002237,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:13.774459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57680) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:13.788314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '82492f48-3952-4ecb-baca-5397eaa51eb6', 'ip_address': '2001:db8::df:26d9:1c76:f7ff'}], 'name': 'tempest-NetworksTestDHCPv6-2124041230'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:13.803208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:13.969660 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-68b0b8b9-c1c9-4d23-8c40-158aec164e0f req-463132e3-933a-4885-8460-225561ef4494 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2477384 Nov 24 04:09:14.014868 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Floating IP 02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c associated. External IP: 172.26.5.125, port: 42e80f9b-33db-4c7f-85ba-50908c286ec3. Nov 24 04:09:14.035105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.152856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:14.156811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.167389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] For port b3af66b8-2e16-4ead-8438-5163397b698f, host hv-neutron-8190, cleared binding levels {{(pid=103380) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:14.167863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempted to set empty binding levels {{(pid=103380) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 04:09:14.187502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.210499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port dfb0ceb8-5578-460d-9ea8-2be8b39d2ac3 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:14.328876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] In _notify_port_updated(), no bound segment for port b3af66b8-2e16-4ead-8438-5163397b698f on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:09:14.329719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:14.330344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.334204 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "PUT /v2.0/ports/b3af66b8-2e16-4ead-8438-5163397b698f HTTP/1.1" status: 200 len: 980 time: 3.3812702 Nov 24 04:09:14.335235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03816ab4-5894-4d08-8562-d84db5842367 req-ff91a525-ad95-45f1-8996-001ce888dbb3 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:14.337115 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-03816ab4-5894-4d08-8562-d84db5842367 req-ff91a525-ad95-45f1-8996-001ce888dbb3 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.2268691 Nov 24 04:09:14.344639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57684) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:14.390501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57688) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:14.394897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Request body: {'floatingip': {'port_id': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:14.454584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Router 6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:14.492750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42ad294-d307-4929-a866-205f591d25c5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=b3af66b8-2e16-4ead-8438-5163397b698f,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:14.496826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.525954 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): There was a conflict when trying to complete your request. Nov 24 04:09:14.526504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:09:14.580750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.760957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 00c2ffe4-6ef6-41ba-b428-ca62c6002237 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:14.816480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7752578d-4c54-4b15-91d2-fd03b2fd7fd6 None None] Provisioning complete for port 339e31ba-2296-4616-a49a-ec0beaf78314 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:14.816850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7752578d-4c54-4b15-91d2-fd03b2fd7fd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.889750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:14.890387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.968201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:14.980028 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3dcd6198-801c-49db-abcb-7ce5ee80d218 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "PUT /v2.0/routers/6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7126765 Nov 24 04:09:14.980539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57692) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:14.988575 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-679272ed-80de-4624-9228-1c5000af7ad2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 409 len: 387 time: 1.2078502 Nov 24 04:09:14.990883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7752578d-4c54-4b15-91d2-fd03b2fd7fd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:14.995647 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57694) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:14.996073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] Sync routers for ids ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:15.023390 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] Routers {'6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:15.024030 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:15.076721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:15.114008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] It took 0.37 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:09:15.116817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.117397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.118264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.118789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.119885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.120411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.120922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.121432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.122904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.123041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.123488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.124457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.125888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.125888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.125888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.126696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.126974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.130900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.131117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7752578d-4c54-4b15-91d2-fd03b2fd7fd6 None None] For port 339e31ba-2296-4616-a49a-ec0beaf78314, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=339e31ba-2296-4616-a49a-ec0beaf78314,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:15.131851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.132093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.132346 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] Routers {'6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:15.132999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.133144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:15.133745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.134432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.135265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.135901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.136509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.142782 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7752578d-4c54-4b15-91d2-fd03b2fd7fd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.146695 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eb7015e2-2ed5-41fb-920a-9724a0d70d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 22412 time: 0.8011248 Nov 24 04:09:15.158901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57696) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:15.222381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8d000bc-400e-4f3d-8234-a56be150eb3c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.228480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8d000bc-400e-4f3d-8234-a56be150eb3c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.233504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f8d000bc-400e-4f3d-8234-a56be150eb3c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1682 time: 0.2285373 Nov 24 04:09:15.233504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57698) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:15.255271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.313574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7163e517-b467-481c-a62d-ebdf5c4af670 None None] Network 0239996c-49f7-4388-9488-06dcd5d10c2c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:15.336376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:15.337053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e76cbdd4-1872-498e-aa66-adfb935f41d2 None None] The sync data for ids ['6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:15.354625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.388960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.393780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.396656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.452637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.453463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Fanout notify agent at l3_agent the message router_deleted on router 6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:15.460357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-23e46ba7-7d05-4084-be1e-02431f1003a8 None None] Provisioning complete for port bc4b029e-005d-4daa-a79d-f8abe6be3931 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:15.460734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-23e46ba7-7d05-4084-be1e-02431f1003a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.463471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.464855 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b3b0931c-08d4-4aea-8752-805a3dafcb62 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "DELETE /v2.0/routers/6cfc7a4c-689e-4bb0-aa28-8bfa04b6112c HTTP/1.1" status: 204 len: 168 time: 0.4749525 Nov 24 04:09:15.468690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7752578d-4c54-4b15-91d2-fd03b2fd7fd6 None None] Pushing event updated for resources: {'Port': ['ID=339e31ba-2296-4616-a49a-ec0beaf78314,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:15.468823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57702) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:15.481306 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port bc4b029e-005d-4daa-a79d-f8abe6be3931 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:15.482304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.496590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 00c2ffe4-6ef6-41ba-b428-ca62c6002237, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=00c2ffe4-6ef6-41ba-b428-ca62c6002237,segment=NetworkSegment(612ae7b6-3eea-4071-bb84-a200e62ebe64),segment_id=612ae7b6-3eea-4071-bb84-a200e62ebe64)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:15.506072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Router 4f8aa7cd-415d-4905-bed0-488cc84270e3 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:15.512976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.513883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 339e31ba-2296-4616-a49a-ec0beaf78314 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:15.578398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Deleting subnet 36a855ec-1766-47fd-a2f1-cb38daa5cac1 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:15.585187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.592220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:15.605285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-23e46ba7-7d05-4084-be1e-02431f1003a8 None None] Port bc4b029e-005d-4daa-a79d-f8abe6be3931 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:15.616412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:15.641297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.648265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=c79bb64a-88fe-43e0-a289-45f4c0fba33b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:15.652365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.655480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=00c2ffe4-6ef6-41ba-b428-ca62c6002237,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:15.667884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-23e46ba7-7d05-4084-be1e-02431f1003a8 None None] Provisioning complete for port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:15.668223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-23e46ba7-7d05-4084-be1e-02431f1003a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.673560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:15.679704 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:15.680085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for bc4b029e-005d-4daa-a79d-f8abe6be3931 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:15.680329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.717839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 339e31ba-2296-4616-a49a-ec0beaf78314 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:15.718240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.784169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Deleting port b3af66b8-2e16-4ead-8438-5163397b698f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:15.784711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.797725 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d430023c-392b-498d-8695-fe63a6e1838e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 3.3809385 Nov 24 04:09:15.801907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57704) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:15.808177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-433335985', 'allowed_address_pairs': [{'ip_address': '2001:db8::252', 'mac_address': 'fa:16:3e:c0:6c:b2'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:15.812446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.953283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] For port b3af66b8-2e16-4ead-8438-5163397b698f, host hv-neutron-8190, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:15.953875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:15.970726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Router b539a212-0737-4c25-ac06-7e1008e8e3bc is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:15.987049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Calling delete_port for b3af66b8-2e16-4ead-8438-5163397b698f owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:15.999577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:16.010701 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] Sync routers for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:16.012520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.012964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.030672 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:16.031647 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:16.049263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.056277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Subnet': ['ID=36a855ec-1766-47fd-a2f1-cb38daa5cac1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:16.066789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.070715 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9495e7e3-3b6b-4b01-a14a-14eaa6d576a5 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "DELETE /v2.0/subnets/36a855ec-1766-47fd-a2f1-cb38daa5cac1 HTTP/1.1" status: 204 len: 168 time: 0.6009562 Nov 24 04:09:16.079884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a76253b-02fc-4d59-9087-bd8199f00b24 None None] Network 5d869497-2705-4cc2-b36d-4dea3a8792ca requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:16.081151 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57706) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:16.107244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=bc4b029e-005d-4daa-a79d-f8abe6be3931,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:16.136736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.142891 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-76a9356f-93be-4e7d-8479-856fc568efe7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/bc4b029e-005d-4daa-a79d-f8abe6be3931 HTTP/1.1" status: 204 len: 168 time: 0.9064403 Nov 24 04:09:16.142891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:16.146875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57708) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:16.153076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b919e81c-abaa-4c34-9b00-d5535c2b99d5 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "PUT /v2.0/floatingips/02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c HTTP/1.1" status: 200 len: 991 time: 4.4991782 Nov 24 04:09:16.168025 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:16.171394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac" -d '{"events": [{"name": "network-changed", "server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:16.246999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-174b141d-08a3-440d-aa35-d16d626eda59 x-openstack-request-id: req-174b141d-08a3-440d-aa35-d16d626eda59 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:16.247336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:16.247595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-174b141d-08a3-440d-aa35-d16d626eda59 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:16.247993 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'status': 'completed', 'code': 200} Nov 24 04:09:16.254750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] It took 0.21 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:09:16.313191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2f79f28b-a0f8-4e0d-abee-3d13a1d1b233 None None] Provisioning complete for port c79bb64a-88fe-43e0-a289-45f4c0fba33b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:16.313774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2f79f28b-a0f8-4e0d-abee-3d13a1d1b233 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.316054 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:16.376435 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-121e34c9-01c1-4ed4-88f0-01e98f2238a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:16.378783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-121e34c9-01c1-4ed4-88f0-01e98f2238a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:16.382866 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-121e34c9-01c1-4ed4-88f0-01e98f2238a8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2316573 Nov 24 04:09:16.391434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2f79f28b-a0f8-4e0d-abee-3d13a1d1b233 None None] Port c79bb64a-88fe-43e0-a289-45f4c0fba33b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:16.392645 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57714) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:16.421741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2f79f28b-a0f8-4e0d-abee-3d13a1d1b233 None None] Provisioning complete for port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:16.426821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2f79f28b-a0f8-4e0d-abee-3d13a1d1b233 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.494715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-c37289d7-34ff-4489-8a86-4308445098a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:16.496382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-c37289d7-34ff-4489-8a86-4308445098a8 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49&device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 1098 time: 0.2226000 Nov 24 04:09:16.500509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.534038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] DHCP port deletion for 5d869497-2705-4cc2-b36d-4dea3a8792ca request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:16.547326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.577311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.590474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.602223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] device_id is not set on port 53748457-6a28-4b5c-8fa7-6796ea04db73 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:16.609105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.610791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] Deleting port fa45325c-186b-458f-b38b-9b6163076cd2 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:16.611246 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.621931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 82492f48-3952-4ecb-baca-5397eaa51eb6 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:16.680915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.686782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:16.703578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] For port fa45325c-186b-458f-b38b-9b6163076cd2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fa45325c-186b-458f-b38b-9b6163076cd2,segment=NetworkSegment(618719f6-5c1e-4e4c-a80a-f0df7b7e1abe),segment_id=618719f6-5c1e-4e4c-a80a-f0df7b7e1abe)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:16.704604 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.727153 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] Calling delete_port for fa45325c-186b-458f-b38b-9b6163076cd2 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:16.759539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event deleted for resources: {'Port': ['ID=b3af66b8-2e16-4ead-8438-5163397b698f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:16.773276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.777042 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e8499f59-fa84-4617-b7bd-31aa35a17a06 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "DELETE /v2.0/ports/b3af66b8-2e16-4ead-8438-5163397b698f HTTP/1.1" status: 204 len: 168 time: 1.6161675 Nov 24 04:09:16.787766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57718) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:16.790361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Sync routers for ids ['b539a212-0737-4c25-ac06-7e1008e8e3bc'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:16.799656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 00c2ffe4-6ef6-41ba-b428-ca62c6002237 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:16.814101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.818365 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7d52056a-72e6-4a38-be08-351ebb30b155 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 908 time: 6.5280435 Nov 24 04:09:16.819154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57720) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:16.834342 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'floating_ip_address': '172.26.5.125', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'port_id': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 173, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'mac_address': 'fa:16:3e:b2:2d:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:36Z', 'updated_at': '2021-11-24T04:09:13Z', 'revision_number': 1, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:35Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:16.837111 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-bbb5cfdc-deef-457f-8761-7a723bb2f722 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:09:16.838654 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bbb5cfdc-deef-457f-8761-7a723bb2f722 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "GET /v2.0/ports/b3af66b8-2e16-4ead-8438-5163397b698f HTTP/1.1" status: 404 len: 333 time: 0.0477090 Nov 24 04:09:16.844663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.870430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57722) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:16.871345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Routers {'b539a212-0737-4c25-ac06-7e1008e8e3bc'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:16.871981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b539a212-0737-4c25-ac06-7e1008e8e3bc'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:16.878011 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] Checking router: 4f8aa7cd-415d-4905-bed0-488cc84270e3 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:16.887600 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-777674089', 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:16.889723 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:16.890382 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:16.908554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-38b1401e-0af6-40b7-a6ae-41e4924e45e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:16.910215 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-38b1401e-0af6-40b7-a6ae-41e4924e45e3 service neutron] 10.222.0.21 "GET /v2.0/networks?id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 HTTP/1.1" status: 200 len: 912 time: 0.3961296 Nov 24 04:09:16.920544 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Floating IP c8213094-8b2a-4d86-9a1d-aa88ab727763 associated. External IP: 172.26.5.8, port: a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b. Nov 24 04:09:16.987504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-47b79135-b169-4350-a14c-9d59a3be8729 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3 HTTP/1.1" status: 200 len: 999 time: 0.0656667 Nov 24 04:09:16.991912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Deleting port fa45325c-186b-458f-b38b-9b6163076cd2 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:16.992483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:16.993173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3cb95f0e-fefd-4590-8cad-5261c0d7f451 None None] Provisioning complete for port c79bb64a-88fe-43e0-a289-45f4c0fba33b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:16.993560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3cb95f0e-fefd-4590-8cad-5261c0d7f451 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.006505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.013777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Made reservation on behalf of 728830d7da834543a5a2d2274585166f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:17.016305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.067877 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:17.075184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Allocated IP 2001:db8::358 (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/53748457-6a28-4b5c-8fa7-6796ea04db73) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:17.114548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-f181afd6-1233-4e7d-ad33-c4d5d21e226c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:17.115008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] Pushing event deleted for resources: {'Port': ['ID=fa45325c-186b-458f-b38b-9b6163076cd2,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:17.117419 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-f181afd6-1233-4e7d-ad33-c4d5d21e226c service neutron] 10.222.0.21 "GET /v2.0/subnets?id=d6b900d5-6e1c-467d-a80c-b932fd4e77fd HTTP/1.1" status: 200 len: 850 time: 0.1203141 Nov 24 04:09:17.127879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.129705 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port bd303cdc-1f6f-4557-b40b-6f5bf214dc75 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:17.132372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:17.132797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.140822 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7e8e65b2-cdd1-41b9-85da-be6994c7d19d tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/b539a212-0737-4c25-ac06-7e1008e8e3bc HTTP/1.1" status: 200 len: 909 time: 0.3179643 Nov 24 04:09:17.141633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57724) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:17.159647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1121178664', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': True}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:17.163230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] For port fa45325c-186b-458f-b38b-9b6163076cd2, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:17.163760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.177720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f9bb184-30f9-4d21-92e7-f1e414369b8a None None] No DVR routers for this DVR port fa45325c-186b-458f-b38b-9b6163076cd2 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:17.193263 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3cb95f0e-fefd-4590-8cad-5261c0d7f451 None None] Port c79bb64a-88fe-43e0-a289-45f4c0fba33b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:17.218676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Set router b539a212-0737-4c25-ac06-7e1008e8e3bc gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:17.236199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Calling delete_port for fa45325c-186b-458f-b38b-9b6163076cd2 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:17.241041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Port fa45325c-186b-458f-b38b-9b6163076cd2 was not found and therefore no delete operation was performed {{(pid=103380) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:09:17.269661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-bfd15468-d1a5-47d8-a0e7-25351dd7e51f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:17.271476 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-bfd15468-d1a5-47d8-a0e7-25351dd7e51f service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1372697 Nov 24 04:09:17.354938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.443376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 339e31ba-2296-4616-a49a-ec0beaf78314 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:17.445267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.448733 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/82492f48-3952-4ecb-baca-5397eaa51eb6 HTTP/1.1" status: 204 len: 168 time: 1.0548170 Nov 24 04:09:17.449724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7048b322-6e8f-4ec5-9033-c62f2f695d18 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=82492f48-3952-4ecb-baca-5397eaa51eb6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:17.453191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57728) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:17.483693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51ff7ae0-4419-420e-997b-07fbed13a598 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:17.517743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c0300022-741b-4b2a-8926-7147832832e2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0553870 Nov 24 04:09:17.518977 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'floating_ip_address': '172.26.5.125', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'port_id': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 173, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'mac_address': 'fa:16:3e:b2:2d:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:36Z', 'updated_at': '2021-11-24T04:09:13Z', 'revision_number': 1, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:35Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:17.523105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57730) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:17.530175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:17.563810 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7aaceb0e-8e26-459e-b9ba-1cf826e734c9 None None] The sync data for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv is: [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'floating_ip_address': '172.26.5.125', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'port_id': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 173, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'mac_address': 'fa:16:3e:b2:2d:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:36Z', 'updated_at': '2021-11-24T04:09:13Z', 'revision_number': 1, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:35Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:17.623101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.666923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.667978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.677313 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Port': ['ID=fa45325c-186b-458f-b38b-9b6163076cd2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:17.679708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] No DVR routers for this DVR port fa45325c-186b-458f-b38b-9b6163076cd2 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:17.815873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b539a212-0737-4c25-ac06-7e1008e8e3bc', 'name': 'tempest-snat-router-1121178664', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.201'}], 'enable_snat': False}, 'gw_port_id': '56b27434-6331-4d82-8599-fc31a6e615f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:10Z', 'updated_at': '2021-11-24T04:09:13Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '56b27434-6331-4d82-8599-fc31a6e615f0', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:97:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b539a212-0737-4c25-ac06-7e1008e8e3bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 259, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:11Z', 'updated_at': '2021-11-24T04:09:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:17.849157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Checking router: b539a212-0737-4c25-ac06-7e1008e8e3bc for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:17.849421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Updating router b539a212-0737-4c25-ac06-7e1008e8e3bc port 56b27434-6331-4d82-8599-fc31a6e615f0 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:09:17.851374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 339e31ba-2296-4616-a49a-ec0beaf78314 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:17.851741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.873491 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5ef3e5d-0d90-403b-a15e-ebeb7bb4237b None None] New status for floating IP 02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:09:17.899879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:17.981459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.007702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.010584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.025978 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-117a81bf-114f-4d36-b0e5-6fc1c9b65232 service neutron] 10.222.0.21 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7403738 Nov 24 04:09:18.031917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.137657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5d869497-2705-4cc2-b36d-4dea3a8792ca']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:18.152635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:18.158264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Router 8f58b51f-193c-43f1-ae94-d69a879a0453 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:18.167530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:18.167828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '618719f6-5c1e-4e4c-a80a-f0df7b7e1abe') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:18.171660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.172797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:18.173528 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:18.176979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.213773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:18.220771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.272972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:18.276270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.281481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.282215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.285692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] Deleting port 339e31ba-2296-4616-a49a-ec0beaf78314 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:18.285692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.297816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=53748457-6a28-4b5c-8fa7-6796ea04db73,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:18.322932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.332337 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-df689656-a3d6-471c-9547-ce4f1b7fcfd4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 2.5256746 Nov 24 04:09:18.341775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57734) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:18.354187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Releasing vlan 199 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:18.354187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:18.356435 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:18.388965 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d3e254a-dbf3-49c8-b2e2-bb7980f1acac req-57a549d4-5d89-4cb5-bf3d-77ac2d5d7d8d service neutron] 10.222.0.21 "GET /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3259161 Nov 24 04:09:18.427137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] For port 339e31ba-2296-4616-a49a-ec0beaf78314, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=339e31ba-2296-4616-a49a-ec0beaf78314,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:18.427899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.442766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] Calling delete_port for 339e31ba-2296-4616-a49a-ec0beaf78314 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:18.456743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-976129b3-c7a1-4541-a383-e44ecceb3d69 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.457586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fa45325c-186b-458f-b38b-9b6163076cd2 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:18.466355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-976129b3-c7a1-4541-a383-e44ecceb3d69 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.472272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-976129b3-c7a1-4541-a383-e44ecceb3d69 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.473947 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-976129b3-c7a1-4541-a383-e44ecceb3d69 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2483 time: 0.1311948 Nov 24 04:09:18.478415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57738) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:18.517676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.520085 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fa45325c-186b-458f-b38b-9b6163076cd2 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:18.520484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fa45325c-186b-458f-b38b-9b6163076cd2 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:18.539662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.555450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.624223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea443ab-503f-44a4-926e-d10fb9eea371 None None] Pushing event updated for resources: {'Port': ['ID=56b27434-6331-4d82-8599-fc31a6e615f0,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:18.642965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.651632 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Attempting to bind port 56b27434-6331-4d82-8599-fc31a6e615f0 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:18.652028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Attempting to bind port 56b27434-6331-4d82-8599-fc31a6e615f0 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:18.652367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Attempting to bind port 56b27434-6331-4d82-8599-fc31a6e615f0 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:18.662913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:18.663305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:18.663716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.664104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:18.664581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Bound port: 56b27434-6331-4d82-8599-fc31a6e615f0, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:18.664960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.671701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Network 1696a733-a969-453a-b9f6-904c0b76edc6 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:18.679277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:18.682345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:18.683365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.684032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.690078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 339e31ba-2296-4616-a49a-ec0beaf78314 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:18.700946 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.706501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.710494 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] 10.222.0.48 "DELETE /v2.0/networks/5d869497-2705-4cc2-b36d-4dea3a8792ca HTTP/1.1" status: 204 len: 168 time: 2.5762529 Nov 24 04:09:18.715453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:18.720793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:18.724371 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.724930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.731465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.744044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862777da-1d45-4947-9915-c0477c00ff24 tempest-FloatingIPNegativeTestJSON-750788375 tempest-FloatingIPNegativeTestJSON-750788375-project] Pushing event deleted for resources: {'Network': ['ID=5d869497-2705-4cc2-b36d-4dea3a8792ca,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:18.760152 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.2343938 Nov 24 04:09:18.763480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c80140-de8c-479d-80dd-ab08fcf513e0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=20d6a246-7b1f-4b75-b499-168177411685,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:18.765772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57742) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:18.767468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=bd303cdc-1f6f-4557-b40b-6f5bf214dc75,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:18.769664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] No DVR routers for this DVR port 339e31ba-2296-4616-a49a-ec0beaf78314 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:18.780062 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5552367c-44b6-4868-b882-880da961dd70 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.9043922 Nov 24 04:09:18.783478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:18.786262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '20d6a246-7b1f-4b75-b499-168177411685', 'ip_address': '2001:db8:0:1::6'}], 'name': 'tempest-NetworksTestDHCPv6-1143437602'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:18.796182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57744) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:18.797726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.832612 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29e177d5-5c7f-44c9-a0c9-121dd07a118e None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:18.833069 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-116d7217-dd9c-4de4-ae0b-7e317188c1b4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "PUT /v2.0/floatingips/c8213094-8b2a-4d86-9a1d-aa88ab727763 HTTP/1.1" status: 200 len: 990 time: 4.4413953 Nov 24 04:09:18.834752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:09:18.837958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb" -d '{"events": [{"name": "network-changed", "server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:09:18.914399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port 53748457-6a28-4b5c-8fa7-6796ea04db73 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:18.915650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.932523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab51d4e8-4f14-4e58-b52c-c90c64f2c9f7 None None] Pushing event deleted for resources: {'Port': ['ID=339e31ba-2296-4616-a49a-ec0beaf78314,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:18.935995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] Sync routers for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:18.958686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:18.959608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:18.961578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-00c504a0-b339-43df-82bc-17909b2c114a None None] Provisioning complete for port 53748457-6a28-4b5c-8fa7-6796ea04db73 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:18.962180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00c504a0-b339-43df-82bc-17909b2c114a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:18.990274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bae90d1b-6191-48b6-ba4e-c614e0a82737 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:18.991580 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bae90d1b-6191-48b6-ba4e-c614e0a82737 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "GET /v2.0/ports/bd303cdc-1f6f-4557-b40b-6f5bf214dc75 HTTP/1.1" status: 200 len: 958 time: 0.1944535 Nov 24 04:09:19.005468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57752) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:19.008797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:09:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2cd2e41-4d71-498e-a87c-e020e65f6a11 x-openstack-request-id: req-b2cd2e41-4d71-498e-a87c-e020e65f6a11 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:09:19.009312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:09:19.009773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-b2cd2e41-4d71-498e-a87c-e020e65f6a11 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:09:19.010372 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'status': 'completed', 'code': 200} Nov 24 04:09:19.033977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.036218 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] For port 56b27434-6331-4d82-8599-fc31a6e615f0, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:19.057917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No active binding found for port 339e31ba-2296-4616-a49a-ec0beaf78314 {{(pid=103382) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 24 04:09:19.058378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 339e31ba-2296-4616-a49a-ec0beaf78314 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:19.059954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.098886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] For port 56b27434-6331-4d82-8599-fc31a6e615f0, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56b27434-6331-4d82-8599-fc31a6e615f0,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:19.156498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.182705 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Allocated IP 172.26.5.67 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/07d190e0-7eb7-4184-b297-248e467a72ea) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:19.192482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.199780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57756) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:19.200163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-00c504a0-b339-43df-82bc-17909b2c114a None None] Port 53748457-6a28-4b5c-8fa7-6796ea04db73 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:19.237088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea443ab-503f-44a4-926e-d10fb9eea371 None None] Pushing event updated for resources: {'Port': ['ID=56b27434-6331-4d82-8599-fc31a6e615f0,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:19.259485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:19.262304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:19.311684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Routers {'b539a212-0737-4c25-ac06-7e1008e8e3bc'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:19.312228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b539a212-0737-4c25-ac06-7e1008e8e3bc'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:19.320131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '20d6a246-7b1f-4b75-b499-168177411685'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:19.320982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.360213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.390790 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c6727f78-b837-44d3-b43b-672d4701ac28 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=d37a09eae8f64345857dfee0a8e964ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1891994 Nov 24 04:09:19.391040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for 53748457-6a28-4b5c-8fa7-6796ea04db73 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:19.394408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57760) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:19.414859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.420219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.450191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:19.454084 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:19.456657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:19.501254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-2a27c019-da2d-414a-8cfb-d49388dcc8aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:19.504074 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-2a27c019-da2d-414a-8cfb-d49388dcc8aa service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=ca64a4f493b349449d44be7e1d9fb98c&device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 1099 time: 0.3440640 Nov 24 04:09:19.510745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port eeba04a6-b434-4c5d-800f-955e6198d08b yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:19.511069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Port': ['ID=07d190e0-7eb7-4184-b297-248e467a72ea,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:19.672797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Deleting port bd303cdc-1f6f-4557-b40b-6f5bf214dc75 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:19.673366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.704038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-decd1e82-5eaa-4077-a4b8-e25bb11b0bd8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.720061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] Set router b539a212-0737-4c25-ac06-7e1008e8e3bc gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:19.781433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.815770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-decd1e82-5eaa-4077-a4b8-e25bb11b0bd8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.850906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:19.889505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Calling delete_port for bd303cdc-1f6f-4557-b40b-6f5bf214dc75 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:19.899386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-9b1226a7-4502-4cae-8413-4bae3333cfc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:19.900622 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-9b1226a7-4502-4cae-8413-4bae3333cfc4 service neutron] 10.222.0.21 "GET /v2.0/networks?id=9279fc65-0f7e-4ac5-8fda-e94ff426a487 HTTP/1.1" status: 200 len: 906 time: 0.3762112 Nov 24 04:09:19.912172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/20d6a246-7b1f-4b75-b499-168177411685/b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:20.029118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.042011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.100815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-decd1e82-5eaa-4077-a4b8-e25bb11b0bd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.103480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-decd1e82-5eaa-4077-a4b8-e25bb11b0bd8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.107587 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-decd1e82-5eaa-4077-a4b8-e25bb11b0bd8 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/e228570a-9e92-47dd-99b7-6170101f999e HTTP/1.1" status: 204 len: 168 time: 0.7093854 Nov 24 04:09:20.107587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=53748457-6a28-4b5c-8fa7-6796ea04db73,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:20.122900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'c8213094-8b2a-4d86-9a1d-aa88ab727763', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'floating_ip_address': '172.26.5.8', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'port_id': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 186, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'mac_address': 'fa:16:3e:6e:0c:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:39Z', 'updated_at': '2021-11-24T04:09:16Z', 'revision_number': 1, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:49Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:20.126495 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-b18b9acc-dd66-483b-bc48-fa5dfb0277fe service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b HTTP/1.1" status: 200 len: 998 time: 0.2164495 Nov 24 04:09:20.160080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-decd1e82-5eaa-4077-a4b8-e25bb11b0bd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e228570a-9e92-47dd-99b7-6170101f999e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:20.200961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] Checking router: 8f58b51f-193c-43f1-ae94-d69a879a0453 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:20.246518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b539a212-0737-4c25-ac06-7e1008e8e3bc', 'name': 'tempest-snat-router-1121178664', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.201'}], 'enable_snat': False}, 'gw_port_id': '56b27434-6331-4d82-8599-fc31a6e615f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:10Z', 'updated_at': '2021-11-24T04:09:13Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '56b27434-6331-4d82-8599-fc31a6e615f0', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:97:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b539a212-0737-4c25-ac06-7e1008e8e3bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 259, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:11Z', 'updated_at': '2021-11-24T04:09:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:20.253107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:20.253279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:20.255368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.284405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-45f151cf-e3a5-4e7e-8eee-6eec3c678d21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:20.285956 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-45f151cf-e3a5-4e7e-8eee-6eec3c678d21 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ac08ee4f-45d7-4c2e-ab90-055d80970c38 HTTP/1.1" status: 200 len: 844 time: 0.1270823 Nov 24 04:09:20.292508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Router 13f4d4db-7a4a-4a87-a15a-24d5493b0996 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:20.318966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.322111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91bf6ffd-13d3-408d-9b80-43a644abccb6 None None] The sync data for ids ['b539a212-0737-4c25-ac06-7e1008e8e3bc'] in dv-neutron-819049-1-hyperv is: [{'id': 'b539a212-0737-4c25-ac06-7e1008e8e3bc', 'name': 'tempest-snat-router-1121178664', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.201'}], 'enable_snat': False}, 'gw_port_id': '56b27434-6331-4d82-8599-fc31a6e615f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:10Z', 'updated_at': '2021-11-24T04:09:13Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '56b27434-6331-4d82-8599-fc31a6e615f0', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:97:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b539a212-0737-4c25-ac06-7e1008e8e3bc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 259, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:11Z', 'updated_at': '2021-11-24T04:09:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:20.326791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.338544 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:09:20.339042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:09:20.414763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.418217 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-82440274-ac31-432d-a25f-3d934afea112 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/ports/53748457-6a28-4b5c-8fa7-6796ea04db73 HTTP/1.1" status: 204 len: 168 time: 1.9389317 Nov 24 04:09:20.419836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event deleted for resources: {'Port': ['ID=bd303cdc-1f6f-4557-b40b-6f5bf214dc75,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:20.423712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57772) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.462368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.463035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:20.469251 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-53665b6c-04b1-4db0-a076-bbd891919ac0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "DELETE /v2.0/ports/bd303cdc-1f6f-4557-b40b-6f5bf214dc75 HTTP/1.1" status: 204 len: 168 time: 1.4573517 Nov 24 04:09:20.472978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:20.475819 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0e6fc3da-2953-4a44-9b61-f3ac34b9f54f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 1.6954017 Nov 24 04:09:20.476472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57774) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.476804 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57776) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.489202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:20.499347 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-fa74abfe-dae1-41fb-8bf2-f07b93ed4dc4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] GET failed (client error): The resource could not be found. Nov 24 04:09:20.502400 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fa74abfe-dae1-41fb-8bf2-f07b93ed4dc4 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "GET /v2.0/ports/53748457-6a28-4b5c-8fa7-6796ea04db73 HTTP/1.1" status: 404 len: 333 time: 0.0753944 Nov 24 04:09:20.502617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Pushing event updated for resources: {'Port': ['ID=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:20.517385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57778) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.536912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1204157683'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:20.563190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-f97f7afb-0362-4dc0-9a73-e3c0f078a2a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:20.564733 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-f97f7afb-0362-4dc0-9a73-e3c0f078a2a1 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=9279fc65-0f7e-4ac5-8fda-e94ff426a487&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2594023 Nov 24 04:09:20.566402 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-6a6ba31b-1ad4-4a49-b7b0-48245fde357a tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:09:20.568915 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a6ba31b-1ad4-4a49-b7b0-48245fde357a tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "GET /v2.0/ports/bd303cdc-1f6f-4557-b40b-6f5bf214dc75 HTTP/1.1" status: 404 len: 333 time: 0.0889223 Nov 24 04:09:20.574234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57782) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.580009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Request body: {'port': {'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-135432894'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:20.601190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Attempting to bind port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:20.603316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Attempting to bind port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:20.603765 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Attempting to bind port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:20.608807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:20.609335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:20.613266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:20.613747 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:20.614255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.614716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:20.615258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Bound port: b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:20.615712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.632087 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Sync routers for ids ['13f4d4db-7a4a-4a87-a15a-24d5493b0996'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:20.648593 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Routers {'13f4d4db-7a4a-4a87-a15a-24d5493b0996'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:20.649399 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['13f4d4db-7a4a-4a87-a15a-24d5493b0996'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:20.681511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d796bc6-013a-427b-883d-1b5899e5cadf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:20.683259 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9d796bc6-013a-427b-883d-1b5899e5cadf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.1949832 Nov 24 04:09:20.688938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57788) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.732984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.734277 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-410849ee-d0ec-4b37-a852-8dd549d19676 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 3.5834088 Nov 24 04:09:20.738425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57792) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:20.843815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Made reservation on behalf of 728830d7da834543a5a2d2274585166f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:20.846665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:20.877188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] For port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:20.923169 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Set router 13f4d4db-7a4a-4a87-a15a-24d5493b0996 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:20.958021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50a6821d-9203-4e46-9ea1-519309f05883 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:20.959708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50a6821d-9203-4e46-9ea1-519309f05883 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:20.961318 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-50a6821d-9203-4e46-9ea1-519309f05883 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2714353 Nov 24 04:09:20.962696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port 395a0155-2e2c-44d1-96cb-6092a540fd90 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:20.968376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57796) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:21.042055 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-9dd1b4c7-f1fd-42a4-aa11-2da81707ba5a service neutron] 10.222.0.21 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4668763 Nov 24 04:09:21.204144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] For port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:21.217430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.283000 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6d68b710-245a-4bc8-84bd-2dfdc0a54cfb req-1f4ba7d5-86fa-4786-8dba-cf61ce24386f service neutron] 10.222.0.21 "GET /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2243767 Nov 24 04:09:21.349072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ac64b3-3dd1-434e-b327-7cf9bd162771 None None] Pushing event updated for resources: {'Port': ['ID=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:21.377207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.378992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'c8213094-8b2a-4d86-9a1d-aa88ab727763', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'floating_ip_address': '172.26.5.8', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'port_id': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 186, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'mac_address': 'fa:16:3e:6e:0c:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:39Z', 'updated_at': '2021-11-24T04:09:16Z', 'revision_number': 1, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:49Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:21.424427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39053d08-a253-4f6b-a393-6223e68f1c3a None None] The sync data for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv is: [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'c8213094-8b2a-4d86-9a1d-aa88ab727763', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'floating_ip_address': '172.26.5.8', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'port_id': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 186, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'mac_address': 'fa:16:3e:6e:0c:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:08:39Z', 'updated_at': '2021-11-24T04:09:16Z', 'revision_number': 1, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:49Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:21.433832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.498991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Network 1696a733-a969-453a-b9f6-904c0b76edc6 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:21.507100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:21.524673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:21.529153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:21.529796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.539832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=395a0155-2e2c-44d1-96cb-6092a540fd90,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:21.577622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57810) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:21.593261 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13f4d4db-7a4a-4a87-a15a-24d5493b0996', 'name': 'tempest-snat-router-1121178664', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.67'}], 'enable_snat': True}, 'gw_port_id': '07d190e0-7eb7-4184-b297-248e467a72ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:17Z', 'updated_at': '2021-11-24T04:09:19Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '07d190e0-7eb7-4184-b297-248e467a72ea', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:d8:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13f4d4db-7a4a-4a87-a15a-24d5493b0996', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:19Z', 'updated_at': '2021-11-24T04:09:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:21.632317 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Checking router: 13f4d4db-7a4a-4a87-a15a-24d5493b0996 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:21.632929 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Updating router 13f4d4db-7a4a-4a87-a15a-24d5493b0996 port 07d190e0-7eb7-4184-b297-248e467a72ea binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:09:21.645910 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-815f34fe-2aa5-4641-b125-461d0ca938e1 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/13f4d4db-7a4a-4a87-a15a-24d5493b0996 HTTP/1.1" status: 200 len: 907 time: 0.9002783 Nov 24 04:09:21.660726 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ebde5b16-4e35-4ad2-96cc-5d34f627d3a7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.0818682 Nov 24 04:09:21.673955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57814) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:21.674825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57816) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:21.685336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:21.689447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 20d6a246-7b1f-4b75-b499-168177411685 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:21.692750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:21.696210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.699494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.718260 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.762035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] device_id is not set on port 7b26d217-8790-4ddb-aa1c-7aa3de804ed6 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:21.803677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.834105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1733003584'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:21.881967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:21.885425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:21.885979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b557ba3-ff47-4f02-9a2e-31b82b8e19a1 None None] New status for floating IP c8213094-8b2a-4d86-9a1d-aa88ab727763: ACTIVE {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:09:21.936565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.008668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.091491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Allocated IP 2001:db8::285 (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/7b26d217-8790-4ddb-aa1c-7aa3de804ed6) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:22.109454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.219013 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.221523 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.232506 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.266362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=20d6a246-7b1f-4b75-b499-168177411685,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:22.268405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.274592 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-40979dbb-23b7-4c13-b540-6f54eda3462b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/20d6a246-7b1f-4b75-b499-168177411685 HTTP/1.1" status: 204 len: 168 time: 1.3056710 Nov 24 04:09:22.277450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57824) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:22.299207 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Pushing event updated for resources: {'Port': ['ID=07d190e0-7eb7-4184-b297-248e467a72ea,revision_number=2']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:22.301687 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Attempting to bind port 07d190e0-7eb7-4184-b297-248e467a72ea on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:22.302063 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Attempting to bind port 07d190e0-7eb7-4184-b297-248e467a72ea by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:22.302451 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Attempting to bind port 07d190e0-7eb7-4184-b297-248e467a72ea on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:22.313757 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.314123 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.314649 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.314990 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.315326 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.315678 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.316009 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.316338 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.316685 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.317011 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.317334 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.317654 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:09:22.332183 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:22.332722 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:22.333128 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.333522 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:22.334002 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Bound port: 07d190e0-7eb7-4184-b297-248e467a72ea, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:22.334422 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.364369 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3e458cbb-813f-4766-a6cf-a1117b90fe5e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0847342 Nov 24 04:09:22.367288 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57826) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:22.372471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:22.402285 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] For port 07d190e0-7eb7-4184-b297-248e467a72ea, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:22.407748 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] For port 07d190e0-7eb7-4184-b297-248e467a72ea, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=07d190e0-7eb7-4184-b297-248e467a72ea,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:22.416451 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.479973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.482494 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Routers {'13f4d4db-7a4a-4a87-a15a-24d5493b0996'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:22.483123 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['13f4d4db-7a4a-4a87-a15a-24d5493b0996'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:22.524798 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9715341d-df3f-499f-91b1-cdb4058ee57c None None] Pushing event updated for resources: {'Port': ['ID=07d190e0-7eb7-4184-b297-248e467a72ea,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:22.585455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.618763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.623882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:22.628063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.644198 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] Set router 13f4d4db-7a4a-4a87-a15a-24d5493b0996 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:22.677200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:22.707397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:22.726885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:22.732910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:22.733686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.803399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:22.811566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=7b26d217-8790-4ddb-aa1c-7aa3de804ed6,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:22.817099 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d019f2b5-addc-45d3-9e1a-ec1743cd8fe9 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 2.2958548 Nov 24 04:09:22.826710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57828) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:22.843975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::252', 'mac_address': 'fa:16:3e:c0:6c:b2'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:22.930993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:22.931433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:22.992098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.018631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.026314 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13f4d4db-7a4a-4a87-a15a-24d5493b0996', 'name': 'tempest-snat-router-1121178664', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.67'}], 'enable_snat': True}, 'gw_port_id': '07d190e0-7eb7-4184-b297-248e467a72ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:17Z', 'updated_at': '2021-11-24T04:09:19Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '07d190e0-7eb7-4184-b297-248e467a72ea', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:d8:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13f4d4db-7a4a-4a87-a15a-24d5493b0996', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:19Z', 'updated_at': '2021-11-24T04:09:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:23.034597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38d367c9-8ee5-4865-8bb8-faafb05f5962 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:23.075348 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86d0c1f9-e3df-40fa-b66d-4beabae1bc1d None None] The sync data for ids ['13f4d4db-7a4a-4a87-a15a-24d5493b0996'] in dv-neutron-819049-1-hyperv is: [{'id': '13f4d4db-7a4a-4a87-a15a-24d5493b0996', 'name': 'tempest-snat-router-1121178664', 'tenant_id': 'cbb7c05c40054eb690b9e741395338ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.67'}], 'enable_snat': True}, 'gw_port_id': '07d190e0-7eb7-4184-b297-248e467a72ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:17Z', 'updated_at': '2021-11-24T04:09:19Z', 'revision_number': 3, 'project_id': 'cbb7c05c40054eb690b9e741395338ee', 'gw_port': {'id': '07d190e0-7eb7-4184-b297-248e467a72ea', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:d8:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13f4d4db-7a4a-4a87-a15a-24d5493b0996', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:19Z', 'updated_at': '2021-11-24T04:09:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:23.155472 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.164191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:23.176359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f1a44e7b-802f-4f89-b8d2-ab191f13eddb,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:23.196484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.196853 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment a10d4f6d-ed5d-43bb-8e18-aae4f2c75848 of type vlan for network 96924243-5b50-48fb-b900-d2dd42606c99 Nov 24 04:09:23.216556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] device_id is not set on port 395a0155-2e2c-44d1-96cb-6092a540fd90 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:23.250372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.257228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.268403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.269978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:23.279652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:23.281559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=2100e375-5f8f-4a0b-af60-5361c23739fd,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:23.284811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.288698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.290376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:23.293038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.363149 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-12d2128a-4a95-445f-9cf4-021e49c94798 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9943490 Nov 24 04:09:23.370078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-26a3888d-7840-4a39-93fd-ec4e8f88d2a1 None None] Provisioning complete for port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:23.370078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26a3888d-7840-4a39-93fd-ec4e8f88d2a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.372551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57832) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:23.382715 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:23.388701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=395a0155-2e2c-44d1-96cb-6092a540fd90,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:23.406598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.412954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:23.413616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.454214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.454214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.454214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.464035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.464035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.486394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.486751 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.490552 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 2 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.496123 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.9171374 Nov 24 04:09:23.543119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8e6f70-5393-4cf3-8d47-4139ec80a6d2 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=96924243-5b50-48fb-b900-d2dd42606c99,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:23.546062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.546423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.546758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.549537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Deleting port 07d190e0-7eb7-4184-b297-248e467a72ea {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:23.549875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.579183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.585650 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.589658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 96924243-5b50-48fb-b900-d2dd42606c99 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:23.599286 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 3 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.644389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.644726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.645060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.653067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.658055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.658702 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.660231 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 4 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.662724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.687000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.687332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.688175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.696880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] For port 07d190e0-7eb7-4184-b297-248e467a72ea, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=07d190e0-7eb7-4184-b297-248e467a72ea,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:23.697245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.698874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.700786 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.701114 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.705977 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 5 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.714130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.716613 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2566e780-5da0-4e00-8ac4-f664510211e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.3425751 Nov 24 04:09:23.717795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.719982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57838) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:23.722549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Calling delete_port for 07d190e0-7eb7-4184-b297-248e467a72ea owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:23.733049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.733379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.733711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.741388 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.741716 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.743945 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.773543 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 6 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.787817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.788152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.788487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.796369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.797084 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.798762 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 7 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.821062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.821394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.821731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.833048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.833375 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.864565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=7b26d217-8790-4ddb-aa1c-7aa3de804ed6,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:23.871382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 8 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.895947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26a3888d-7840-4a39-93fd-ec4e8f88d2a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.902258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.902598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.902933 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.911890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.912219 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:23.913245 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 9 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:23.949655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] In _notify_port_updated(), no bound segment for port 7b26d217-8790-4ddb-aa1c-7aa3de804ed6 on network 0239996c-49f7-4388-9488-06dcd5d10c2c {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:09:23.955188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:23.955521 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:23.955857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:23.958380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:23.959046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:23.960371 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-70984b86-3b1c-4f88-b9dd-443a6a1a163e tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "PUT /v2.0/ports/7b26d217-8790-4ddb-aa1c-7aa3de804ed6 HTTP/1.1" status: 200 len: 1003 time: 1.1325541 Nov 24 04:09:23.989266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:23.998734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:23.999987 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:24.000731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57840) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:24.001504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempt 10 to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 Nov 24 04:09:24.015525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.016194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56b27434-6331-4d82-8599-fc31a6e615f0 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:24.148295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:24.148979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:24.149531 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempting to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:24.178407 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:24.206125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:09:24.206125 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Failed to bind port 395a0155-2e2c-44d1-96cb-6092a540fd90 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '10462bbd-d34e-4c70-949a-31a1e06b54a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '1696a733-a969-453a-b9f6-904c0b76edc6'}] Nov 24 04:09:24.206884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.262485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-26a3888d-7840-4a39-93fd-ec4e8f88d2a1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:09:24.264248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-26a3888d-7840-4a39-93fd-ec4e8f88d2a1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:09:24.265288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.284841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 56b27434-6331-4d82-8599-fc31a6e615f0 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:24.285167 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.415114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event deleted for resources: {'Port': ['ID=07d190e0-7eb7-4184-b297-248e467a72ea,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:24.524437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.541249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.602936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 56b27434-6331-4d82-8599-fc31a6e615f0, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56b27434-6331-4d82-8599-fc31a6e615f0,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:24.613992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.658511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] For port 395a0155-2e2c-44d1-96cb-6092a540fd90, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:24.658923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attempted to set empty binding levels {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 04:09:24.659992 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.665320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port 7b26d217-8790-4ddb-aa1c-7aa3de804ed6 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:24.665656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.772602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:24.793154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=56b27434-6331-4d82-8599-fc31a6e615f0,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:24.800468 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07ffaf06-5ab3-4c63-a5bd-0a68baae2aa5 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:24.863584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:24.951106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event updated for resources: {'Port': ['ID=395a0155-2e2c-44d1-96cb-6092a540fd90,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:24.996608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.003233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] In _notify_port_updated(), no bound segment for port 395a0155-2e2c-44d1-96cb-6092a540fd90 on network 1696a733-a969-453a-b9f6-904c0b76edc6 {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:09:25.004868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:25.005673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.010114 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5489053e-e6c7-4b06-9d26-c93bfa31a347 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "PUT /v2.0/ports/395a0155-2e2c-44d1-96cb-6092a540fd90 HTTP/1.1" status: 200 len: 980 time: 3.3330410 Nov 24 04:09:25.014000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.022099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57848) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:25.070794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::1 (a2b36c78-43a6-4954-8102-cb5638999bb1/2100e375-5f8f-4a0b-af60-5361c23739fd/64422d38-70c1-4073-8c0e-c1d98f0e2048) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:25.138160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:25.139018 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.187899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3ac2f6f2-287b-4cbd-b729-610e0f34a6c9 None None] Provisioning complete for port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:25.188581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3ac2f6f2-287b-4cbd-b729-610e0f34a6c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.240925 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.241829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 13f4d4db-7a4a-4a87-a15a-24d5493b0996 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:25.311736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.319892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.326513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.330272 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5bb7125a-6976-49fa-ba99-440ecfba99a7 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/routers/13f4d4db-7a4a-4a87-a15a-24d5493b0996 HTTP/1.1" status: 204 len: 168 time: 3.6519353 Nov 24 04:09:25.336420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57850) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:25.352728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for 7b26d217-8790-4ddb-aa1c-7aa3de804ed6 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:25.390908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.423960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3ac2f6f2-287b-4cbd-b729-610e0f34a6c9 None None] Provisioning complete for port 7b26d217-8790-4ddb-aa1c-7aa3de804ed6 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:25.425926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3ac2f6f2-287b-4cbd-b729-610e0f34a6c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.479687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=64422d38-70c1-4073-8c0e-c1d98f0e2048,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:25.502008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:25.503501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:25.504982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3ac2f6f2-287b-4cbd-b729-610e0f34a6c9 None None] Port 7b26d217-8790-4ddb-aa1c-7aa3de804ed6 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:25.511011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:25.511637 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.612619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.646596 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-29b6f3cd-c2ac-4dd6-8542-c10818664778 None None] Provisioning complete for port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:25.647316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-29b6f3cd-c2ac-4dd6-8542-c10818664778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.687013 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.715712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Deleting port 395a0155-2e2c-44d1-96cb-6092a540fd90 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:25.717772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.944023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1e619ea3-35f5-4792-b640-cc18014568bf None None] Provisioning complete for port 64422d38-70c1-4073-8c0e-c1d98f0e2048 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:25.944992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1e619ea3-35f5-4792-b640-cc18014568bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:25.958060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] For port 395a0155-2e2c-44d1-96cb-6092a540fd90, host hv-neutron-8190, got binding levels [] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:25.976697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.017287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Calling delete_port for 395a0155-2e2c-44d1-96cb-6092a540fd90 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:26.020595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.020717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1e619ea3-35f5-4792-b640-cc18014568bf None None] Port 64422d38-70c1-4073-8c0e-c1d98f0e2048 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:26.040198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.097066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.103048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.104103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.163136 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=64422d38-70c1-4073-8c0e-c1d98f0e2048,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:26.173443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=7b26d217-8790-4ddb-aa1c-7aa3de804ed6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:26.212531 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Deleting port 56b27434-6331-4d82-8599-fc31a6e615f0 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:26.212863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.293261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:26.295334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:26.311310 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.316884 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-75790705-f305-470d-a353-4b6b7ccbc834 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/ports/7b26d217-8790-4ddb-aa1c-7aa3de804ed6 HTTP/1.1" status: 204 len: 168 time: 2.3080695 Nov 24 04:09:26.341454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57858) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:26.371391 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-e96d2e96-fec7-42c8-9a20-f9b95c81bd75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] GET failed (client error): The resource could not be found. Nov 24 04:09:26.376735 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e96d2e96-fec7-42c8-9a20-f9b95c81bd75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "GET /v2.0/ports/7b26d217-8790-4ddb-aa1c-7aa3de804ed6 HTTP/1.1" status: 404 len: 333 time: 0.0312443 Nov 24 04:09:26.379215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57860) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:26.384482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1638832314'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:26.407501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.476327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.479567 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "DELETE /v2.0/ports/395a0155-2e2c-44d1-96cb-6092a540fd90 HTTP/1.1" status: 204 len: 168 time: 1.4124999 Nov 24 04:09:26.508533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57862) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:26.522258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79bbffe1-22c5-45d8-8285-dfb4cbcb8eca tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] Pushing event deleted for resources: {'Port': ['ID=395a0155-2e2c-44d1-96cb-6092a540fd90,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:26.532581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] For port 56b27434-6331-4d82-8599-fc31a6e615f0, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56b27434-6331-4d82-8599-fc31a6e615f0,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:26.532953 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.552703 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Calling delete_port for 56b27434-6331-4d82-8599-fc31a6e615f0 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:26.564763 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6842658-37d1-4c28-bc73-c204a63552a5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:09:26.566835 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a6842658-37d1-4c28-bc73-c204a63552a5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-431472979-project-admin] 10.222.0.48 "GET /v2.0/ports/395a0155-2e2c-44d1-96cb-6092a540fd90 HTTP/1.1" status: 404 len: 333 time: 0.0512209 Nov 24 04:09:26.575421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57866) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:26.588958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Router 3e582de3-12d1-4bc4-a1af-369538214a02 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:26.684145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-dd724bd6-d90c-4ccd-8a60-a8e4070af976 None None] Provisioning complete for port 64422d38-70c1-4073-8c0e-c1d98f0e2048 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:26.688391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-dd724bd6-d90c-4ccd-8a60-a8e4070af976 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.732903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:26.736439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.780917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-dd724bd6-d90c-4ccd-8a60-a8e4070af976 None None] Port 64422d38-70c1-4073-8c0e-c1d98f0e2048 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:26.782981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] device_id is not set on port 652403ad-60f1-4ef5-87c4-c88b699ed75e yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:26.793574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.800960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56b27434-6331-4d82-8599-fc31a6e615f0 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:26.848991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:26.859963 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Sync routers for ids ['3e582de3-12d1-4bc4-a1af-369538214a02'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:26.864929 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e7095fcf-d102-48e8-83c4-229e00d99aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "PUT /v2.0/routers/3e582de3-12d1-4bc4-a1af-369538214a02/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0894890 Nov 24 04:09:26.867495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57868) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:26.881048 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Routers {'3e582de3-12d1-4bc4-a1af-369538214a02'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:26.885591 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3e582de3-12d1-4bc4-a1af-369538214a02'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:26.902675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 56b27434-6331-4d82-8599-fc31a6e615f0 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:26.903060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:26.903997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57870) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:26.912632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': '96924243-5b50-48fb-b900-d2dd42606c99', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:27.002937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.013907 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Set router 3e582de3-12d1-4bc4-a1af-369538214a02 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:27.020061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04e84a1e-6d8d-4833-bd22-c22d97a5e9b4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:27.024371 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-04e84a1e-6d8d-4833-bd22-c22d97a5e9b4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports/64422d38-70c1-4073-8c0e-c1d98f0e2048 HTTP/1.1" status: 200 len: 911 time: 0.1531579 Nov 24 04:09:27.024554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57872) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:27.070584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1696a733-a969-453a-b9f6-904c0b76edc6']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:27.087682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '10462bbd-d34e-4c70-949a-31a1e06b54a2') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:27.088045 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '10462bbd-d34e-4c70-949a-31a1e06b54a2') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:27.095682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Allocated IP 2001:db8::163 (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/652403ad-60f1-4ef5-87c4-c88b699ed75e) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:27.107560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.120596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.147392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82ac627e-25c0-4b87-9e32-a98967f2f5d6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:27.154406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82ac627e-25c0-4b87-9e32-a98967f2f5d6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:27.156447 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-82ac627e-25c0-4b87-9e32-a98967f2f5d6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1576 time: 0.1307497 Nov 24 04:09:27.160874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.162922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57878) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:27.170122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event deleted for resources: {'Port': ['ID=56b27434-6331-4d82-8599-fc31a6e615f0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:27.205607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Releasing vlan 163 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:27.206008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.208983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:27.209154 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:27.216385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.293815 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:23Z', 'updated_at': '2021-11-24T04:09:25Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None, '_interfaces': [{'id': '64422d38-70c1-4073-8c0e-c1d98f0e2048', 'name': '', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'mac_address': 'fa:16:3e:75:f2:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'device_owner': 'network:router_interface', 'standard_attr_id': 283, 'fixed_ips': [{'subnet_id': '2100e375-5f8f-4a0b-af60-5361c23739fd', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:24Z', 'updated_at': '2021-11-24T04:09:25Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'subnets': [{'id': '2100e375-5f8f-4a0b-af60-5361c23739fd', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:27.329486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.331809 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Checking router: 3e582de3-12d1-4bc4-a1af-369538214a02 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:27.332344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Updating router 3e582de3-12d1-4bc4-a1af-369538214a02 port 64422d38-70c1-4073-8c0e-c1d98f0e2048 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:09:27.334115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.337412 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] 10.222.0.48 "DELETE /v2.0/networks/1696a733-a969-453a-b9f6-904c0b76edc6 HTTP/1.1" status: 204 len: 168 time: 0.7570436 Nov 24 04:09:27.362560 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.364253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d849f26-8baa-4bf8-a851-e4b0aa837aa8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1126791501-project] Pushing event deleted for resources: {'Network': ['ID=1696a733-a969-453a-b9f6-904c0b76edc6,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:27.679714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.732809 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.743374 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.792577 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc95c2d-28a3-4ca7-89e7-4890704d70d1 None None] Pushing event updated for resources: {'Port': ['ID=64422d38-70c1-4073-8c0e-c1d98f0e2048,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:27.796246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.798680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.816152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57884) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:27.906114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.906701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Fanout notify agent at l3_agent the message router_deleted on router b539a212-0737-4c25-ac06-7e1008e8e3bc {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:27.913950 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Attempting to bind port 64422d38-70c1-4073-8c0e-c1d98f0e2048 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:27.915238 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Attempting to bind port 64422d38-70c1-4073-8c0e-c1d98f0e2048 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:27.915661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.916052 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Attempting to bind port 64422d38-70c1-4073-8c0e-c1d98f0e2048 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:27.916797 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e7c5bc3d-0f3d-4e18-be39-6f9471347a63 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "DELETE /v2.0/routers/b539a212-0737-4c25-ac06-7e1008e8e3bc HTTP/1.1" status: 204 len: 168 time: 2.5793767 Nov 24 04:09:27.923239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57890) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:27.924574 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:27.925804 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:27.927506 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.927728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1049848591', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:27.928591 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:27.929563 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Bound port: 64422d38-70c1-4073-8c0e-c1d98f0e2048, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:27.930467 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:27.959180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.051410 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] For port 64422d38-70c1-4073-8c0e-c1d98f0e2048, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:28.061801 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] For port 64422d38-70c1-4073-8c0e-c1d98f0e2048, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=64422d38-70c1-4073-8c0e-c1d98f0e2048,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:28.068402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.069503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.071370 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.146898 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Routers {'3e582de3-12d1-4bc4-a1af-369538214a02'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:28.147793 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3e582de3-12d1-4bc4-a1af-369538214a02'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:28.159849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.206909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.237153 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e15b60d6-cde4-4452-8275-133a48d99f55 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=d6936b011bd74028af2ed1051e1988ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3936856 Nov 24 04:09:28.253472 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc95c2d-28a3-4ca7-89e7-4890704d70d1 None None] Pushing event updated for resources: {'Port': ['ID=64422d38-70c1-4073-8c0e-c1d98f0e2048,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:28.254271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57896) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:28.292849 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] Set router 3e582de3-12d1-4bc4-a1af-369538214a02 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:28.302669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:28.302669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.308993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:28.322354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:28.330542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:28.331219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.360381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-987f926b-2210-422d-8dc5-cfdf5ffc907d None None] Provisioning complete for port 64422d38-70c1-4073-8c0e-c1d98f0e2048 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:28.360863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-987f926b-2210-422d-8dc5-cfdf5ffc907d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.515342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcadaf87-ae98-4503-9c1c-672e2eca637b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.547878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=652403ad-60f1-4ef5-87c4-c88b699ed75e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:28.548721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-987f926b-2210-422d-8dc5-cfdf5ffc907d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.584470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '96924243-5b50-48fb-b900-d2dd42606c99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:28.584837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: 96924243-5b50-48fb-b900-d2dd42606c99, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:28.597436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcadaf87-ae98-4503-9c1c-672e2eca637b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.600544 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7a6e78a4-75ce-4e94-9bb7-3a5926f0a7e6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 2.2200110 Nov 24 04:09:28.614000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-987f926b-2210-422d-8dc5-cfdf5ffc907d None None] For port 64422d38-70c1-4073-8c0e-c1d98f0e2048, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=64422d38-70c1-4073-8c0e-c1d98f0e2048,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:28.628470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-987f926b-2210-422d-8dc5-cfdf5ffc907d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.703411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57898) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:28.713262 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987f926b-2210-422d-8dc5-cfdf5ffc907d None None] Pushing event updated for resources: {'Port': ['ID=64422d38-70c1-4073-8c0e-c1d98f0e2048,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:28.714807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=1bacb3a7-3670-41c2-ab32-f3272ff96726,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:28.734381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:c0:6c:b2'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:28.765640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 07d190e0-7eb7-4184-b297-248e467a72ea no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:28.768943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4a590e02-a8aa-4a79-a696-4b024d685f01 None None] Provisioning complete for port 64422d38-70c1-4073-8c0e-c1d98f0e2048 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:28.769313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4a590e02-a8aa-4a79-a696-4b024d685f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.780105 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:23Z', 'updated_at': '2021-11-24T04:09:25Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None, '_interfaces': [{'id': '64422d38-70c1-4073-8c0e-c1d98f0e2048', 'name': '', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'mac_address': 'fa:16:3e:75:f2:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'device_owner': 'network:router_interface', 'standard_attr_id': 283, 'fixed_ips': [{'subnet_id': '2100e375-5f8f-4a0b-af60-5361c23739fd', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:24Z', 'updated_at': '2021-11-24T04:09:28Z', 'revision_number': 4, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'subnets': [{'id': '2100e375-5f8f-4a0b-af60-5361c23739fd', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:28.785014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcadaf87-ae98-4503-9c1c-672e2eca637b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.785996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.788222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcadaf87-ae98-4503-9c1c-672e2eca637b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.789485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 07d190e0-7eb7-4184-b297-248e467a72ea {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:28.790043 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bcadaf87-ae98-4503-9c1c-672e2eca637b admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/9b39ec71-6b1d-4b03-abf6-300dcc4c629f HTTP/1.1" status: 204 len: 168 time: 0.5346606 Nov 24 04:09:28.792824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 07d190e0-7eb7-4184-b297-248e467a72ea not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:28.793258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56b27434-6331-4d82-8599-fc31a6e615f0 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:28.796239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 96924243-5b50-48fb-b900-d2dd42606c99 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:28.823022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 96924243-5b50-48fb-b900-d2dd42606c99) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:28.830424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.835479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:28.836034 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c90005f6-3c22-4983-b7d0-f85beedd70c4 None None] The sync data for ids ['3e582de3-12d1-4bc4-a1af-369538214a02'] in dv-neutron-819049-1-hyperv is: [{'id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:23Z', 'updated_at': '2021-11-24T04:09:25Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None, '_interfaces': [{'id': '64422d38-70c1-4073-8c0e-c1d98f0e2048', 'name': '', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'mac_address': 'fa:16:3e:75:f2:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'device_owner': 'network:router_interface', 'standard_attr_id': 283, 'fixed_ips': [{'subnet_id': '2100e375-5f8f-4a0b-af60-5361c23739fd', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:24Z', 'updated_at': '2021-11-24T04:09:28Z', 'revision_number': 4, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'subnets': [{'id': '2100e375-5f8f-4a0b-af60-5361c23739fd', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:28.836877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:28.841003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54f9a600-e812-4005-80d0-9cc7eb3c250b None None] Network 96924243-5b50-48fb-b900-d2dd42606c99 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:28.849561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 56b27434-6331-4d82-8599-fc31a6e615f0 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:28.849827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56b27434-6331-4d82-8599-fc31a6e615f0 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:28.890767 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b7914ada-f551-4bc6-a226-677d2a5d63d5 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.9856544 Nov 24 04:09:28.894526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57902) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:28.904211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcadaf87-ae98-4503-9c1c-672e2eca637b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b39ec71-6b1d-4b03-abf6-300dcc4c629f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:28.905170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-473601518'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:29.059042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:29.064163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.109449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 161, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:29.136507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-96924243-5b50-48fb-b900-d2dd42606c99', 'network_id': '96924243-5b50-48fb-b900-d2dd42606c99', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '1bacb3a7-3670-41c2-ab32-f3272ff96726'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:29.137650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.189785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.200875 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 046d1f3d-e4f8-4e2c-995f-96172ae4540c of type vlan for network d67ce1fa-0a12-4693-91ed-d0858961a4e7 Nov 24 04:09:29.271965 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.274654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.312509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5266020a-9286-424e-954e-d4fa6712eccd None None] Provisioning complete for port 652403ad-60f1-4ef5-87c4-c88b699ed75e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:29.312985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5266020a-9286-424e-954e-d4fa6712eccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.316973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.322908 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.333399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57908) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:29.439784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Allocated IP 2001:db8:0:ffff::2 (96924243-5b50-48fb-b900-d2dd42606c99/1bacb3a7-3670-41c2-ab32-f3272ff96726/1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:29.447323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.454173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:29.454791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.549687 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-472b26db-2e27-46d6-8649-3155f2afcb85 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=728830d7da834543a5a2d2274585166f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2141197 Nov 24 04:09:29.555804 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57914) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:29.588836 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6929519 Nov 24 04:09:29.591029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5266020a-9286-424e-954e-d4fa6712eccd None None] Port 652403ad-60f1-4ef5-87c4-c88b699ed75e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:29.618712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57916) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:29.626605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:29.639971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c911a6e5-877c-4774-b368-5f4049752d97 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=d67ce1fa-0a12-4693-91ed-d0858961a4e7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:29.660344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network d67ce1fa-0a12-4693-91ed-d0858961a4e7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:29.670381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Allocated IP 172.26.5.127 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/3216237d-e278-4cbe-a1e5-21479569c632) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:29.715241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96488edb-d08b-4ec0-b592-772c733467f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.748451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.748742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.757646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 64422d38-70c1-4073-8c0e-c1d98f0e2048 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:29.757994 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.761410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.785571 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.791909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96488edb-d08b-4ec0-b592-772c733467f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.808427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Network 96924243-5b50-48fb-b900-d2dd42606c99 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:29.813540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:29.818805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:29.824036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Pushing event updated for resources: {'Port': ['ID=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:29.886266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] In _notify_port_updated(), no bound segment for port 652403ad-60f1-4ef5-87c4-c88b699ed75e on network 0239996c-49f7-4388-9488-06dcd5d10c2c {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:09:29.888611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.896118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:29.897534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.899033 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "PUT /v2.0/ports/652403ad-60f1-4ef5-87c4-c88b699ed75e HTTP/1.1" status: 200 len: 1003 time: 1.1869175 Nov 24 04:09:29.901920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57918) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:29.920827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96488edb-d08b-4ec0-b592-772c733467f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.921077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96488edb-d08b-4ec0-b592-772c733467f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.924832 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-96488edb-d08b-4ec0-b592-772c733467f6 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/d372a2a5-5f53-4761-ac2e-dc7c798658f4 HTTP/1.1" status: 204 len: 168 time: 0.3580587 Nov 24 04:09:29.931331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Attempting to bind port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:29.931973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Attempting to bind port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '96924243-5b50-48fb-b900-d2dd42606c99'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:29.932521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Attempting to bind port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 on network 96924243-5b50-48fb-b900-d2dd42606c99 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:29.938968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:29.939558 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Checking segment: {'id': 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '96924243-5b50-48fb-b900-d2dd42606c99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:29.940110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.940674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Bound using segment: {'id': 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '96924243-5b50-48fb-b900-d2dd42606c99'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:29.941323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Bound port: 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '96924243-5b50-48fb-b900-d2dd42606c99'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:29.941856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.943709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:29.957054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:29.997943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96488edb-d08b-4ec0-b592-772c733467f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d372a2a5-5f53-4761-ac2e-dc7c798658f4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:30.065653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.147346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:30.159665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:30.162877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event updated for resources: {'Port': ['ID=3216237d-e278-4cbe-a1e5-21479569c632,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:30.165189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:30.200530 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port 652403ad-60f1-4ef5-87c4-c88b699ed75e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:30.201266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.215476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89636e2-76dc-4b1b-b7af-b71e4fdc2ff6 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=652403ad-60f1-4ef5-87c4-c88b699ed75e,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:30.245952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] For port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:30.250550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] For port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,segment=NetworkSegment(a10d4f6d-ed5d-43bb-8e18-aae4f2c75848),segment_id=a10d4f6d-ed5d-43bb-8e18-aae4f2c75848)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:30.259136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.346716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] For port 64422d38-70c1-4073-8c0e-c1d98f0e2048, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=64422d38-70c1-4073-8c0e-c1d98f0e2048,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:30.347441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.361490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.362410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-83742683-b72f-484e-b79a-65544ef5d9f9 None None] Provisioning complete for port 652403ad-60f1-4ef5-87c4-c88b699ed75e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:30.362792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-83742683-b72f-484e-b79a-65544ef5d9f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.399756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a43f00-8af8-4af3-b95a-60a42a83c853 None None] Pushing event updated for resources: {'Port': ['ID=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:30.423759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-83742683-b72f-484e-b79a-65544ef5d9f9 None None] Port 652403ad-60f1-4ef5-87c4-c88b699ed75e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:30.437805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.443237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=e196d631-e150-44a2-834f-5c8ac192bceb,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:30.449730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 64422d38-70c1-4073-8c0e-c1d98f0e2048 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:30.466411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for 652403ad-60f1-4ef5-87c4-c88b699ed75e owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:30.537880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': '046d1f3d-e4f8-4e2c-995f-96172ae4540c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:30.542374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: d67ce1fa-0a12-4693-91ed-d0858961a4e7, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:30.674051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network d67ce1fa-0a12-4693-91ed-d0858961a4e7 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:30.696239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, d67ce1fa-0a12-4693-91ed-d0858961a4e7) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:30.701108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:30.701838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.713368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2368a774-5e24-4b04-b499-98163776f6e4 None None] Network d67ce1fa-0a12-4693-91ed-d0858961a4e7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:30.738990 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ee67644f-2dc0-4620-bb6c-e6375463bd72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.1181576 Nov 24 04:09:30.744234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57936) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:30.757126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:30.955890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.012067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.033469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.066657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=64422d38-70c1-4073-8c0e-c1d98f0e2048,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:31.068804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 64422d38-70c1-4073-8c0e-c1d98f0e2048 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:31.098940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-d67ce1fa-0a12-4693-91ed-d0858961a4e7', 'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': 'e196d631-e150-44a2-834f-5c8ac192bceb'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:31.099950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.102416 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 64422d38-70c1-4073-8c0e-c1d98f0e2048 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:31.102921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 64422d38-70c1-4073-8c0e-c1d98f0e2048 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:09:31.185289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port 64422d38-70c1-4073-8c0e-c1d98f0e2048 not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:09:31.185730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:31.192715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=652403ad-60f1-4ef5-87c4-c88b699ed75e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:31.199874 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.209276 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-090a4e50-5f39-4c11-a360-cd89dbb93355 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/ports/652403ad-60f1-4ef5-87c4-c88b699ed75e HTTP/1.1" status: 204 len: 168 time: 1.3061938 Nov 24 04:09:31.218814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57948) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:31.311968 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2251575-e66a-49c8-bf01-a11ff448fd71 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] GET failed (client error): The resource could not be found. Nov 24 04:09:31.317539 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c2251575-e66a-49c8-bf01-a11ff448fd71 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "GET /v2.0/ports/652403ad-60f1-4ef5-87c4-c88b699ed75e HTTP/1.1" status: 404 len: 333 time: 0.0973587 Nov 24 04:09:31.323473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57954) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:31.343022 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.371658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-632588086'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:31.416084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.426116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.440383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:31.440383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.513847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Allocated IP 2001:db8::1 (d67ce1fa-0a12-4693-91ed-d0858961a4e7/e196d631-e150-44a2-834f-5c8ac192bceb/9a7071bf-8c91-4af3-9eb3-cd73a36bfc99) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:31.617088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Router 254035a8-de52-4bcb-8176-a8d74b1e3452 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:31.709008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.876361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.884924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,segment=NetworkSegment(a10d4f6d-ed5d-43bb-8e18-aae4f2c75848),segment_id=a10d4f6d-ed5d-43bb-8e18-aae4f2c75848)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:31.891249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:31.930446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.004184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Pushing event updated for resources: {'Port': ['ID=9a7071bf-8c91-4af3-9eb3-cd73a36bfc99,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:32.019122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Network d67ce1fa-0a12-4693-91ed-d0858961a4e7 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:32.082116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:32.085561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:32.088025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:32.120667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:32.136388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] Sync routers for ids ['254035a8-de52-4bcb-8176-a8d74b1e3452'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:32.139786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2202addc-c3df-4e3b-b83d-673fb1f9e63d None None] Network 96924243-5b50-48fb-b900-d2dd42606c99 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:32.155657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.161227 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f32c3fb3-add2-4648-b7c2-771d0122b0ea tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 4.2339780 Nov 24 04:09:32.162443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57972) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:32.168167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': False}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:32.200313 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.212527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] Routers {'254035a8-de52-4bcb-8176-a8d74b1e3452'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:32.213178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['254035a8-de52-4bcb-8176-a8d74b1e3452'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.239198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=e196d631-e150-44a2-834f-5c8ac192bceb,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:32.247277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Router 3e582de3-12d1-4bc4-a1af-369538214a02 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:32.263749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.273735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57974) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:32.287305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:32.291108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.304587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Attempting to bind port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:32.304973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Attempting to bind port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '046d1f3d-e4f8-4e2c-995f-96172ae4540c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:32.306854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Attempting to bind port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99 on network d67ce1fa-0a12-4693-91ed-d0858961a4e7 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:32.315134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:32.315525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Checking segment: {'id': '046d1f3d-e4f8-4e2c-995f-96172ae4540c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:32.315920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.316319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Bound using segment: {'id': '046d1f3d-e4f8-4e2c-995f-96172ae4540c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:32.316795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Bound port: 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '046d1f3d-e4f8-4e2c-995f-96172ae4540c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:32.317179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.329576 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ab073417-751c-4d93-98e2-1353d836d924 None None] Provisioning complete for port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:32.329878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ab073417-751c-4d93-98e2-1353d836d924 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.352243 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] Routers {'254035a8-de52-4bcb-8176-a8d74b1e3452'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:32.352784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['254035a8-de52-4bcb-8176-a8d74b1e3452'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.408753 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-2037996329', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:32.415067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.417147 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.417815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af212f50-c1ab-43ba-8cc6-4715581c2955 None None] The sync data for ids ['254035a8-de52-4bcb-8176-a8d74b1e3452'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:32.438179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] device_id is not set on port d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:32.466541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:32.473103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d67ce1fa-0a12-4693-91ed-d0858961a4e7']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.481336 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] Sync routers for ids ['3e582de3-12d1-4bc4-a1af-369538214a02'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:32.497714 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] Routers {'3e582de3-12d1-4bc4-a1af-369538214a02'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:32.499447 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fe995d76-85e6-49cf-872a-e440d1340437 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "PUT /v2.0/routers/3e582de3-12d1-4bc4-a1af-369538214a02/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3352463 Nov 24 04:09:32.499858 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3e582de3-12d1-4bc4-a1af-369538214a02'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.509386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57980) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:32.573650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8877ab9f-9b69-47ef-a7ff-71affd5260e2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:32.576040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8877ab9f-9b69-47ef-a7ff-71affd5260e2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:32.578463 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8877ab9f-9b69-47ef-a7ff-71affd5260e2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0680537 Nov 24 04:09:32.581160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57982) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:32.583115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] For port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:32.587869 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] For port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9a7071bf-8c91-4af3-9eb3-cd73a36bfc99,segment=NetworkSegment(046d1f3d-e4f8-4e2c-995f-96172ae4540c),segment_id=046d1f3d-e4f8-4e2c-995f-96172ae4540c)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:32.588997 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] Set router 3e582de3-12d1-4bc4-a1af-369538214a02 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:32.627776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.642684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Allocated IP 2001:db8::16b (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:32.651562 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:23Z', 'updated_at': '2021-11-24T04:09:30Z', 'revision_number': 3, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.661815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.666728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 2100e375-5f8f-4a0b-af60-5361c23739fd {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:32.674273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.685882 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] Checking router: 3e582de3-12d1-4bc4-a1af-369538214a02 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:32.694874 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] Routers {'3e582de3-12d1-4bc4-a1af-369538214a02'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:32.695610 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3e582de3-12d1-4bc4-a1af-369538214a02'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.770626 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.785034 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] Set router 3e582de3-12d1-4bc4-a1af-369538214a02 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:32.807888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f919f9-02d3-461c-b639-45f8fefb8328 None None] Pushing event updated for resources: {'Port': ['ID=9a7071bf-8c91-4af3-9eb3-cd73a36bfc99,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:32.822746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Made reservation on behalf of 8f1b322a89f946f19ad1965c373e7b5e for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:32.825108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.857363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2ec8c21-801a-4bd7-a54c-76fd46195d71 None None] Network d67ce1fa-0a12-4693-91ed-d0858961a4e7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:32.864778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '046d1f3d-e4f8-4e2c-995f-96172ae4540c') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.865082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '046d1f3d-e4f8-4e2c-995f-96172ae4540c') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.865886 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:23Z', 'updated_at': '2021-11-24T04:09:30Z', 'revision_number': 3, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:32.895042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.897739 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a301eff2-826a-4981-b5d8-6bf031b24255 None None] The sync data for ids ['3e582de3-12d1-4bc4-a1af-369538214a02'] in dv-neutron-819049-1-hyperv is: [{'id': '3e582de3-12d1-4bc4-a1af-369538214a02', 'name': 'tempest-NetworksTestDHCPv6-router-751027213', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:23Z', 'updated_at': '2021-11-24T04:09:30Z', 'revision_number': 3, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:32.927884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.969125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.984963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:32.994479 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:33.008608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 161 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:33.009263 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:33.013814 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:33.030169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.128219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.130828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:09:33.130828 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:09:33.130828 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'id': 'd67ce1fa-0a12-4693-91ed-d0858961a4e7'}] Nov 24 04:09:33.130828 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:09:33.131172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:33.131253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:09:33.131345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.131552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.165684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=2100e375-5f8f-4a0b-af60-5361c23739fd,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:33.173177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.178587 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-27cc93a5-5095-439e-adb7-2481dfa42443 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/2100e375-5f8f-4a0b-af60-5361c23739fd HTTP/1.1" status: 204 len: 168 time: 0.5944121 Nov 24 04:09:33.178758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:33.178843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f30b364-ea6b-4ecc-8008-559f438133ff None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:09:33.178921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57988) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:33.184492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:33.189659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:33.195727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:33.196365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.237908 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 1.8959303 Nov 24 04:09:33.243873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ffa8679-b47c-4efd-8870-91d2118b8f6c tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:33.248655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 57990) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:33.253708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'network_id': '0239996c-49f7-4388-9488-06dcd5d10c2c', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1699377600'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:33.258031 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.275489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.292853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] device_id is not set on port 7a7128d2-f43d-4a61-a103-5a35e643c2b5 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:33.363580 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5980e2db-56a0-4bab-ae1e-aab448ce9901 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.1834261 Nov 24 04:09:33.364479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57992) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:33.396969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f614f9a4-ec82-4f74-900d-133fd77a88f9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:33.413708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-83e5c5d3-d731-4ccc-a96b-fe7e6707583a None None] Provisioning complete for port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:33.414090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-83e5c5d3-d731-4ccc-a96b-fe7e6707583a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.493388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Allocated IP 172.26.5.233 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/7a7128d2-f43d-4a61-a103-5a35e643c2b5) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:33.498768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Made reservation on behalf of d10ac043d90d4ae1a587a0fe1fc513d3 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:33.502379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.538333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] device_id is not set on port 7c04c654-86b0-4060-8aa0-7302c036b56a yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:33.543279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.566013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f30b364-ea6b-4ecc-8008-559f438133ff None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:09:33.634081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.773726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.779866 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.784826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Allocated IP 2001:db8::355 (0239996c-49f7-4388-9488-06dcd5d10c2c/61d2ee7d-2547-416e-acbd-1eae08042687/7c04c654-86b0-4060-8aa0-7302c036b56a) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:33.807969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.862268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.862855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Fanout notify agent at l3_agent the message router_deleted on router 3e582de3-12d1-4bc4-a1af-369538214a02 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:33.869788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:33.870123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.870324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.874907 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f10109c7-ea37-4a95-b436-057c341e1493 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/routers/3e582de3-12d1-4bc4-a1af-369538214a02 HTTP/1.1" status: 204 len: 168 time: 0.4558523 Nov 24 04:09:33.874907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 57996) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:33.880218 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:33.911217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.921357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:33.979362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.024207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4685454b-f56d-4124-8e37-38803a8c5a28 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:34.098439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] For port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9a7071bf-8c91-4af3-9eb3-cd73a36bfc99,segment=NetworkSegment(046d1f3d-e4f8-4e2c-995f-96172ae4540c),segment_id=046d1f3d-e4f8-4e2c-995f-96172ae4540c)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:34.098819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.122394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:34.138601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:34.144277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Calling delete_port for 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:34.151026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:34.157299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Pushing event updated for resources: {'Port': ['ID=7a7128d2-f43d-4a61-a103-5a35e643c2b5,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:34.172264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bcbaad3-2682-467f-8358-01822500e6c7 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:34.214277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.227147 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port 821066e1-70dd-43b3-8e94-cc706e3bbd45 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:34.227510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.275633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:34.277212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Port 821066e1-70dd-43b3-8e94-cc706e3bbd45 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:34.278951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.290821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port b16f6f22-9ec8-455b-bfdc-56955cdb66ff triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:34.291485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.338690 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3758a129-5838-4710-88d4-a001561b19d6 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1037 time: 2.0636966 Nov 24 04:09:34.342101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58002) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:34.352210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.233'}]}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:34.391776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:34.402413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.404524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.410961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.411789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.440555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:34.444207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.454374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Network 0239996c-49f7-4388-9488-06dcd5d10c2c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:34.454593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port 56919873-aabb-4651-947d-5d6a306972db triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:34.454925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.455674 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Port': ['ID=9a7071bf-8c91-4af3-9eb3-cd73a36bfc99,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:34.457879 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No DVR routers for this DVR port 9a7071bf-8c91-4af3-9eb3-cd73a36bfc99 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:34.460461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:34.493285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] Deleting port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:34.493661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.568959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:34.577040 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:34.578022 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.578142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Router 254035a8-de52-4bcb-8176-a8d74b1e3452 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:34.597971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] For port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:34.598402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.618676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] Calling delete_port for b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:34.628050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.669522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.669671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port 05680a67-f712-4941-9fd3-852fad6b27fb triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:34.670034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.701073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d67ce1fa-0a12-4693-91ed-d0858961a4e7']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:34.713527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '046d1f3d-e4f8-4e2c-995f-96172ae4540c') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:34.718122 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '046d1f3d-e4f8-4e2c-995f-96172ae4540c') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:34.747845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.753300 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 1.5035803 Nov 24 04:09:34.757341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58008) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:34.777229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::252', 'mac_address': 'fa:16:3e:c0:6c:b2'}, {'ip_address': '2001:db8::16b', 'mac_address': 'fa:16:3e:20:37:16'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:34.781724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:34.795250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.796311 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f4d04b0e-b825-4e1b-8845-68913ac91cc2 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "PUT /v2.0/routers/254035a8-de52-4bcb-8176-a8d74b1e3452 HTTP/1.1" status: 200 len: 922 time: 2.6327708 Nov 24 04:09:34.816300 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb49d91-1e79-4d57-a409-34d2f11899ee tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=7c04c654-86b0-4060-8aa0-7302c036b56a,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:34.819802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58010) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:34.819968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 64422d38-70c1-4073-8c0e-c1d98f0e2048 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:34.822291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] Sync routers for ids ['254035a8-de52-4bcb-8176-a8d74b1e3452'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:34.872548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port 8aac0b0c-6dbb-49ea-85cb-46c26161b754 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:34.873244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.876875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 64422d38-70c1-4073-8c0e-c1d98f0e2048 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:34.877244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 64422d38-70c1-4073-8c0e-c1d98f0e2048 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:34.877660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:34.878431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.885553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 161 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:34.886200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.899735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] Routers {'254035a8-de52-4bcb-8176-a8d74b1e3452'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:34.900592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['254035a8-de52-4bcb-8176-a8d74b1e3452'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:34.951897 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:34.960344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:34.976929 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:35.001807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.015745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=ffd5ae43-00b3-45a7-8d66-aaec11c4be13,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:35.034085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:35.040364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:35.046648 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-46af33f7-b0a1-4652-87db-4b01d4bbb240 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.047891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:35.048052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.048245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.050954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] No DVR routers for this DVR port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:35.054351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Port 8aac0b0c-6dbb-49ea-85cb-46c26161b754 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:35.059171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] Routers {'254035a8-de52-4bcb-8176-a8d74b1e3452'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:35.059814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['254035a8-de52-4bcb-8176-a8d74b1e3452'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:35.063908 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50758dbf-4373-4e69-b84e-5bf7841af8de None None] Pushing event deleted for resources: {'Port': ['ID=b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:35.098587 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f59cc2f8-eda5-45e1-9daf-78104794e8f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.2224548 Nov 24 04:09:35.099420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58012) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.107688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95ae1aae-83db-4391-922f-f591f97c7198 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:35.109211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:35.111425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No active binding found for port b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 {{(pid=103382) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 24 04:09:35.112145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b0ac22e8-04ba-4245-9e56-1f3fc0bc9fc3 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:35.114126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:35.114126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2ad15d7-9bb3-4f37-82be-63d2d8ff2c63 None None] The sync data for ids ['254035a8-de52-4bcb-8176-a8d74b1e3452'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:35.139067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.142438 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/d67ce1fa-0a12-4693-91ed-d0858961a4e7 HTTP/1.1" status: 204 len: 168 time: 4.3971291 Nov 24 04:09:35.145431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.152487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58016) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.152611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5ed105-d3e5-4f45-9a12-7702ca27fc85 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=d67ce1fa-0a12-4693-91ed-d0858961a4e7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:35.153953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port 3216237d-e278-4cbe-a1e5-21479569c632 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:35.154777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.190007 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5b54579d-f8e9-4cf6-ba19-03cddc0dba30 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/254035a8-de52-4bcb-8176-a8d74b1e3452 HTTP/1.1" status: 200 len: 922 time: 0.2390034 Nov 24 04:09:35.190641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58018) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.191540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-718286830'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:35.196102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.217599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.218699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.260189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:35.264327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.304027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9436b891-c19b-42cb-8e73-26d2d8eba3e6 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:35.318662 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9436b891-c19b-42cb-8e73-26d2d8eba3e6 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=254035a8-de52-4bcb-8176-a8d74b1e3452&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1256201 Nov 24 04:09:35.319331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58022) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.364301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.365115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Port 3216237d-e278-4cbe-a1e5-21479569c632 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:35.372725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 164, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:35.376323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.390888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port 5503f0ee-7113-45e0-8806-1eb6b4320966 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:35.392103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.409965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.410694 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 49d23002-af0e-47fe-af58-60e30b337f6e of type vlan for network 9a49573f-b949-41da-8c25-9ae3174f545b Nov 24 04:09:35.431659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b752303a-4447-47da-9162-a3214b011818 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:35.436423 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b752303a-4447-47da-9162-a3214b011818 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.1118219 Nov 24 04:09:35.436609 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58024) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.440707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.444552 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b1a0bfc-e866-4d3b-a464-1d4a8b90eae8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.3387959 Nov 24 04:09:35.445101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58026) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.501378 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-25851a1b-3407-45c4-a3a9-d96a74bdbea6 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=254035a8-de52-4bcb-8176-a8d74b1e3452 HTTP/1.1" status: 200 len: 205 time: 0.0613585 Nov 24 04:09:35.524382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58028) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.528309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:35.529285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.575460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.639592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Provisioning complete for port c7e79400-9389-41db-8a8d-3154de89f8c1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:35.639981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.705800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-881c89f6-e9bf-49e9-a683-56f9aa5ef3c1 None None] Port c7e79400-9389-41db-8a8d-3154de89f8c1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:35.727015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/ffd5ae43-00b3-45a7-8d66-aaec11c4be13/ce4709dd-0183-4ef5-8d07-def42ddb209b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:35.765299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.770971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:35.771614 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.836159 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6740036 Nov 24 04:09:35.840188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.852265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Provisioning complete for port 7c04c654-86b0-4060-8aa0-7302c036b56a triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:35.852642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.860085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58030) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:35.897909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:35.909077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.934803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4709b9b3-3d28-498e-988a-6558c02dbe5d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=9a49573f-b949-41da-8c25-9ae3174f545b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:35.940513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.943358 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Port 7c04c654-86b0-4060-8aa0-7302c036b56a cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:35.953130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 9a49573f-b949-41da-8c25-9ae3174f545b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:35.957924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.983878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:35.997707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] In _notify_port_updated(), no bound segment for port 7c04c654-86b0-4060-8aa0-7302c036b56a on network 0239996c-49f7-4388-9488-06dcd5d10c2c {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:09:36.003472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:36.004222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.008146 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "PUT /v2.0/ports/7c04c654-86b0-4060-8aa0-7302c036b56a HTTP/1.1" status: 200 len: 1068 time: 1.2362752 Nov 24 04:09:36.013220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Provisioning complete for port 7a7128d2-f43d-4a61-a103-5a35e643c2b5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:36.013599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.042711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58034) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:36.072843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.090043 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:36.097306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.103149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:36.109663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.110163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:36.116460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Port 7a7128d2-f43d-4a61-a103-5a35e643c2b5 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:36.117219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5775ef2e-ca8c-47c4-96ce-b92edc856b7f tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event updated for resources: {'Port': ['ID=7c04c654-86b0-4060-8aa0-7302c036b56a,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:36.121465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Pushing event updated for resources: {'Port': ['ID=ce4709dd-0183-4ef5-8d07-def42ddb209b,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:36.181903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Provisioning complete for port d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:36.182305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.220939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Attempting to bind port ce4709dd-0183-4ef5-8d07-def42ddb209b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:36.221353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Attempting to bind port ce4709dd-0183-4ef5-8d07-def42ddb209b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:36.221684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Attempting to bind port ce4709dd-0183-4ef5-8d07-def42ddb209b on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:36.235216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:36.235595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:36.236004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.236404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:36.236886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Bound port: ce4709dd-0183-4ef5-8d07-def42ddb209b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:36.237271 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.240817 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e4882fe7-a246-42d1-b2d0-f1a65da67449 None None] Port d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:36.271880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:36.275517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.364614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.367759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] For port ce4709dd-0183-4ef5-8d07-def42ddb209b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:36.385814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] For port ce4709dd-0183-4ef5-8d07-def42ddb209b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ce4709dd-0183-4ef5-8d07-def42ddb209b,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:36.388110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-17e94d4b-fd6b-4c44-b011-2e1534cac55a None None] Provisioning complete for port 7c04c654-86b0-4060-8aa0-7302c036b56a triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:36.388482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-17e94d4b-fd6b-4c44-b011-2e1534cac55a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.402357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.413562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.455379 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-17e94d4b-fd6b-4c44-b011-2e1534cac55a None None] Port 7c04c654-86b0-4060-8aa0-7302c036b56a cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:36.457000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port 7c04c654-86b0-4060-8aa0-7302c036b56a {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:36.457337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.485502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4a5a3a-acca-4edb-bce5-06e0391a8581 None None] Pushing event updated for resources: {'Port': ['ID=ce4709dd-0183-4ef5-8d07-def42ddb209b,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:36.579762 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.582799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.594361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Deleting port 3216237d-e278-4cbe-a1e5-21479569c632 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:36.594640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.673169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.678963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::1 (a2b36c78-43a6-4954-8102-cb5638999bb1/ffd5ae43-00b3-45a7-8d66-aaec11c4be13/b6e44a3e-efd0-45df-9087-0ecddfd2a3e5) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:36.700404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.701092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 45ec90d7-88ed-4fbb-aa5d-cd8f05c03187 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:36.727332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for 7c04c654-86b0-4060-8aa0-7302c036b56a owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:36.740548 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 24 04:09:36.743955 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d00668f8-2201-4188-83f9-5e42586fb82f tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 2.3938813 Nov 24 04:09:36.746658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58040) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:36.759567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.772404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Calling delete_port for 3216237d-e278-4cbe-a1e5-21479569c632 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:36.944160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.966006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:36.975266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event deleted for resources: {'Port': ['ID=3216237d-e278-4cbe-a1e5-21479569c632,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:36.991595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8e04580-0aa0-40cd-87b5-b86225041ae3 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:37.037584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.072248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.085099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=349c4db4-9db8-40f6-b5d1-f1e10cf06f3e,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:37.131890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.133722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.147170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Deleting port 7a7128d2-f43d-4a61-a103-5a35e643c2b5 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:37.147516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.149235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': '49d23002-af0e-47fe-af58-60e30b337f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:37.149594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: 9a49573f-b949-41da-8c25-9ae3174f545b, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:37.178530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.179085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Fanout notify agent at l3_agent the message router_deleted on router 254035a8-de52-4bcb-8176-a8d74b1e3452 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:37.186265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.190855 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-590a6c95-5496-4326-acd3-e4ddd413c222 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/254035a8-de52-4bcb-8176-a8d74b1e3452 HTTP/1.1" status: 204 len: 168 time: 1.6622267 Nov 24 04:09:37.194800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58044) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:37.200439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-933547298', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:37.224867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.225954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.237456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.252576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.285539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.290030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.309200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.313081 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-02708ea5-7126-4304-a5c5-e12baeddd624 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.1147320 Nov 24 04:09:37.313488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58046) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:37.318620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:37.537380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.578876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 9a49573f-b949-41da-8c25-9ae3174f545b is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:37.584730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-26a2b810-f96c-483a-ae9e-494931a663c9 None None] Provisioning complete for port ce4709dd-0183-4ef5-8d07-def42ddb209b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:37.585272 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26a2b810-f96c-483a-ae9e-494931a663c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.591516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:37.611963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:37.616832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.623674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:37.624299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.631243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 9a49573f-b949-41da-8c25-9ae3174f545b) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:37.703817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Calling delete_port for 7a7128d2-f43d-4a61-a103-5a35e643c2b5 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:37.707112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:37.707734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.710195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:37.749111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fd72276-498e-41c9-b096-cd98dd125e80 None None] Network 9a49573f-b949-41da-8c25-9ae3174f545b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:37.752649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26a2b810-f96c-483a-ae9e-494931a663c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.768643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=7c04c654-86b0-4060-8aa0-7302c036b56a,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:37.816595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.840084 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2521513e-38f7-4bfd-84a1-b260cbf7746c tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.9738519 Nov 24 04:09:37.840329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.840921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58052) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:37.846055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1714319586'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:37.868087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-26a2b810-f96c-483a-ae9e-494931a663c9 None None] For port ce4709dd-0183-4ef5-8d07-def42ddb209b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ce4709dd-0183-4ef5-8d07-def42ddb209b,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:37.877271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:37.881518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.884712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26a2b810-f96c-483a-ae9e-494931a663c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:37.999253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 171, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:37.999390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.007213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-71a295f2-42e3-413d-8f8e-d78cd69c2ad6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.026160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a2b810-f96c-483a-ae9e-494931a663c9 None None] Pushing event updated for resources: {'Port': ['ID=ce4709dd-0183-4ef5-8d07-def42ddb209b,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:38.058295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.058740 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 073ac5b1-c574-4f23-a975-f2ff1405107b of type vlan for network beab3bda-7c8e-463e-8007-e4bcafe99977 Nov 24 04:09:38.085265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-9a49573f-b949-41da-8c25-9ae3174f545b', 'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '349c4db4-9db8-40f6-b5d1-f1e10cf06f3e'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:38.086135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.138569 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Allocated IP 172.26.5.57 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/c758033c-9a4e-4f03-8458-60169ea32e74) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:38.141617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.162054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.165585 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-71ec63bd-412a-4318-902b-ce49d0660183 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/ports/7c04c654-86b0-4060-8aa0-7302c036b56a HTTP/1.1" status: 204 len: 168 time: 2.1211393 Nov 24 04:09:38.169298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58054) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:38.216554 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-323d6493-74b6-40a0-b652-72b0d2ba0ec5 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] GET failed (client error): The resource could not be found. Nov 24 04:09:38.220652 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-323d6493-74b6-40a0-b652-72b0d2ba0ec5 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "GET /v2.0/ports/7c04c654-86b0-4060-8aa0-7302c036b56a HTTP/1.1" status: 404 len: 333 time: 0.0483019 Nov 24 04:09:38.220879 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58058) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:38.250350 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.255843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:38.256433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.261657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.265110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Allocated IP 2001:db8::3 (9a49573f-b949-41da-8c25-9ae3174f545b/349c4db4-9db8-40f6-b5d1-f1e10cf06f3e/68085816-de5c-415b-93be-5558699fefc8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:38.305558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Pushing event deleted for resources: {'Port': ['ID=7a7128d2-f43d-4a61-a103-5a35e643c2b5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:38.338367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53df6316-7b3d-4d34-beff-627c67ec38ac None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:38.354684 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.5125487 Nov 24 04:09:38.355557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58060) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:38.380044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': 'beab3bda-7c8e-463e-8007-e4bcafe99977', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:38.395036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-64d7127a-8fd0-42de-80ec-a49430811dd8 None None] Provisioning complete for port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:38.395409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64d7127a-8fd0-42de-80ec-a49430811dd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.419850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff8394f6-7e9e-44b3-a0f5-41d900903220 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=beab3bda-7c8e-463e-8007-e4bcafe99977,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:38.448864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network beab3bda-7c8e-463e-8007-e4bcafe99977 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:38.451745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.470994 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:38.471295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.502063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-64d7127a-8fd0-42de-80ec-a49430811dd8 None None] Port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:38.544054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.547332 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f0600096-37e5-4867-92a8-6309fb6773f7 tempest-RoutersAdminNegativeIpV6Test-1791802247 tempest-RoutersAdminNegativeIpV6Test-1791802247-project-admin] 10.222.0.48 "DELETE /v2.0/ports/7a7128d2-f43d-4a61-a103-5a35e643c2b5 HTTP/1.1" status: 204 len: 168 time: 1.7937284 Nov 24 04:09:38.551648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.579336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.587178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.615326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.619574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:38.626624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Network 9a49573f-b949-41da-8c25-9ae3174f545b is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:38.628048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:38.636457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:38.636890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:38.638806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:38.639050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:38.645717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.649562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:38.651400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-725637e3-62b7-4e77-9079-58157d83bff7 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:38.655032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.659918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.660071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Pushing event updated for resources: {'Port': ['ID=68085816-de5c-415b-93be-5558699fefc8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:38.660798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.660944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event updated for resources: {'Port': ['ID=c758033c-9a4e-4f03-8458-60169ea32e74,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:38.820301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.828003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Attempting to bind port 68085816-de5c-415b-93be-5558699fefc8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:38.828378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Attempting to bind port 68085816-de5c-415b-93be-5558699fefc8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '49d23002-af0e-47fe-af58-60e30b337f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:38.828749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Attempting to bind port 68085816-de5c-415b-93be-5558699fefc8 on network 9a49573f-b949-41da-8c25-9ae3174f545b {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:38.835212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4604061-2fe3-4680-b609-e6cc30693f92 None None] Provisioning complete for port c758033c-9a4e-4f03-8458-60169ea32e74 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:38.836453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4604061-2fe3-4680-b609-e6cc30693f92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.840020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Performing IP validity checks on allocation pools {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:09:38.840162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:38.840162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Checking segment: {'id': '49d23002-af0e-47fe-af58-60e30b337f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:38.840945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:09:38.841021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.841021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Bound using segment: {'id': '49d23002-af0e-47fe-af58-60e30b337f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:38.841021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Bound port: 68085816-de5c-415b-93be-5558699fefc8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '49d23002-af0e-47fe-af58-60e30b337f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '9a49573f-b949-41da-8c25-9ae3174f545b'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:38.841419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.885270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ce4709dd-0183-4ef5-8d07-def42ddb209b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:38.956618 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:38.976957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:38.977852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b4604061-2fe3-4680-b609-e6cc30693f92 None None] Port c758033c-9a4e-4f03-8458-60169ea32e74 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:38.994286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58070) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:38.998688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:39.054064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:39.055793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ce4709dd-0183-4ef5-8d07-def42ddb209b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:39.056277 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.058047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:39.063350 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.068958 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5f409a2f-854d-420f-b471-e177a5f8bc75 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/ports/d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 HTTP/1.1" status: 204 len: 168 time: 0.8448932 Nov 24 04:09:39.071221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58074) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:39.095060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8908b0da-24ad-4159-836c-fd836865157f None None] For port 68085816-de5c-415b-93be-5558699fefc8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:39.098623 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-54011fb3-41b2-4ec6-b1fe-5f583585f6a1 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] GET failed (client error): The resource could not be found. Nov 24 04:09:39.100608 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-54011fb3-41b2-4ec6-b1fe-5f583585f6a1 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "GET /v2.0/ports/d15d91e6-8784-4ebd-928b-ad1b0e1e2ae1 HTTP/1.1" status: 404 len: 333 time: 0.0279167 Nov 24 04:09:39.123251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8908b0da-24ad-4159-836c-fd836865157f None None] For port 68085816-de5c-415b-93be-5558699fefc8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=68085816-de5c-415b-93be-5558699fefc8,segment=NetworkSegment(49d23002-af0e-47fe-af58-60e30b337f6e),segment_id=49d23002-af0e-47fe-af58-60e30b337f6e)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:39.139338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.141225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58076) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:39.317833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8908b0da-24ad-4159-836c-fd836865157f None None] Pushing event updated for resources: {'Port': ['ID=68085816-de5c-415b-93be-5558699fefc8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:39.335110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b153771a-1632-4db9-9584-640ce59ad216 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.340292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.383004 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:39.424150 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port c79bb64a-88fe-43e0-a289-45f4c0fba33b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:39.424657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.452438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.566033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-18d3477f-c598-422d-8474-25588b185259 None None] Provisioning complete for port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:39.566885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-18d3477f-c598-422d-8474-25588b185259 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.610451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-18d3477f-c598-422d-8474-25588b185259 None None] Port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:39.640395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=af108464-aeb6-461a-9325-8e45f71c19dc,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:39.707105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:39.716056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b153771a-1632-4db9-9584-640ce59ad216 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.722752 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-35711cf7-2c73-4e69-bacd-6472afee13b6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "PUT /v2.0/routers/a5d44d1f-24d1-41c1-b30b-40c7e92ea3da/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2741368 Nov 24 04:09:39.722752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': '073ac5b1-c574-4f23-a975-f2ff1405107b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'beab3bda-7c8e-463e-8007-e4bcafe99977'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:39.722752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: beab3bda-7c8e-463e-8007-e4bcafe99977, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:39.723132 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Sync routers for ids ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:39.726840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58082) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:39.742121 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Routers {'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:39.743031 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:39.745560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b153771a-1632-4db9-9584-640ce59ad216 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.819030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network beab3bda-7c8e-463e-8007-e4bcafe99977 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:39.827252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c51b4f7-2928-40c8-bae8-3d313a99d857 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:39.831095 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5c51b4f7-2928-40c8-bae8-3d313a99d857 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports/b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 HTTP/1.1" status: 200 len: 911 time: 0.0990214 Nov 24 04:09:39.833818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58084) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:39.842478 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Set router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:39.850739 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b153771a-1632-4db9-9584-640ce59ad216 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=7458a1b3d1ef4caa8b94349357bffd02&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8529112 Nov 24 04:09:39.851667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b153771a-1632-4db9-9584-640ce59ad216 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c7e4e220-54e0-4f11-9f02-9e2fda7c2c29,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:39.854532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58086) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:39.870103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, beab3bda-7c8e-463e-8007-e4bcafe99977) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:39.874814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:39.875092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:39.881290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84c04892-d68f-4982-9de6-e86e944488cf None None] Network beab3bda-7c8e-463e-8007-e4bcafe99977 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:39.908596 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-48991038-fe31-4669-b80c-fea407aa9cac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 1.5346289 Nov 24 04:09:39.919076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58090) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:40.016414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c1ce5a2-a022-4b57-893b-ef9e0427abd8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.037989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d6f359e-03eb-483f-a005-7fe30a34e106 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:40.046074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d6f359e-03eb-483f-a005-7fe30a34e106 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:40.050788 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2d6f359e-03eb-483f-a005-7fe30a34e106 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.2129996 Nov 24 04:09:40.052106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58092) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:40.060770 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:35Z', 'updated_at': '2021-11-24T04:09:37Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None, '_interfaces': [{'id': 'b6e44a3e-efd0-45df-9087-0ecddfd2a3e5', 'name': '', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'mac_address': 'fa:16:3e:67:03:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'device_owner': 'network:router_interface', 'standard_attr_id': 308, 'fixed_ips': [{'subnet_id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:36Z', 'updated_at': '2021-11-24T04:09:38Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'subnets': [{'id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:40.065880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c1ce5a2-a022-4b57-893b-ef9e0427abd8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.092710 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Checking router: a5d44d1f-24d1-41c1-b30b-40c7e92ea3da for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:40.092974 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Updating router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:09:40.094705 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.120744 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.155656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for c79bb64a-88fe-43e0-a289-45f4c0fba33b owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:40.191394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.327665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c1ce5a2-a022-4b57-893b-ef9e0427abd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.330502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c1ce5a2-a022-4b57-893b-ef9e0427abd8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.331819 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7c1ce5a2-a022-4b57-893b-ef9e0427abd8 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/c7e4e220-54e0-4f11-9f02-9e2fda7c2c29 HTTP/1.1" status: 204 len: 168 time: 0.4763484 Nov 24 04:09:40.349346 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.355945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.357629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c1ce5a2-a022-4b57-893b-ef9e0427abd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7e4e220-54e0-4f11-9f02-9e2fda7c2c29,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:40.375561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-579bf13e-43bd-4749-a649-be3e34337bf9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-beab3bda-7c8e-463e-8007-e4bcafe99977', 'network_id': 'beab3bda-7c8e-463e-8007-e4bcafe99977', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': 'af108464-aeb6-461a-9325-8e45f71c19dc'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:40.377739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-579bf13e-43bd-4749-a649-be3e34337bf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.382505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.404835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.451535 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.468850 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.586474 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Attempting to bind port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:40.587072 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Attempting to bind port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:40.587605 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Attempting to bind port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:40.609317 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:40.609943 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:40.610586 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.611168 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:40.612014 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Bound port: b6e44a3e-efd0-45df-9087-0ecddfd2a3e5, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:40.612609 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.708912 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] For port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:40.713811 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] For port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:40.728727 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.743385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.770497 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37d04df7-1ff0-49aa-a3e5-142b824c8d33 None None] Pushing event updated for resources: {'Port': ['ID=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server [None req-579bf13e-43bd-4749-a649-be3e34337bf9 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet af108464-aeb6-461a-9325-8e45f71c19dc: This subnet is being modified by another concurrent operation. Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 295, in create_dhcp_port Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 115, in _port_action Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:09:40.771845 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exception Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet af108464-aeb6-461a-9325-8e45f71c19dc: This subnet is being modified by another concurrent operation. Nov 24 04:09:40.775221 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:09:40.849133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7cf0204-64b0-4ee1-af6e-4b87b85bf4cd None None] Network beab3bda-7c8e-463e-8007-e4bcafe99977 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:40.879381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Router 6f32a371-4603-4af4-8fd1-deb0d04e6c8d is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:40.935130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 68085816-de5c-415b-93be-5558699fefc8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:40.939851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=af108464-aeb6-461a-9325-8e45f71c19dc,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:40.947253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:40.978846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.024080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.029692 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37d04df7-1ff0-49aa-a3e5-142b824c8d33 None None] Pushing event updated for resources: {'Port': ['ID=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:41.030689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1f883cc-15c9-4d26-9f52-5bf318346eed None None] Network 9a49573f-b949-41da-8c25-9ae3174f545b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:41.062753 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Routers {'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:41.063589 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.068735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58104) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:41.069477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['beab3bda-7c8e-463e-8007-e4bcafe99977']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.099189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '073ac5b1-c574-4f23-a975-f2ff1405107b') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.099743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '073ac5b1-c574-4f23-a975-f2ff1405107b') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.113219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.137023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.146806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 171 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:41.147480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.182546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=c79bb64a-88fe-43e0-a289-45f4c0fba33b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:41.198348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.209916 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-67365a56-dfc7-440b-b76c-4ecd760c11b8 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/ports/c79bb64a-88fe-43e0-a289-45f4c0fba33b HTTP/1.1" status: 204 len: 168 time: 2.0675821 Nov 24 04:09:41.210533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58106) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:41.220806 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] Set router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:41.256470 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:41.279772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.286567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Provisioning complete for port 68085816-de5c-415b-93be-5558699fefc8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:41.286937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.320436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=beab3bda-7c8e-463e-8007-e4bcafe99977,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:41.330865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.340938 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-82becf20-ee4e-4bbb-ae1d-e63b9f1a5eea tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/beab3bda-7c8e-463e-8007-e4bcafe99977 HTTP/1.1" status: 204 len: 168 time: 1.4148595 Nov 24 04:09:41.351163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58108) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:41.353158 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 68085816-de5c-415b-93be-5558699fefc8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:41.353658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.361752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1810937034'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:41.381976 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2a4485ab-68e6-402a-be5e-d6066235d777 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=8f1b322a89f946f19ad1965c373e7b5e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2821298 Nov 24 04:09:41.383774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:41.414803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.418705 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-33b905ef-9ce1-44ae-9538-b4ddfc08ffbd tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "PUT /v2.0/routers/6f32a371-4603-4af4-8fd1-deb0d04e6c8d HTTP/1.1" status: 200 len: 878 time: 4.1021035 Nov 24 04:09:41.418705 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58110) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:41.420797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58112) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:41.457101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] Sync routers for ids ['6f32a371-4603-4af4-8fd1-deb0d04e6c8d'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:41.484505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting subnet 61d2ee7d-2547-416e-acbd-1eae08042687 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:41.488069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.534520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.557854 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:35Z', 'updated_at': '2021-11-24T04:09:37Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None, '_interfaces': [{'id': 'b6e44a3e-efd0-45df-9087-0ecddfd2a3e5', 'name': '', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'mac_address': 'fa:16:3e:67:03:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'device_owner': 'network:router_interface', 'standard_attr_id': 308, 'fixed_ips': [{'subnet_id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:36Z', 'updated_at': '2021-11-24T04:09:40Z', 'revision_number': 4, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'subnets': [{'id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.562272 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] Routers {'6f32a371-4603-4af4-8fd1-deb0d04e6c8d'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:41.563091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6f32a371-4603-4af4-8fd1-deb0d04e6c8d'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.589766 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-729e4545-1471-47a6-8e03-dbc28e52e719 None None] The sync data for ids ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'] in dv-neutron-819049-1-hyperv is: [{'id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:35Z', 'updated_at': '2021-11-24T04:09:37Z', 'revision_number': 2, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None, '_interfaces': [{'id': 'b6e44a3e-efd0-45df-9087-0ecddfd2a3e5', 'name': '', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'mac_address': 'fa:16:3e:67:03:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'device_owner': 'network:router_interface', 'standard_attr_id': 308, 'fixed_ips': [{'subnet_id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:09:36Z', 'updated_at': '2021-11-24T04:09:40Z', 'revision_number': 4, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'subnets': [{'id': 'ffd5ae43-00b3-45a7-8d66-aaec11c4be13', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:41.598397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.650485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-272ec27f-24e9-4ee1-ae2e-5cb2ce1306b8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.665541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.688239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] Routers {'6f32a371-4603-4af4-8fd1-deb0d04e6c8d'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:41.688979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6f32a371-4603-4af4-8fd1-deb0d04e6c8d'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.690903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.717274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-272ec27f-24e9-4ee1-ae2e-5cb2ce1306b8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.759597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:41.760421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2123b0ff-a723-448c-a861-2a359e587ae8 None None] The sync data for ids ['6f32a371-4603-4af4-8fd1-deb0d04e6c8d'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:41.789974 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] For port 68085816-de5c-415b-93be-5558699fefc8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=68085816-de5c-415b-93be-5558699fefc8,segment=NetworkSegment(49d23002-af0e-47fe-af58-60e30b337f6e),segment_id=49d23002-af0e-47fe-af58-60e30b337f6e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:41.792193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.809618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.890950 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.921119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:41.934697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.947729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Provisioning complete for port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:41.948150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.974515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Subnet': ['ID=61d2ee7d-2547-416e-acbd-1eae08042687,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:41.983076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:41.997257 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-50f0f42e-429e-49cf-8fd6-80277f285103 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/subnets/61d2ee7d-2547-416e-acbd-1eae08042687 HTTP/1.1" status: 204 len: 168 time: 0.7704434 Nov 24 04:09:42.001929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58118) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:42.017193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac74c870-092f-43bc-b131-a42412b3eca6 None None] Network 0239996c-49f7-4388-9488-06dcd5d10c2c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:42.017657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-272ec27f-24e9-4ee1-ae2e-5cb2ce1306b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.021714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-272ec27f-24e9-4ee1-ae2e-5cb2ce1306b8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.026642 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-272ec27f-24e9-4ee1-ae2e-5cb2ce1306b8 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/f614f9a4-ec82-4f74-900d-133fd77a88f9 HTTP/1.1" status: 204 len: 168 time: 0.6022503 Nov 24 04:09:42.101806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Pushing event updated for resources: {'Port': ['ID=68085816-de5c-415b-93be-5558699fefc8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:42.111417 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272ec27f-24e9-4ee1-ae2e-5cb2ce1306b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f614f9a4-ec82-4f74-900d-133fd77a88f9,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:42.125478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:09:42.125855 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:09:42.201271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 194, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:42.223382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.223954 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 093a6958-49e9-4323-b76a-e448a82ab409 of type vlan for network 86ab2784-1c7c-49c8-a410-580753aaecdb Nov 24 04:09:42.225736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.299111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.326129 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b2e4b3ce-3d22-4605-8d87-7b85c79667c8 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/6f32a371-4603-4af4-8fd1-deb0d04e6c8d HTTP/1.1" status: 200 len: 919 time: 0.8727150 Nov 24 04:09:42.333411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58124) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:42.395915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.422194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.448547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.453052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Deleting port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:42.453399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.470953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5fa091b-35a3-459f-80d8-e44fd36eb658 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:42.476831 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f5fa091b-35a3-459f-80d8-e44fd36eb658 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=6f32a371-4603-4af4-8fd1-deb0d04e6c8d&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1402552 Nov 24 04:09:42.483297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58128) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:42.484195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] For port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:42.493148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.558008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.564745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:42.565613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.593201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3469f68e-4025-4d40-ba08-ba338673d843 None None] Pushing event updated for resources: {'Port': ['ID=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:42.600823 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] DHCP port deletion for 0239996c-49f7-4388-9488-06dcd5d10c2c request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:42.665305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] For port 00c2ffe4-6ef6-41ba-b428-ca62c6002237, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=00c2ffe4-6ef6-41ba-b428-ca62c6002237,segment=NetworkSegment(612ae7b6-3eea-4071-bb84-a200e62ebe64),segment_id=612ae7b6-3eea-4071-bb84-a200e62ebe64)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:42.665829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.697355 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.3446095 Nov 24 04:09:42.700669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58134) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:42.708142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5dfb1d42-ca05-43ac-9c61-1c4408686b82 None None] Provisioning complete for port 68085816-de5c-415b-93be-5558699fefc8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:42.709135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5dfb1d42-ca05-43ac-9c61-1c4408686b82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.715525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:42.765122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc1b224-7dd9-426d-bd06-f592cccfabdd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=86ab2784-1c7c-49c8-a410-580753aaecdb,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:42.782942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Calling delete_port for 00c2ffe4-6ef6-41ba-b428-ca62c6002237 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:42.784930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 86ab2784-1c7c-49c8-a410-580753aaecdb details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:42.867738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] Deleting port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:42.868352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.913504 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:42.917158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.939946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:42.940652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.956942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] For port 00c2ffe4-6ef6-41ba-b428-ca62c6002237, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=00c2ffe4-6ef6-41ba-b428-ca62c6002237,segment=NetworkSegment(612ae7b6-3eea-4071-bb84-a200e62ebe64),segment_id=612ae7b6-3eea-4071-bb84-a200e62ebe64)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:42.957605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:42.973467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] Calling delete_port for 00c2ffe4-6ef6-41ba-b428-ca62c6002237 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:43.074529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10e12949-fadb-4cb9-a15f-3a718426044f tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:43.080705 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-10e12949-fadb-4cb9-a15f-3a718426044f tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.5963750 Nov 24 04:09:43.081461 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58144) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:43.138657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] For port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:43.139163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.161741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:43.176634 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-39f9ecd6-0733-45e0-a131-fb376c35027c tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=6f32a371-4603-4af4-8fd1-deb0d04e6c8d HTTP/1.1" status: 200 len: 205 time: 0.0938475 Nov 24 04:09:43.179824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58150) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:43.232240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.262584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.270990 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Port': ['ID=00c2ffe4-6ef6-41ba-b428-ca62c6002237,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:43.280755 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:43.283060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] No DVR routers for this DVR port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:43.385555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58156) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:43.401978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] No DVR routers for this DVR port 00c2ffe4-6ef6-41ba-b428-ca62c6002237 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:43.411852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b42e3487-9453-499c-a309-b2d6b77a0277 None None] Pushing event deleted for resources: {'Port': ['ID=00c2ffe4-6ef6-41ba-b428-ca62c6002237,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:43.413781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.421310 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5dfb1d42-ca05-43ac-9c61-1c4408686b82 None None] Provisioning complete for port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:43.421684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5dfb1d42-ca05-43ac-9c61-1c4408686b82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.454439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5da90c1-f3e2-49ee-87ad-e383f25b0fcd None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:09:43.495294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:43.495601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.519771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.549306 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-3ced0f3d-ed48-409d-a83d-619d278dc2b0 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2121258 Nov 24 04:09:43.576079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0239996c-49f7-4388-9488-06dcd5d10c2c']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:43.599043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-283209699'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:43.608689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=8c55ca26-c5a1-43b5-83c0-5afdab99fa63,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:43.623487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '612ae7b6-3eea-4071-bb84-a200e62ebe64') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:43.623924 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '612ae7b6-3eea-4071-bb84-a200e62ebe64') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:43.644297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.660627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': '093a6958-49e9-4323-b76a-e448a82ab409', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 194, 'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:43.661140 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: 86ab2784-1c7c-49c8-a410-580753aaecdb, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:43.676136 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.687917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:43.691675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.696325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Releasing vlan 169 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:43.697053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:43.704347 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:43.726097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 86ab2784-1c7c-49c8-a410-580753aaecdb is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:43.735050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.737929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.767306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 68085816-de5c-415b-93be-5558699fefc8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:43.800301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 86ab2784-1c7c-49c8-a410-580753aaecdb) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:43.803275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-cba6e4fc-8cd4-4aaf-b258-cc0b12294737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:43.804778 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-cba6e4fc-8cd4-4aaf-b258-cc0b12294737 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.1244397 Nov 24 04:09:43.805433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.811244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:43.811793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.828785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.840777 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b2d4d236-03f2-460b-9c7d-2406969d5047 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 1.1282697 Nov 24 04:09:43.842816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58162) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:43.844822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.848143 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] 10.222.0.48 "DELETE /v2.0/networks/0239996c-49f7-4388-9488-06dcd5d10c2c HTTP/1.1" status: 204 len: 168 time: 1.8450627 Nov 24 04:09:43.864320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23f3663-1ff2-4436-bf45-c7306d2dfe31 tempest-AllowedAddressPairIpV6TestJSON-1996051664 tempest-AllowedAddressPairIpV6TestJSON-1996051664-project] Pushing event deleted for resources: {'Network': ['ID=0239996c-49f7-4388-9488-06dcd5d10c2c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:43.924111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=b6e44a3e-efd0-45df-9087-0ecddfd2a3e5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:43.929588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5da90c1-f3e2-49ee-87ad-e383f25b0fcd None None] Unable to find a vacant binding_index for network 86ab2784-1c7c-49c8-a410-580753aaecdb and agent 2017f21b-d647-4a6e-b306-49195b4c6afd {{(pid=103382) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 24 04:09:43.937001 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 68085816-de5c-415b-93be-5558699fefc8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:43.940477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.943770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5da90c1-f3e2-49ee-87ad-e383f25b0fcd None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 86ab2784-1c7c-49c8-a410-580753aaecdb) {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:09:43.943902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.951339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.980152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] vlan segment allocate from pool success with {'vlan_id': 189, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:43.995715 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:43.996068 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Added segment 5523fa93-94f7-413e-8471-cf3c22a7a3da of type vlan for network a47a2785-1e21-4a90-b046-5bf9f26ab1aa Nov 24 04:09:44.078819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.131484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'SecurityGroup': ['ID=42736ac5-448b-4f73-83a3-03b5753bdb67,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:44.138238 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.158935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:44.159543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.160373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.168862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.244224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-55e86033-9103-4107-8c7e-31ae82a57a3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:44.245941 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-55e86033-9103-4107-8c7e-31ae82a57a3f service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.4007878 Nov 24 04:09:44.252463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.253359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Network': ['ID=a47a2785-1e21-4a90-b046-5bf9f26ab1aa,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:44.280465 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-344bf659-c7cf-427e-a82b-d7ddee139ebd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.8914819 Nov 24 04:09:44.283472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:44.283715 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58170) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:44.285422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 00c2ffe4-6ef6-41ba-b428-ca62c6002237 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:44.291939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'subnet': {'network_id': 'a47a2785-1e21-4a90-b046-5bf9f26ab1aa', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:44.332534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58172) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:44.345633 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 00c2ffe4-6ef6-41ba-b428-ca62c6002237 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:44.345976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 00c2ffe4-6ef6-41ba-b428-ca62c6002237 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:44.380526 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:09:44.438801 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-dd350794-28fa-47d4-a8ff-256c35c8649e service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1001 time: 0.1788201 Nov 24 04:09:44.443531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:44.447089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.447491 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-86ab2784-1c7c-49c8-a410-580753aaecdb', 'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '8c55ca26-c5a1-43b5-83c0-5afdab99fa63'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:44.449603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.522635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Deleting port c758033c-9a4e-4f03-8458-60169ea32e74 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:44.522974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.572910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.644606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:44.661837 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Allocated IP 2001:db8::1 (86ab2784-1c7c-49c8-a410-580753aaecdb/8c55ca26-c5a1-43b5-83c0-5afdab99fa63/2085cee8-13ae-48ff-924e-af72ec6aa05e) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:44.662996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-f46cffde-d4ca-4b19-bbfa-8d1bed66d6da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:44.664454 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-f46cffde-d4ca-4b19-bbfa-8d1bed66d6da service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.1582665 Nov 24 04:09:44.719353 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1222dec8-4f65-45b3-b5ca-fb92e2e3e1b5 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=d10ac043d90d4ae1a587a0fe1fc513d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3832295 Nov 24 04:09:44.719353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.721492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58180) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:44.759682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.824963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Subnet': ['ID=2f7d8ed8-b820-4cb9-a339-78c29b4488cf,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:44.831420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Checking segment: {'id': '5523fa93-94f7-413e-8471-cf3c22a7a3da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'a47a2785-1e21-4a90-b046-5bf9f26ab1aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:44.831994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.832116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network hostable DHCP agents. Network: a47a2785-1e21-4a90-b046-5bf9f26ab1aa, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:44.843313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.860589 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76f2d0be-f8b0-4c74-afa3-3919d6a79fda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.874392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:44.893308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76f2d0be-f8b0-4c74-afa3-3919d6a79fda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.896614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Network 86ab2784-1c7c-49c8-a410-580753aaecdb is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:44.901440 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, a47a2785-1e21-4a90-b046-5bf9f26ab1aa) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:44.910056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:44.910858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.914914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:44.927094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:44.946214 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f604a8c0-2be6-4d3e-8d6f-eb971bae653e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 0.6603262 Nov 24 04:09:44.948137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58182) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:44.953919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-810481541', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:44.978534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Pushing event updated for resources: {'Port': ['ID=2085cee8-13ae-48ff-924e-af72ec6aa05e,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:44.982493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.983768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.988988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76f2d0be-f8b0-4c74-afa3-3919d6a79fda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.991576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76f2d0be-f8b0-4c74-afa3-3919d6a79fda admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:44.995337 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-76f2d0be-f8b0-4c74-afa3-3919d6a79fda admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/a9fcfe6a-d533-484b-be97-7f629d915a44 HTTP/1.1" status: 204 len: 168 time: 0.2668958 Nov 24 04:09:45.007660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f2d0be-f8b0-4c74-afa3-3919d6a79fda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9fcfe6a-d533-484b-be97-7f629d915a44,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:45.034180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Attempting to bind port 2085cee8-13ae-48ff-924e-af72ec6aa05e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:45.034577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Attempting to bind port 2085cee8-13ae-48ff-924e-af72ec6aa05e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '093a6958-49e9-4323-b76a-e448a82ab409', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 194, 'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:45.034955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Attempting to bind port 2085cee8-13ae-48ff-924e-af72ec6aa05e on network 86ab2784-1c7c-49c8-a410-580753aaecdb {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:45.047814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:45.048203 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Checking segment: {'id': '093a6958-49e9-4323-b76a-e448a82ab409', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 194, 'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:45.048763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.049179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Bound using segment: {'id': '093a6958-49e9-4323-b76a-e448a82ab409', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 194, 'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:45.049678 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Bound port: 2085cee8-13ae-48ff-924e-af72ec6aa05e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '093a6958-49e9-4323-b76a-e448a82ab409', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 194, 'network_id': '86ab2784-1c7c-49c8-a410-580753aaecdb'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:45.050070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.060862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.112173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Calling delete_port for c758033c-9a4e-4f03-8458-60169ea32e74 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:45.122377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:45.129931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] For port 2085cee8-13ae-48ff-924e-af72ec6aa05e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:45.132132 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] Sync routers for ids ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:45.133574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] For port 2085cee8-13ae-48ff-924e-af72ec6aa05e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=2085cee8-13ae-48ff-924e-af72ec6aa05e,segment=NetworkSegment(093a6958-49e9-4323-b76a-e448a82ab409),segment_id=093a6958-49e9-4323-b76a-e448a82ab409)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:45.135475 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-815cda7f-5db2-4e1d-b35c-701717ba8419 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "PUT /v2.0/routers/a5d44d1f-24d1-41c1-b30b-40c7e92ea3da/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0830154 Nov 24 04:09:45.140747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58186) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:45.144875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.145721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.147721 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] Routers {'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:45.153901 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.251391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=8c55ca26-c5a1-43b5-83c0-5afdab99fa63,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:45.255443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-e5851470-6691-46e2-9e4b-30d9574823d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:45.257183 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-e5851470-6691-46e2-9e4b-30d9574823d0 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.5621986 Nov 24 04:09:45.265188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba698be4-f4cb-49bf-843b-ae32ce05a143 None None] Pushing event updated for resources: {'Port': ['ID=2085cee8-13ae-48ff-924e-af72ec6aa05e,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:45.325833 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] Set router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:45.336594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.395184 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:35Z', 'updated_at': '2021-11-24T04:09:43Z', 'revision_number': 3, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.427524 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] Checking router: a5d44d1f-24d1-41c1-b30b-40c7e92ea3da for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:09:45.432462 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b1c82e7-f8ed-4453-8949-d1ad0dc82ec5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:45.434719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b1c82e7-f8ed-4453-8949-d1ad0dc82ec5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:45.436552 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b1c82e7-f8ed-4453-8949-d1ad0dc82ec5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2938442 Nov 24 04:09:45.441133 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] Routers {'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:45.441887 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.461493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58196) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:45.523628 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] Set router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:09:45.553465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet ffd5ae43-00b3-45a7-8d66-aaec11c4be13 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:45.563894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.618449 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:35Z', 'updated_at': '2021-11-24T04:09:43Z', 'revision_number': 3, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.677787 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a1c837f-789b-4a9d-a2ce-0f4b0b97091c None None] The sync data for ids ['a5d44d1f-24d1-41c1-b30b-40c7e92ea3da'] in dv-neutron-819049-1-hyperv is: [{'id': 'a5d44d1f-24d1-41c1-b30b-40c7e92ea3da', 'name': 'tempest-NetworksTestDHCPv6-router-2071499446', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:09:35Z', 'updated_at': '2021-11-24T04:09:43Z', 'revision_number': 3, 'project_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:45.681624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.717478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.771436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.824555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.831164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.868054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.136 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/9b8e9f28-d49a-41d5-ab8b-1b403fdd0826) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:45.920078 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event deleted for resources: {'Port': ['ID=c758033c-9a4e-4f03-8458-60169ea32e74,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:45.938919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86ab2784-1c7c-49c8-a410-580753aaecdb']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.973818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '093a6958-49e9-4323-b76a-e448a82ab409') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.974217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '093a6958-49e9-4323-b76a-e448a82ab409') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:45.988914 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-b89f7aec-9842-4fa2-9cc5-b1d46ab232c9 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7174020 Nov 24 04:09:45.990790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:45.993347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.011390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.056158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.111500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.111624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:46.114902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:46.130376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 194 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:46.130791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.132201 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:46.135202 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:46.181662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=9b8e9f28-d49a-41d5-ab8b-1b403fdd0826,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:46.331890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.362936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58214) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:46.371758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.api [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:09:46.371758 dv-neutron-819049-1-hyperv neutron-server[103381]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:09:46.371758 dv-neutron-819049-1-hyperv neutron-server[103381]: [parameters: {'id': '86ab2784-1c7c-49c8-a410-580753aaecdb'}] Nov 24 04:09:46.371758 dv-neutron-819049-1-hyperv neutron-server[103381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103381) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:09:46.372163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG oslo_db.api [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:09:46.424621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.496425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9f124ba6-4198-44aa-9b35-26b45f6cffe1 req-5ee11f4a-e4c0-4752-b7f5-e3d2382a7556 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4816473 Nov 24 04:09:46.497142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=ffd5ae43-00b3-45a7-8d66-aaec11c4be13,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:46.500673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.504681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.506986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.513144 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dfb25feb-f72c-48cb-b8d7-7411bd91f4cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ffd5ae43-00b3-45a7-8d66-aaec11c4be13 HTTP/1.1" status: 204 len: 168 time: 1.0474143 Nov 24 04:09:46.513336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58220) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:46.625717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb4db50e-3b43-48cb-8fa2-c0cbb482d112 None None] Network 86ab2784-1c7c-49c8-a410-580753aaecdb requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:46.646402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.646921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Fanout notify agent at l3_agent the message router_deleted on router 6f32a371-4603-4af4-8fd1-deb0d04e6c8d {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:46.654656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.659621 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-165fd273-9fad-4bcf-a07c-c50466c1e8cc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/6f32a371-4603-4af4-8fd1-deb0d04e6c8d HTTP/1.1" status: 204 len: 168 time: 3.4738712 Nov 24 04:09:46.663129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58224) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:46.672263 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aeffdf6f-1196-499b-bab8-b5d801fe095e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.1578476 Nov 24 04:09:46.676661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1809907576', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:46.681424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58226) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:46.760118 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f137443-1cc3-4964-9d17-25d421d176b0 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:46.766192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e538065-b71b-4c88-804b-8c5e9d36246e None None] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:46.772657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.806751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-334398918'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:46.811867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.812897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.833015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6048730-699c-4ab6-a957-5b288ec21daa None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:46.841262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:46.845149 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.851296 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ed8f414f-6ccc-422b-be65-8ee263e37f64 None None] Provisioning complete for port 2085cee8-13ae-48ff-924e-af72ec6aa05e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:46.852155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ed8f414f-6ccc-422b-be65-8ee263e37f64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.862345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:46.898320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.022875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 2085cee8-13ae-48ff-924e-af72ec6aa05e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:47.035113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.056244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-695e3772-3235-4735-a266-ecf35cf2c40a None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:47.076693 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.084659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.147555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] vlan segment allocate from pool success with {'vlan_id': 170, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:47.152664 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.154881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.157102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.169955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.173683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.174107 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Added segment 40e5aef9-04c6-425a-9f18-ed721c14f46c of type vlan for network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf Nov 24 04:09:47.175222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8df1db4d-4596-4d61-8b2d-4d0142b52107 None None] Network 86ab2784-1c7c-49c8-a410-580753aaecdb requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:47.175418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82bfd2d0-fdbd-4cea-9229-689316b1d5a7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:47.186717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ed8f414f-6ccc-422b-be65-8ee263e37f64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.229048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.232775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.234405 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-39e8e8b3-3aa3-41a1-863f-4ab22b8d4915 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.5610380 Nov 24 04:09:47.237225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58234) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:47.241609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': True}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:47.244773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.245275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Fanout notify agent at l3_agent the message router_deleted on router a5d44d1f-24d1-41c1-b30b-40c7e92ea3da {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:47.252937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.254222 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5320c12e-5bbb-46cb-9f72-79005f940aff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/routers/a5d44d1f-24d1-41c1-b30b-40c7e92ea3da HTTP/1.1" status: 204 len: 168 time: 0.5717342 Nov 24 04:09:47.257204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting port 2085cee8-13ae-48ff-924e-af72ec6aa05e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:47.257809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.279154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58236) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:47.359138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.364971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:47.365577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.371511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20d4179c-f038-4ea3-9fff-55c79d6cdc6a None None] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:47.415940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 2085cee8-13ae-48ff-924e-af72ec6aa05e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:47.415940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.436356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ed8f414f-6ccc-422b-be65-8ee263e37f64 None None] For port 2085cee8-13ae-48ff-924e-af72ec6aa05e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=2085cee8-13ae-48ff-924e-af72ec6aa05e,segment=NetworkSegment(093a6958-49e9-4323-b76a-e448a82ab409),segment_id=093a6958-49e9-4323-b76a-e448a82ab409)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:47.437210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9737c2d6-8bc6-451e-9119-b4d28da1dd5e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:47.441845 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9737c2d6-8bc6-451e-9119-b4d28da1dd5e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1601949 Nov 24 04:09:47.461057 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.0815887 Nov 24 04:09:47.461057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58238) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:47.482425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.539625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2a1243-4cc0-4d70-b6a4-7c1ff88d2a33 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Network': ['ID=6ec1f6c2-69cf-492f-9b2e-e197f9c60baf,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:47.600600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.633652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34b7dc4a-97e0-497f-aa65-701f3cc0efe9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:47.638740 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-34b7dc4a-97e0-497f-aa65-701f3cc0efe9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1652248 Nov 24 04:09:47.639691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58242) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:47.640465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] For port 2085cee8-13ae-48ff-924e-af72ec6aa05e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=2085cee8-13ae-48ff-924e-af72ec6aa05e,segment=NetworkSegment(093a6958-49e9-4323-b76a-e448a82ab409),segment_id=093a6958-49e9-4323-b76a-e448a82ab409)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:47.640890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.674558 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ed8f414f-6ccc-422b-be65-8ee263e37f64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.686675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:47.689001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Calling delete_port for 2085cee8-13ae-48ff-924e-af72ec6aa05e owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:47.718758 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0edf7ddd-a4eb-481d-97d4-78e6583a5d34 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0754273 Nov 24 04:09:47.724338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58244) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:47.730342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:47.833882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:47.857497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:47.861861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:47.866695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:47.938913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8f414f-6ccc-422b-be65-8ee263e37f64 None None] Pushing event updated for resources: {'Port': ['ID=2085cee8-13ae-48ff-924e-af72ec6aa05e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:47.993621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f9af6c0d-3339-445f-b1b4-513e702b341a None None] Provisioning complete for port 9b8e9f28-d49a-41d5-ab8b-1b403fdd0826 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:47.994112 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f9af6c0d-3339-445f-b1b4-513e702b341a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.027321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] DHCP port deletion for 86ab2784-1c7c-49c8-a410-580753aaecdb request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:48.090679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f9af6c0d-3339-445f-b1b4-513e702b341a None None] Port 9b8e9f28-d49a-41d5-ab8b-1b403fdd0826 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:48.093654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:48.095001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.122430 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.135788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:48.136159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b6e44a3e-efd0-45df-9087-0ecddfd2a3e5 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:48.148353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] Deleting port ce4709dd-0183-4ef5-8d07-def42ddb209b {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:48.149275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.219657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.228555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Deleting port 2085cee8-13ae-48ff-924e-af72ec6aa05e {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:48.229268 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.232527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:48.259631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:48.267832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Port': ['ID=2085cee8-13ae-48ff-924e-af72ec6aa05e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:48.282861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.284480 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f41d9726-e499-4eb2-af22-614d00108c15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.3349428 Nov 24 04:09:48.290068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58250) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:48.301710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] For port ce4709dd-0183-4ef5-8d07-def42ddb209b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ce4709dd-0183-4ef5-8d07-def42ddb209b,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:48.302406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.306396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No DVR routers for this DVR port 2085cee8-13ae-48ff-924e-af72ec6aa05e on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:48.366930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] Calling delete_port for ce4709dd-0183-4ef5-8d07-def42ddb209b owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:48.389642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:48.391361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.409485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.431605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] For port 2085cee8-13ae-48ff-924e-af72ec6aa05e, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:48.432371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.436969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.438673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86ab2784-1c7c-49c8-a410-580753aaecdb']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.450074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '093a6958-49e9-4323-b76a-e448a82ab409') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.450413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '093a6958-49e9-4323-b76a-e448a82ab409') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.460343 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.479320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.491634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Calling delete_port for 2085cee8-13ae-48ff-924e-af72ec6aa05e owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:48.495140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 194 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:48.495549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.500182 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Port 2085cee8-13ae-48ff-924e-af72ec6aa05e was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:48.501411 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:48.506674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:48.507706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.512743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.523813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Allocated IP 172.26.5.200 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/e15a165e-95f7-42d2-96dc-eaf35be0f97b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:48.585611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] Pushing event deleted for resources: {'Port': ['ID=2085cee8-13ae-48ff-924e-af72ec6aa05e,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:48.600902 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:48.601862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7b73e9-7dd2-45ef-b438-7ff8a48ce2fd None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:48.607799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.620063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcfea9f5-d2dd-4553-a657-d5492f59bc3a None None] No DVR routers for this DVR port 2085cee8-13ae-48ff-924e-af72ec6aa05e on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:48.627916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.644854 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/86ab2784-1c7c-49c8-a410-580753aaecdb HTTP/1.1" status: 204 len: 168 time: 4.7970128 Nov 24 04:09:48.649732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58254) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:48.666930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-134017627'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:48.681859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.716882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] Pushing event deleted for resources: {'Port': ['ID=ce4709dd-0183-4ef5-8d07-def42ddb209b,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:48.733253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99ad4d5b-daff-48f3-9d42-96da138b363f None None] No DVR routers for this DVR port ce4709dd-0183-4ef5-8d07-def42ddb209b on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:09:48.758780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:09:48.763044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.852111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:48.858231 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:48.866140 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:48.866765 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:48.875451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75d82d2c-d8b5-4253-aab7-afdf8ce60a10 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:48.891717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:48.899807 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e75350cf-f29b-4007-ab3b-89569cd93591 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.1741719 Nov 24 04:09:48.903189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58256) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:48.908954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:49.013500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cc5577-d2b2-4d0b-9e77-9697d4a681fd tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=86ab2784-1c7c-49c8-a410-580753aaecdb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:49.045653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 2085cee8-13ae-48ff-924e-af72ec6aa05e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:49.052276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:49.057165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.075221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 2085cee8-13ae-48ff-924e-af72ec6aa05e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:49.075593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 2085cee8-13ae-48ff-924e-af72ec6aa05e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:49.076072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ce4709dd-0183-4ef5-8d07-def42ddb209b no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:49.094125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.105257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 196, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:49.108275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ce4709dd-0183-4ef5-8d07-def42ddb209b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:09:49.108676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ce4709dd-0183-4ef5-8d07-def42ddb209b not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:09:49.125402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.125762 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment f147a08e-60d7-4580-86b4-861556807355 of type vlan for network d668fe39-f315-48ad-a281-ce3c1e32a77d Nov 24 04:09:49.181090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.190375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.221231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:49.222202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.248846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:49.259994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:49.277432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:49.292051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.298775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:49.299154 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.338554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Port': ['ID=e15a165e-95f7-42d2-96dc-eaf35be0f97b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:49.384931 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.7340779 Nov 24 04:09:49.397204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58262) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:49.397785 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62da2c2e-ecda-417a-b270-629417cf12b0 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:49.407995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': 'd668fe39-f315-48ad-a281-ce3c1e32a77d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:49.444804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:49.450283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.461112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75730b30-7dc8-4cce-9c5c-dc0b29d298f9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=d668fe39-f315-48ad-a281-ce3c1e32a77d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:49.482900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network d668fe39-f315-48ad-a281-ce3c1e32a77d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:49.561277 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1c249512-8de5-4f50-9eac-3cbcb6a09f00 None None] Provisioning complete for port e15a165e-95f7-42d2-96dc-eaf35be0f97b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:49.561657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c249512-8de5-4f50-9eac-3cbcb6a09f00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.623686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Allocated IP 2001:db8::f816:3eff:fe24:ffcf (a2b36c78-43a6-4954-8102-cb5638999bb1/b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d/853e0fd0-2955-4f20-ac09-7a3095b390ce) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:49.625721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1c249512-8de5-4f50-9eac-3cbcb6a09f00 None None] Port e15a165e-95f7-42d2-96dc-eaf35be0f97b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:49.690682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.698611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.798923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.807330 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.866103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Pushing event updated for resources: {'Port': ['ID=853e0fd0-2955-4f20-ac09-7a3095b390ce,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:49.897146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:49.900284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:49.912569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:49.945877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:49.950252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.000269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Attempting to bind port 853e0fd0-2955-4f20-ac09-7a3095b390ce on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:50.001419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Attempting to bind port 853e0fd0-2955-4f20-ac09-7a3095b390ce by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:50.002010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Attempting to bind port 853e0fd0-2955-4f20-ac09-7a3095b390ce on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:50.010698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:50.011389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:50.012481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.013026 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:50.013645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Bound port: 853e0fd0-2955-4f20-ac09-7a3095b390ce, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:50.014222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.099151 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] For port 853e0fd0-2955-4f20-ac09-7a3095b390ce, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:50.099767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Router ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:09:50.102630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] For port 853e0fd0-2955-4f20-ac09-7a3095b390ce, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=853e0fd0-2955-4f20-ac09-7a3095b390ce,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:50.110687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.179848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4045475d-8545-4e3b-9c88-7dc4188f4cc0 None None] Pushing event updated for resources: {'Port': ['ID=853e0fd0-2955-4f20-ac09-7a3095b390ce,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:50.186564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:50.190190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.278486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:50.291926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.294169 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] Sync routers for ids ['ca97f8f3-3f7b-497f-875f-fdb9fd4e7193'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:50.298742 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-52cca570-cab2-4610-829d-672c75b44659 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "PUT /v2.0/routers/ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 HTTP/1.1" status: 200 len: 915 time: 3.0591793 Nov 24 04:09:50.300181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58266) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:50.314989 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] Routers {'ca97f8f3-3f7b-497f-875f-fdb9fd4e7193'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:50.316059 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ca97f8f3-3f7b-497f-875f-fdb9fd4e7193'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:50.378862 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:50.396442 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] Routers {'ca97f8f3-3f7b-497f-875f-fdb9fd4e7193'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:50.397129 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ca97f8f3-3f7b-497f-875f-fdb9fd4e7193'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:50.461682 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6b51d4c9-50e5-47a3-a42c-24f7c64f5ac0 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 HTTP/1.1" status: 200 len: 921 time: 0.1554248 Nov 24 04:09:50.461682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58272) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:50.490675 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:50.493272 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c63b3b1d-c0de-42b9-82ee-88be14460936 None None] The sync data for ids ['ca97f8f3-3f7b-497f-875f-fdb9fd4e7193'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:50.688962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a4de8be-6a0e-4a58-8f03-2d830d0d0ccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:50.691242 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2a4de8be-6a0e-4a58-8f03-2d830d0d0ccb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=ca97f8f3-3f7b-497f-875f-fdb9fd4e7193&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1929300 Nov 24 04:09:50.708197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58276) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:50.789304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed3b5de-ee52-4d70-893c-4264bbc8f12f req-8b9f689e-b769-4e6d-9af8-1067761bc11c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:50.799838 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aed3b5de-ee52-4d70-893c-4264bbc8f12f req-8b9f689e-b769-4e6d-9af8-1067761bc11c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1429412 Nov 24 04:09:50.815143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58278) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:50.820874 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'subnet': {'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:50.823015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.911686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:50.921165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.925504 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.1 (a47a2785-1e21-4a90-b046-5bf9f26ab1aa/2f7d8ed8-b820-4cb9-a339-78c29b4488cf/9c22bb44-3211-49e7-bcde-f7d29f0a526d) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:50.927733 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:50.940037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:50.940652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:50.941723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 853e0fd0-2955-4f20-ac09-7a3095b390ce up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:50.947240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef738366-c354-4d10-aab7-676974239550 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:50.950511 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ef738366-c354-4d10-aab7-676974239550 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.2384758 Nov 24 04:09:50.951466 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58282) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:50.952935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=8a4ffb10-1a31-4ecd-9b76-1baf8ea21076,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:50.956297 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aed3b5de-ee52-4d70-893c-4264bbc8f12f req-533fa2aa-943d-484f-9fd6-92653fd13446 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1552441 Nov 24 04:09:50.998192 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7586d204-edbd-49e4-bb52-9756c2a60a16 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 HTTP/1.1" status: 200 len: 205 time: 0.0333493 Nov 24 04:09:50.999323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58284) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:51.005038 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e72cdb28-188e-4568-b67a-251e9e27fc22 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1006966 Nov 24 04:09:51.005545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58288) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:51.012311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:55:72:83', 'name': 'tempest-NetworksTestDHCPv6-1965752941'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:51.016126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:51.019557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.066687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 853e0fd0-2955-4f20-ac09-7a3095b390ce triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:51.067542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.087742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=21b77914-7e45-44eb-a4cd-2bd05f5a8f16,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:51.121349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': 'f147a08e-60d7-4580-86b4-861556807355', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'd668fe39-f315-48ad-a281-ce3c1e32a77d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:51.121741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: d668fe39-f315-48ad-a281-ce3c1e32a77d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:51.184857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.186435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network d668fe39-f315-48ad-a281-ce3c1e32a77d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:51.201216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, d668fe39-f315-48ad-a281-ce3c1e32a77d) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:51.207900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:51.208556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.229326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6e679c8-6f0a-4211-9142-59d9d96229b6 None None] Network d668fe39-f315-48ad-a281-ce3c1e32a77d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:51.246862 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a8d6a5d4-9789-4fd1-9f0f-ed1dc55112e4 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.8466008 Nov 24 04:09:51.249460 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58292) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:51.257926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.264747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.360757 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:51.398114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:51.407175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:51.440765 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=9c22bb44-3211-49e7-bcde-f7d29f0a526d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:51.457048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 853e0fd0-2955-4f20-ac09-7a3095b390ce, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=853e0fd0-2955-4f20-ac09-7a3095b390ce,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:51.464374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.494620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d255f7-51ac-4aa4-b6e9-becbd19fcd42 req-cfb321e6-29a6-4274-88c0-4d3314869e39 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:51.495215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.497484 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c5d255f7-51ac-4aa4-b6e9-becbd19fcd42 req-cfb321e6-29a6-4274-88c0-4d3314869e39 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1716948 Nov 24 04:09:51.506096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.524557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.528518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-419d2b5c-304c-4e49-b4bf-34a09520aefa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-d668fe39-f315-48ad-a281-ce3c1e32a77d', 'network_id': 'd668fe39-f315-48ad-a281-ce3c1e32a77d', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '21b77914-7e45-44eb-a4cd-2bd05f5a8f16'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:51.529399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-419d2b5c-304c-4e49-b4bf-34a09520aefa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.549515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=853e0fd0-2955-4f20-ac09-7a3095b390ce,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:51.617483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.680456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:51.712925 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c5d255f7-51ac-4aa4-b6e9-becbd19fcd42 req-1df389f0-b1be-4bc1-a1bd-bccd2e9de2a9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1453042 Nov 24 04:09:51.725873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.729749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Subnet': ['ID=d612e6a2-304d-4720-9d39-9d84aa8f3122,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:51.785850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.797805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Checking segment: {'id': '40e5aef9-04c6-425a-9f18-ed721c14f46c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:51.798161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network hostable DHCP agents. Network: 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:51.835404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.842739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.846548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beadb425-7dae-4d4e-818e-78e1a0be8855 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:51.870095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:51.894389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:51.897102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.900326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:51.916497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:51.917084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.945546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a41f5890-9ff5-455a-a28d-b66e91a18f7f None None] Network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:51.949489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=21b77914-7e45-44eb-a4cd-2bd05f5a8f16,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server [None req-419d2b5c-304c-4e49-b4bf-34a09520aefa None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 21b77914-7e45-44eb-a4cd-2bd05f5a8f16: This subnet is being modified by another concurrent operation. Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 295, in create_dhcp_port Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 115, in _port_action Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:09:51.951698 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exception Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 21b77914-7e45-44eb-a4cd-2bd05f5a8f16: This subnet is being modified by another concurrent operation. Nov 24 04:09:51.954690 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:09:51.976429 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Deleting port e15a165e-95f7-42d2-96dc-eaf35be0f97b {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:51.976831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:51.995043 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b065d04-67e8-43a2-9124-789e2d5740c0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.1787877 Nov 24 04:09:52.001402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58300) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:52.018208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-771750002'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:52.025862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.049494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-310dd979-c4c7-4976-9067-f5efb57e0219 None None] Network d668fe39-f315-48ad-a281-ce3c1e32a77d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:52.050703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d668fe39-f315-48ad-a281-ce3c1e32a77d']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:52.074178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8dad2d89-4de5-485a-bbfb-8f8933d19205 None None] Provisioning complete for port 853e0fd0-2955-4f20-ac09-7a3095b390ce triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:52.074570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8dad2d89-4de5-485a-bbfb-8f8933d19205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.102074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f147a08e-60d7-4580-86b4-861556807355') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:52.102432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f147a08e-60d7-4580-86b4-861556807355') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:52.116061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.128930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.145024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.149801 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Calling delete_port for e15a165e-95f7-42d2-96dc-eaf35be0f97b owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:52.197315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 196 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:09:52.197860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:09:52.201487 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:09:52.289064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.311134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.319750 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/d668fe39-f315-48ad-a281-ce3c1e32a77d HTTP/1.1" status: 204 len: 168 time: 1.0681527 Nov 24 04:09:52.320707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6ce1a7-2da8-4c0a-b8c8-ba16b6b0fcda tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=d668fe39-f315-48ad-a281-ce3c1e32a77d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:52.333029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58308) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:52.339635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1660062949'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:52.361364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.369338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:52.373858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.429589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event deleted for resources: {'Port': ['ID=e15a165e-95f7-42d2-96dc-eaf35be0f97b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:52.449928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:52.454221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.456689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff1e66ba-251a-4c80-9387-86405da446fd None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:52.483103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-6ec1f6c2-69cf-492f-9b2e-e197f9c60baf', 'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf', 'tenant_id': 'b122491e0fb34122afbcabe86bf340c9', 'fixed_ips': [{'subnet_id': 'd612e6a2-304d-4720-9d39-9d84aa8f3122'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:52.484760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.533825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] vlan segment allocate from pool success with {'vlan_id': 198, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:52.547759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da51ac82-b52c-4fd4-990a-855a5841180d req-b46adc51-96fd-489d-a2f6-7eaba89502e8 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:52.555707 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-da51ac82-b52c-4fd4-990a-855a5841180d req-b46adc51-96fd-489d-a2f6-7eaba89502e8 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.2119036 Nov 24 04:09:52.564463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 197, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:52.584730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.585204 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Added segment a7963f32-3e70-4e4f-b118-8ef9c778d4b8 of type vlan for network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca Nov 24 04:09:52.586673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.598131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.598507 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 88ff4684-70ec-40d1-a214-97fbe7672f4e of type vlan for network 9636bfff-8e74-468a-bd36-23db9868f00f Nov 24 04:09:52.606569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 172.20.0.11 (a2b36c78-43a6-4954-8102-cb5638999bb1/8a4ffb10-1a31-4ecd-9b76-1baf8ea21076/0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:52.619996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.648780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.661619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': 'b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d', 'ip_address': '2001:db8::f816:3eff:fe24:ffcf'}, {'subnet_id': '8a4ffb10-1a31-4ecd-9b76-1baf8ea21076'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '853e0fd0-2955-4f20-ac09-7a3095b390ce'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:09:52.717273 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-da51ac82-b52c-4fd4-990a-855a5841180d req-3acaab2b-51ec-4f90-82fc-c4388b2dbef8 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1602452 Nov 24 04:09:52.718962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fe55:7283 (a2b36c78-43a6-4954-8102-cb5638999bb1/b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d/0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:52.724697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.729296 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.740189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.748287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.751436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.755529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=9c22bb44-3211-49e7-bcde-f7d29f0a526d,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:52.768795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.798857 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Allocated IP 2001:db8:0:ffff::2 (6ec1f6c2-69cf-492f-9b2e-e197f9c60baf/d612e6a2-304d-4720-9d39-9d84aa8f3122/830f76ad-7a2f-47ad-becd-81e9ca3f103e) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:52.822267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c4538d-6fb8-4a64-a61c-17121c87b382 req-5b190eea-195c-4387-ab2c-0791250a661c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:52.830347 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d3c4538d-6fb8-4a64-a61c-17121c87b382 req-5b190eea-195c-4387-ab2c-0791250a661c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2992935 Nov 24 04:09:52.880527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.880837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Fanout notify agent at l3_agent the message router_deleted on router ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:09:52.887828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.896348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:52.897906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.912838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.920640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:52.921536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.931882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:52.933141 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bbde43e9-577a-43bc-a543-e5f2aa6fcd27 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 HTTP/1.1" status: 204 len: 168 time: 1.9328082 Nov 24 04:09:52.937200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58316) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:52.960317 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1338159085', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:52.971958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 853e0fd0-2955-4f20-ac09-7a3095b390ce up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:53.030212 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.6959460 Nov 24 04:09:53.059814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58320) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:53.068287 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:53.079233 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:53.080152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19876b2-2194-456b-8bc4-f25eec7140e9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=9636bfff-8e74-468a-bd36-23db9868f00f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:53.095963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:53.111703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:53.189983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.196267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 853e0fd0-2955-4f20-ac09-7a3095b390ce triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:53.197151 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.207677 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.271817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:09:53.292112 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:53.300686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:53.305997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:53.318319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Pushing event updated for resources: {'Port': ['ID=830f76ad-7a2f-47ad-becd-81e9ca3f103e,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:53.355200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58322) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:53.355438 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.3511329 Nov 24 04:09:53.388754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'subnet': {'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:53.399768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:53.400004 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d3c4538d-6fb8-4a64-a61c-17121c87b382 req-cffcecb5-98b9-444b-86d2-332289ec8abb tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5674493 Nov 24 04:09:53.400871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Attempting to bind port 830f76ad-7a2f-47ad-becd-81e9ca3f103e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:53.401041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Attempting to bind port 830f76ad-7a2f-47ad-becd-81e9ca3f103e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '40e5aef9-04c6-425a-9f18-ed721c14f46c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:53.401476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Attempting to bind port 830f76ad-7a2f-47ad-becd-81e9ca3f103e on network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:53.403268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.418866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:53.418866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Checking segment: {'id': '40e5aef9-04c6-425a-9f18-ed721c14f46c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:53.418866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.418866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Bound using segment: {'id': '40e5aef9-04c6-425a-9f18-ed721c14f46c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:53.418866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Bound port: 830f76ad-7a2f-47ad-becd-81e9ca3f103e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '40e5aef9-04c6-425a-9f18-ed721c14f46c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '6ec1f6c2-69cf-492f-9b2e-e197f9c60baf'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:53.418866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.427696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216be751-b964-44a5-a024-351a185b43cc tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Network': ['ID=522fbdcd-5bc8-4bff-9c8f-bd9985273cca,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:53.432997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.435016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.455109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:53.475096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.523320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.534273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.559970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:09:53.563769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.565121 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f5a35514-3517-4e87-84d5-7ded43d62147 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.6233346 Nov 24 04:09:53.567109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.568765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58326) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:53.570656 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ba3cfb79-4790-4d4c-adbd-a26192d4e7c9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/routers/a8386b6b-248e-4548-b4bd-473c72f35a73/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2795446 Nov 24 04:09:53.575078 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58328) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:53.578594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': False}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:53.593519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'port': {'network_id': 'a47a2785-1e21-4a90-b046-5bf9f26ab1aa', 'name': 'tempest-FloatingIPTestJSON-510938491'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:53.610079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:53.614015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.685676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:09:53.726706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:53.727352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:53.729886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:53.733708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] Allocated IP 172.20.0.2 (a2b36c78-43a6-4954-8102-cb5638999bb1/8a4ffb10-1a31-4ecd-9b76-1baf8ea21076/853e0fd0-2955-4f20-ac09-7a3095b390ce) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:53.741195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] For port 830f76ad-7a2f-47ad-becd-81e9ca3f103e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:53.785560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:53.788980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:53.806317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] For port 830f76ad-7a2f-47ad-becd-81e9ca3f103e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=830f76ad-7a2f-47ad-becd-81e9ca3f103e,segment=NetworkSegment(40e5aef9-04c6-425a-9f18-ed721c14f46c),segment_id=40e5aef9-04c6-425a-9f18-ed721c14f46c)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:53.809199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.815364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:53.818115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:53.822780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:53.860651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:09:53.861028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:53.940795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=00a22817-3b62-4e1a-a6a5-9779ed61a227,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:53.995336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:53.997022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.004954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': '88ff4684-70ec-40d1-a214-97fbe7672f4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 197, 'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:54.005917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: 9636bfff-8e74-468a-bd36-23db9868f00f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:54.101225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:09:54.101900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64fe244d-a521-4cbb-ac52-3ae525396718 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:09:54.134374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60cd962-63fd-4b80-80fa-6f0cf222da78 None None] Pushing event updated for resources: {'Port': ['ID=830f76ad-7a2f-47ad-becd-81e9ca3f103e,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:54.148049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89bf8c6c-a60d-41c6-9b11-6657fe8af162 req-06c7216e-3333-41f1-baa2-8f51ab614953 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:54.155205 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-89bf8c6c-a60d-41c6-9b11-6657fe8af162 req-06c7216e-3333-41f1-baa2-8f51ab614953 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.3961263 Nov 24 04:09:54.173701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.177763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] For port 853e0fd0-2955-4f20-ac09-7a3095b390ce, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=853e0fd0-2955-4f20-ac09-7a3095b390ce,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:54.216337 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b1ef879-3a0d-438f-917b-5015f631b09a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 3.2093394 Nov 24 04:09:54.221044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58334) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:54.222626 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:54.226899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.243419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.256875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.335415 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-89bf8c6c-a60d-41c6-9b11-6657fe8af162 req-cec5b3e5-bc17-44f4-9f20-a5173144b8ff tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1791158 Nov 24 04:09:54.343253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] device_id is not set on port 5ee20480-1bf7-450b-b47b-dbf62c478f88 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:54.363338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-090a638b-59cc-49d0-8bf6-45126bd7b146 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:54.370163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-090a638b-59cc-49d0-8bf6-45126bd7b146 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:54.371991 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-090a638b-59cc-49d0-8bf6-45126bd7b146 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1864 time: 0.1424036 Nov 24 04:09:54.372394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13eb5d23-6b68-40b0-b864-3c9371638f5c None None] Pushing event updated for resources: {'Port': ['ID=853e0fd0-2955-4f20-ac09-7a3095b390ce,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:54.376527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58336) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:54.516254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 9636bfff-8e74-468a-bd36-23db9868f00f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:54.565704 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 9636bfff-8e74-468a-bd36-23db9868f00f) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:54.575052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd7ea858-cf71-4fcf-8366-7b591b1e3348 None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:54.596943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:09:54.602205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:54.602788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.614951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.676794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.14 (a47a2785-1e21-4a90-b046-5bf9f26ab1aa/2f7d8ed8-b820-4cb9-a339-78c29b4488cf/5ee20480-1bf7-450b-b47b-dbf62c478f88) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:54.682927 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0d07ddaa-dafb-48d9-8a35-347a235fe5ac tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6183512 Nov 24 04:09:54.685741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58340) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:54.691129 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d75e09-39ed-4cf5-9b33-9aa20417209b req-481ef542-8b0c-4c0a-b840-9ffc0cfc6471 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:54.692707 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-98d75e09-39ed-4cf5-9b33-9aa20417209b req-481ef542-8b0c-4c0a-b840-9ffc0cfc6471 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1699343 Nov 24 04:09:54.696445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:54.743919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Subnet': ['ID=c74b2104-0571-42e7-af22-d6bdcf0ac791,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:54.749178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:54.749675 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.770838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Checking segment: {'id': 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:54.771206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network hostable DHCP agents. Network: 522fbdcd-5bc8-4bff-9c8f-bd9985273cca, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:54.790058 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-98d75e09-39ed-4cf5-9b33-9aa20417209b req-75026744-3265-4c1a-ba01-f827e04f8fb3 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0843520 Nov 24 04:09:54.816890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:54.835502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 522fbdcd-5bc8-4bff-9c8f-bd9985273cca) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:54.836079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-9636bfff-8e74-468a-bd36-23db9868f00f', 'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '00a22817-3b62-4e1a-a6a5-9779ed61a227'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:54.836957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.841566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:54.842473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:54.852746 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cce814f-5582-4c18-9b84-c02b4612dd45 None None] Network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:54.873677 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cc3b965c-4f0d-4049-97ad-dd268e195ba3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.4895296 Nov 24 04:09:54.876376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58342) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:54.892733 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'port': {'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca', 'name': 'tempest-NetworksIpV6TestAttrs-1427006939'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:55.098797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:55.102506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.124851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] device_id is not set on port 93336f5e-041b-4597-a7ad-bd0a641bb977 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:55.155985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 853e0fd0-2955-4f20-ac09-7a3095b390ce up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:55.307413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Allocated IP 2001:db8::2 (9636bfff-8e74-468a-bd36-23db9868f00f/00a22817-3b62-4e1a-a6a5-9779ed61a227/e7f5f50e-d994-4e1b-b684-b1e392aef100) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:55.307781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Allocated IP 2001:db8::f816:3eff:fe36:af4d (522fbdcd-5bc8-4bff-9c8f-bd9985273cca/c74b2104-0571-42e7-af22-d6bdcf0ac791/93336f5e-041b-4597-a7ad-bd0a641bb977) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:55.316600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.364649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.380602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:55.394294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.396242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.435475 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 853e0fd0-2955-4f20-ac09-7a3095b390ce triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:55.435778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.512936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-522fbdcd-5bc8-4bff-9c8f-bd9985273cca', 'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca', 'tenant_id': 'b122491e0fb34122afbcabe86bf340c9', 'fixed_ips': [{'subnet_id': 'c74b2104-0571-42e7-af22-d6bdcf0ac791'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:09:55.513796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.545304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-7da73941-d1fd-4e41-b92a-d03d53eb2e88 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:55.546876 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-7da73941-d1fd-4e41-b92a-d03d53eb2e88 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.21 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.3273692 Nov 24 04:09:55.626740 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:55.630578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.655568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.678516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e163138-a21e-48c8-837d-5d619e3d2d97 req-bd204998-77fa-4e77-95eb-d8d1d002a07c tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:55.680504 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-2e163138-a21e-48c8-837d-5d619e3d2d97 req-bd204998-77fa-4e77-95eb-d8d1d002a07c tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.1037252 Nov 24 04:09:55.732103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 830f76ad-7a2f-47ad-becd-81e9ca3f103e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:55.740293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.763833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-034eb939-dc9d-4c4b-974c-8cb617d4243e None None] Provisioning complete for port 853e0fd0-2955-4f20-ac09-7a3095b390ce triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:55.770400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-034eb939-dc9d-4c4b-974c-8cb617d4243e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.773968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36196961-7f75-44d0-85c8-7b0dbaad37b7 None None] Network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:55.796089 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-2e163138-a21e-48c8-837d-5d619e3d2d97 req-83ddc560-daa2-4d8c-ab6c-33c340c56685 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1058393 Nov 24 04:09:55.805334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:55.808871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:55.821636 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:55.827768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:55.828423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.838759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Port': ['ID=93336f5e-041b-4597-a7ad-bd0a641bb977,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:55.866063 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-34a7867b-d8df-44be-8d15-09d1601e0d22 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 0.9864323 Nov 24 04:09:55.866920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58350) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:55.913658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.953695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting subnet c74b2104-0571-42e7-af22-d6bdcf0ac791 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:55.969134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:55.969712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.031084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Allocated IP 2001:db8::f816:3eff:fe9b:4d04 (522fbdcd-5bc8-4bff-9c8f-bd9985273cca/c74b2104-0571-42e7-af22-d6bdcf0ac791/ca026fa0-96e8-43f4-b760-0998d047580e) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:56.046431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:56.071429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:56.073896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:56.077226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 830f76ad-7a2f-47ad-becd-81e9ca3f103e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:56.077629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.089204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Allocated IP 172.26.5.186 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/9374eb0d-5c32-4eab-8013-93e515c3eab9) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:56.113533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Pushing event updated for resources: {'Port': ['ID=e7f5f50e-d994-4e1b-b684-b1e392aef100,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:56.127899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:56.147769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:56.162723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63af312a-1812-4637-8e87-1563314b4058 req-ac6051b6-eaa9-40f3-8517-ae36892bbc3a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:56.164210 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-63af312a-1812-4637-8e87-1563314b4058 req-ac6051b6-eaa9-40f3-8517-ae36892bbc3a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2597120 Nov 24 04:09:56.165178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=5ee20480-1bf7-450b-b47b-dbf62c478f88,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:56.169684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:56.293906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Attempting to bind port e7f5f50e-d994-4e1b-b684-b1e392aef100 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:56.294481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Attempting to bind port e7f5f50e-d994-4e1b-b684-b1e392aef100 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '88ff4684-70ec-40d1-a214-97fbe7672f4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 197, 'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:56.294681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Attempting to bind port e7f5f50e-d994-4e1b-b684-b1e392aef100 on network 9636bfff-8e74-468a-bd36-23db9868f00f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:56.312096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:56.312334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Checking segment: {'id': '88ff4684-70ec-40d1-a214-97fbe7672f4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 197, 'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:56.312581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.312976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Bound using segment: {'id': '88ff4684-70ec-40d1-a214-97fbe7672f4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 197, 'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:56.313467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Bound port: e7f5f50e-d994-4e1b-b684-b1e392aef100, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88ff4684-70ec-40d1-a214-97fbe7672f4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 197, 'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:56.313860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.365497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Deleting port 42e80f9b-33db-4c7f-85ba-50908c286ec3 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:09:56.365751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.408143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222405c0-805a-4536-82f4-0e729b9dae3a req-6a68bd1c-bd32-47e1-820d-f82f8436a637 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:56.409648 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-222405c0-805a-4536-82f4-0e729b9dae3a req-6a68bd1c-bd32-47e1-820d-f82f8436a637 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.0533357 Nov 24 04:09:56.418675 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:56.419286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.465866 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-222405c0-805a-4536-82f4-0e729b9dae3a req-5974ebd5-6e8b-4946-93f0-be063399322e tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483840 Nov 24 04:09:56.474929 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.680770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.693475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.694932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7de5e62f-36ae-4267-923b-734f0f1281cc None None] Provisioning complete for port 0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:56.695388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7de5e62f-36ae-4267-923b-734f0f1281cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.700213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.733927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] For port e7f5f50e-d994-4e1b-b684-b1e392aef100, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:56.744268 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7de5e62f-36ae-4267-923b-734f0f1281cc None None] Port 0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 was deleted so its status cannot be updated. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Nov 24 04:09:56.744798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.747999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 830f76ad-7a2f-47ad-becd-81e9ca3f103e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=830f76ad-7a2f-47ad-becd-81e9ca3f103e,segment=NetworkSegment(40e5aef9-04c6-425a-9f18-ed721c14f46c),segment_id=40e5aef9-04c6-425a-9f18-ed721c14f46c)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:56.780963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.788628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] For port e7f5f50e-d994-4e1b-b684-b1e392aef100, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7f5f50e-d994-4e1b-b684-b1e392aef100,segment=NetworkSegment(88ff4684-70ec-40d1-a214-97fbe7672f4e),segment_id=88ff4684-70ec-40d1-a214-97fbe7672f4e)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:56.805927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:56.812705 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.816805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:56.819298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:56.825235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Pushing event updated for resources: {'Port': ['ID=ca026fa0-96e8-43f4-b760-0998d047580e,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:56.826033 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-63af312a-1812-4637-8e87-1563314b4058 req-1c68f5b6-59bd-4975-b3ad-4aa7fbe7f1ad tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6254356 Nov 24 04:09:56.836705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.838663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.846588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7de5e62f-36ae-4267-923b-734f0f1281cc None None] Provisioning complete for port 830f76ad-7a2f-47ad-becd-81e9ca3f103e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:56.846960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7de5e62f-36ae-4267-923b-734f0f1281cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.905222 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cf741548-1c08-4e4d-8a25-61b4eef222fa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 3.3216968 Nov 24 04:09:56.933386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58362) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:56.953525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'port': {'network_id': 'a47a2785-1e21-4a90-b046-5bf9f26ab1aa', 'name': 'tempest-FloatingIPTestJSON-1738482201'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:56.976233 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:56.979938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:56.992989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=830f76ad-7a2f-47ad-becd-81e9ca3f103e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:56.999387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.020197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Attempting to bind port ca026fa0-96e8-43f4-b760-0998d047580e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:09:57.020585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Attempting to bind port ca026fa0-96e8-43f4-b760-0998d047580e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:09:57.020957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Attempting to bind port ca026fa0-96e8-43f4-b760-0998d047580e on network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:09:57.029636 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 9636bfff-8e74-468a-bd36-23db9868f00f is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:57.042699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:09:57.043690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Checking segment: {'id': 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:57.043994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.044391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Bound using segment: {'id': 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:09:57.045071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Bound port: ca026fa0-96e8-43f4-b760-0998d047580e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '522fbdcd-5bc8-4bff-9c8f-bd9985273cca'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:09:57.045269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.069981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:57.129164 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06601023-efb3-43b0-9d87-b3b10d66e304 None None] Pushing event updated for resources: {'Port': ['ID=e7f5f50e-d994-4e1b-b684-b1e392aef100,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:57.145418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.146341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.201184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] For port ca026fa0-96e8-43f4-b760-0998d047580e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:09:57.207616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] For port ca026fa0-96e8-43f4-b760-0998d047580e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ca026fa0-96e8-43f4-b760-0998d047580e,segment=NetworkSegment(a7963f32-3e70-4e4f-b118-8ef9c778d4b8),segment_id=a7963f32-3e70-4e4f-b118-8ef9c778d4b8)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:09:57.208146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9da261-ab5d-4774-a5ca-e2dd47e05171 req-63db518d-db95-4916-975c-7286cb4c5011 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.216537 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9b9da261-ab5d-4774-a5ca-e2dd47e05171 req-63db518d-db95-4916-975c-7286cb4c5011 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.0910642 Nov 24 04:09:57.221145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.235422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=ab352553-110b-4a28-bdb0-1a9f4bb412fb,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:57.238174 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.256826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] For port 42e80f9b-33db-4c7f-85ba-50908c286ec3, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=42e80f9b-33db-4c7f-85ba-50908c286ec3,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:57.257199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.323189 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9b9da261-ab5d-4774-a5ca-e2dd47e05171 req-9bc9b386-e2a1-44e2-8cfc-ffd43fb680ee tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1048615 Nov 24 04:09:57.348139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.357203 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/c74b2104-0571-42e7-af22-d6bdcf0ac791 HTTP/1.1" status: 204 len: 168 time: 1.4886684 Nov 24 04:09:57.358435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58366) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.412645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42dbc52-3969-4690-9435-c2c697ddaae2 None None] Pushing event updated for resources: {'Port': ['ID=ca026fa0-96e8-43f4-b760-0998d047580e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:57.431844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-aec53e12-ff30-47d2-b45e-343084bc240e None None] Provisioning complete for port 830f76ad-7a2f-47ad-becd-81e9ca3f103e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:57.432591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-aec53e12-ff30-47d2-b45e-343084bc240e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.476867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2b233a6-bb06-4e6e-ba46-2365f22a9138 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.480803 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-64416a62-d442-4e96-9742-78fa64e18d6b tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.7867465 Nov 24 04:09:57.481917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2b233a6-bb06-4e6e-ba46-2365f22a9138 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.486704 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f2b233a6-bb06-4e6e-ba46-2365f22a9138 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1270592 Nov 24 04:09:57.497570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e2797d-482e-41d0-aa0e-3eeda0a9f22c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Subnet': ['ID=c74b2104-0571-42e7-af22-d6bdcf0ac791,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:57.501148 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58370) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.506972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58372) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.596171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.602605 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c3fa5315-5e89-4044-b4bc-f7c63b98eede tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 HTTP/1.1" status: 204 len: 168 time: 3.2227769 Nov 24 04:09:57.611029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58374) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.714480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457dd526-2ab4-45e9-8a4d-ed0607299236 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.716105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457dd526-2ab4-45e9-8a4d-ed0607299236 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.717602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457dd526-2ab4-45e9-8a4d-ed0607299236 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.719244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457dd526-2ab4-45e9-8a4d-ed0607299236 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.720741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457dd526-2ab4-45e9-8a4d-ed0607299236 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.722574 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-457dd526-2ab4-45e9-8a4d-ed0607299236 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.2144098 Nov 24 04:09:57.727101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58376) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.735356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c1f5eb-a5dc-40f9-aa3c-a4af66464bce req-56829eb8-7789-45b4-8eef-b85b020ae4d4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.744786 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d7c1f5eb-a5dc-40f9-aa3c-a4af66464bce req-56829eb8-7789-45b4-8eef-b85b020ae4d4 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.1744075 Nov 24 04:09:57.750734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.755614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-516723756'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:57.791173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1bc608a-2cdd-444e-88ee-4359436804c1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.803703 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-e1bc608a-2cdd-444e-88ee-4359436804c1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 24 04:09:57.803703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e1bc608a-2cdd-444e-88ee-4359436804c1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:09:57.818823 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e1bc608a-2cdd-444e-88ee-4359436804c1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/522fbdcd-5bc8-4bff-9c8f-bd9985273cca HTTP/1.1" status: 409 len: 405 time: 0.2526791 Nov 24 04:09:57.819050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58378) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.819050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d64d20d2-2b9f-4083-950e-ddb18584332d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.819050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d64d20d2-2b9f-4083-950e-ddb18584332d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.819737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d64d20d2-2b9f-4083-950e-ddb18584332d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:57.821420 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d64d20d2-2b9f-4083-950e-ddb18584332d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1986036 Nov 24 04:09:57.829857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58380) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:57.841426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1447948534'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:57.860966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:57.864482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.868711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:09:57.922672 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d7c1f5eb-a5dc-40f9-aa3c-a4af66464bce req-390c067c-230b-4eec-b2a2-964cc1597c50 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1776407 Nov 24 04:09:57.930703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 8a4ffb10-1a31-4ecd-9b76-1baf8ea21076 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:57.934861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.938022 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:57.942408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:57.945616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:57.948259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:09:57.960890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58f31f28-e6c3-4885-8163-a2ffe2f8254c None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:57.963747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Pushing event updated for resources: {'Port': ['ID=9374eb0d-5c32-4eab-8013-93e515c3eab9,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:57.992538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.024797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 159, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:58.043700 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.044139 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment d332d147-df67-4fe6-bd0a-0fc98296f9a7 of type vlan for network c025adea-51c3-4eb6-a148-813b50abc4c2 Nov 24 04:09:58.058202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] device_id is not set on port 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:09:58.093150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9a17d065-177e-4da5-8469-42819e36c6e5 None None] Provisioning complete for port 9374eb0d-5c32-4eab-8013-93e515c3eab9 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:58.093585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a17d065-177e-4da5-8469-42819e36c6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.104244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:58.108251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.126117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.140972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9a17d065-177e-4da5-8469-42819e36c6e5 None None] Port 9374eb0d-5c32-4eab-8013-93e515c3eab9 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:09:58.142317 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.143240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.143611 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Floating IP 02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c disassociated. External IP: 172.26.5.125, port: 42e80f9b-33db-4c7f-85ba-50908c286ec3. Nov 24 04:09:58.144325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Calling delete_port for 42e80f9b-33db-4c7f-85ba-50908c286ec3 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:09:58.153041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.191039 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.196788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:58.197323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.245205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.4932942 Nov 24 04:09:58.249882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58384) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:58.263305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c81bcd5-f12f-4fc8-a9fc-01f827295127 req-15ad3ee5-df22-47c2-ab7f-8e9cf3733eba tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:58.265187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5c81bcd5-f12f-4fc8-a9fc-01f827295127 req-15ad3ee5-df22-47c2-ab7f-8e9cf3733eba tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3315091 Nov 24 04:09:58.266638 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'New_network'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:58.328267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8003f143-7222-4f9d-8650-295f11f49582 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=c025adea-51c3-4eb6-a148-813b50abc4c2,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:58.341546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network c025adea-51c3-4eb6-a148-813b50abc4c2 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:58.361342 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] vlan segment allocate from pool success with {'vlan_id': 150, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:09:58.367971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.454117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8381147e-8a40-4a78-a879-46f580a457e3 None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:58.460813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.464221 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/8a4ffb10-1a31-4ecd-9b76-1baf8ea21076 HTTP/1.1" status: 204 len: 168 time: 0.6325600 Nov 24 04:09:58.475324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aec627ef-bcfe-4815-a852-fc7fb02d9400 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:58.480320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c4ef78-a093-4f11-9e98-bc67043a91f4 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=8a4ffb10-1a31-4ecd-9b76-1baf8ea21076,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:58.482520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58388) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:58.514489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.514841 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Added segment d833e0c0-1270-44b9-8027-09ae0e7f8cae of type vlan for network 78c0685f-61f4-48a9-87dd-048ba3c3b855 Nov 24 04:09:58.566951 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5c81bcd5-f12f-4fc8-a9fc-01f827295127 req-2076356d-7d01-4f9a-9913-69afa2af5eb8 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2648616 Nov 24 04:09:58.584813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fec26f-7b2b-45fe-a6d3-af7a83736d00 req-cdd941a7-4de1-4379-aa7a-a1ef5a28f015 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:58.586633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-30fec26f-7b2b-45fe-a6d3-af7a83736d00 req-cdd941a7-4de1-4379-aa7a-a1ef5a28f015 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 945 time: 0.1647153 Nov 24 04:09:58.631817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.633488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6afa28c7-657d-4290-8e3b-a0eddea83a70 None None] Provisioning complete for port e7f5f50e-d994-4e1b-b684-b1e392aef100 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:58.633868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6afa28c7-657d-4290-8e3b-a0eddea83a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.668883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.680032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.8 (a47a2785-1e21-4a90-b046-5bf9f26ab1aa/2f7d8ed8-b820-4cb9-a339-78c29b4488cf/6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:09:58.756238 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=c025adea-51c3-4eb6-a148-813b50abc4c2,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:58.771233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network c025adea-51c3-4eb6-a148-813b50abc4c2 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:09:58.776262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network c025adea-51c3-4eb6-a148-813b50abc4c2 is not hosted by any dhcp agent {{(pid=103380) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:09:58.782513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:58.783036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.784724 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a5d75158-5f7f-4c18-8b14-6f3cbf0df8ca tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "PUT /v2.0/networks/c025adea-51c3-4eb6-a148-813b50abc4c2 HTTP/1.1" status: 200 len: 723 time: 0.5268509 Nov 24 04:09:58.787768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58390) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:58.793493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': 'c025adea-51c3-4eb6-a148-813b50abc4c2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:58.844092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.854244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:09:58.874468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.935058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:09:58.937897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 42e80f9b-33db-4c7f-85ba-50908c286ec3 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:09:58.939590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:58.961820 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-30fec26f-7b2b-45fe-a6d3-af7a83736d00 req-abc90d66-4fc0-4d35-94fc-d3bd95fd7fa6 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups?id=c44ed4b6-b064-46c5-b181-829da0b490b1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3461509 Nov 24 04:09:59.011368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.resource_extend [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:09:59.076512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19bae6de-d583-4744-8ee7-b6b56d897135 None None] Network 522fbdcd-5bc8-4bff-9c8f-bd9985273cca requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:59.123808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.133206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6afa28c7-657d-4290-8e3b-a0eddea83a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.133553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae322de8-d006-4f60-a899-44126e09b589 req-c2cc28b6-025a-4a46-b0f8-1207b8c642a8 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:59.135190 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ae322de8-d006-4f60-a899-44126e09b589 req-c2cc28b6-025a-4a46-b0f8-1207b8c642a8 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.21 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.3419409 Nov 24 04:09:59.135685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.166392 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No ports have port_id starting with 42e80f9b-33db-4c7f-85ba-50908c286ec3 Nov 24 04:09:59.182188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ca026fa0-96e8-43f4-b760-0998d047580e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:09:59.182509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.188510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:59.189570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.221847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.284133 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event deleted for resources: {'Port': ['ID=42e80f9b-33db-4c7f-85ba-50908c286ec3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:59.298775 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=7a13a54e-2e51-4a11-a88e-418f4ec8b1c8,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:59.301429 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': 'd332d147-df67-4fe6-bd0a-0fc98296f9a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': 'c025adea-51c3-4eb6-a148-813b50abc4c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:09:59.301799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: c025adea-51c3-4eb6-a148-813b50abc4c2, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:09:59.314722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-6afa28c7-657d-4290-8e3b-a0eddea83a70 None None] For port e7f5f50e-d994-4e1b-b684-b1e392aef100, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7f5f50e-d994-4e1b-b684-b1e392aef100,segment=NetworkSegment(88ff4684-70ec-40d1-a214-97fbe7672f4e),segment_id=88ff4684-70ec-40d1-a214-97fbe7672f4e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:09:59.317980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.325669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network c025adea-51c3-4eb6-a148-813b50abc4c2 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:09:59.337128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f82c09-1205-41c4-83d3-e597bfb17d14 req-dab93259-c5c4-4ecc-8a65-d04b684c262e tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:59.338760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, c025adea-51c3-4eb6-a148-813b50abc4c2) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:09:59.339192 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4f82c09-1205-41c4-83d3-e597bfb17d14 req-dab93259-c5c4-4ecc-8a65-d04b684c262e tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.2777309 Nov 24 04:09:59.343913 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.344959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:59.345843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.352912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6afa28c7-657d-4290-8e3b-a0eddea83a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.369271 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b79db842-b3f3-41d3-8b3d-700619877efe tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5800605 Nov 24 04:09:59.371743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58396) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:59.377359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:09:59.395477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d34f1cfb-f8f1-40ca-85ef-3412ed586535 None None] Network c025adea-51c3-4eb6-a148-813b50abc4c2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:09:59.434940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ca026fa0-96e8-43f4-b760-0998d047580e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:59.435315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.487532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] Update dhcp port {'port': {'network_id': '9636bfff-8e74-468a-bd36-23db9868f00f', 'fixed_ips': [{'subnet_id': '00a22817-3b62-4e1a-a6a5-9779ed61a227', 'ip_address': '2001:db8::2'}, {'subnet_id': 'ab352553-110b-4a28-bdb0-1a9f4bb412fb'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': 'e7f5f50e-d994-4e1b-b684-b1e392aef100'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:09:59.528842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-4111412'] for subnet, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.548181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6afa28c7-657d-4290-8e3b-a0eddea83a70 None None] Pushing event updated for resources: {'Port': ['ID=e7f5f50e-d994-4e1b-b684-b1e392aef100,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:09:59.600679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.609813 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6f2f52d2-291a-4b66-b139-f4b1ba652d5d None None] Provisioning complete for port ca026fa0-96e8-43f4-b760-0998d047580e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:09:59.611284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6f2f52d2-291a-4b66-b139-f4b1ba652d5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.670181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] DHCP port deletion for 522fbdcd-5bc8-4bff-9c8f-bd9985273cca request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:09:59.794342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8769089902457', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-3452072'] for subnet, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.845158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:59.845837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:09:59.847242 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "PUT /v2.0/subnets/7a13a54e-2e51-4a11-a88e-418f4ec8b1c8 HTTP/1.1" status: 200 len: 826 time: 0.4744117 Nov 24 04:09:59.859288 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73836217-b74b-4513-92f1-f0a0bc5e2432 req-c7029f5d-0262-4e2f-8841-b55038b3fbc7 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:09:59.863544 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-73836217-b74b-4513-92f1-f0a0bc5e2432 req-c7029f5d-0262-4e2f-8841-b55038b3fbc7 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1095569 Nov 24 04:09:59.868828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58400) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:09:59.919771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 2.0969694 Nov 24 04:10:00.049731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58402) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:00.064464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'subnet': {'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:00.161180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.174987 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf268100-5df5-4ff0-b5b1-bde0e78362b8 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Network': ['ID=78c0685f-61f4-48a9-87dd-048ba3c3b855,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:00.200377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.237132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:00.274508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10849bb6-adae-4e3c-afe3-4c11906da618 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=7a13a54e-2e51-4a11-a88e-418f4ec8b1c8,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:00.320406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9108a71f-e5d8-45dc-8d1a-1dcad0be0595 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-c025adea-51c3-4eb6-a148-813b50abc4c2', 'network_id': 'c025adea-51c3-4eb6-a148-813b50abc4c2', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '7a13a54e-2e51-4a11-a88e-418f4ec8b1c8'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:00.321666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9108a71f-e5d8-45dc-8d1a-1dcad0be0595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.346546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port ca026fa0-96e8-43f4-b760-0998d047580e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ca026fa0-96e8-43f4-b760-0998d047580e,segment=NetworkSegment(a7963f32-3e70-4e4f-b118-8ef9c778d4b8),segment_id=a7963f32-3e70-4e4f-b118-8ef9c778d4b8)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:00.349657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] Deleting port ca026fa0-96e8-43f4-b760-0998d047580e {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:00.350242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.352604 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-73836217-b74b-4513-92f1-f0a0bc5e2432 req-2a155206-04b2-43e1-bd7e-ab4baea167f1 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2497523 Nov 24 04:10:00.409635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.483244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6f2f52d2-291a-4b66-b139-f4b1ba652d5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.497492 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4f82c09-1205-41c4-83d3-e597bfb17d14 req-4ba9cd05-50d4-4edb-9665-e12463587cf3 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5032935 Nov 24 04:10:00.505426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.510623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 830f76ad-7a2f-47ad-becd-81e9ca3f103e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:00.521508 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-23e038c1-e757-4a96-9aa0-469ad481eec9 req-48de1f4e-cd4e-44a1-ba5e-5beafc80d306 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/ports?device_id=d51233ff-7801-4fe5-a044-3dbd25635580 HTTP/1.1" status: 200 len: 210 time: 0.0537682 Nov 24 04:10:00.548899 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.563665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.596687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Deleting port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:00.597036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.599751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:00.603325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.639649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.653527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=ca026fa0-96e8-43f4-b760-0998d047580e,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:00.711898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:00.716454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=7a13a54e-2e51-4a11-a88e-418f4ec8b1c8,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:00.731775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:00.734328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:00.835393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Router 4f8aa7cd-415d-4905-bed0-488cc84270e3 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:00.840884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.883057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c025adea-51c3-4eb6-a148-813b50abc4c2']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:00.905279 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd332d147-df67-4fe6-bd0a-0fc98296f9a7') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:00.906460 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd332d147-df67-4fe6-bd0a-0fc98296f9a7') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:00.929173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] For port ca026fa0-96e8-43f4-b760-0998d047580e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ca026fa0-96e8-43f4-b760-0998d047580e,segment=NetworkSegment(a7963f32-3e70-4e4f-b118-8ef9c778d4b8),segment_id=a7963f32-3e70-4e4f-b118-8ef9c778d4b8)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:00.929900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.933763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.934523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.935871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:00.962502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.965955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70631a59-b041-4c53-9a1d-275a0daec220 None None] Network c025adea-51c3-4eb6-a148-813b50abc4c2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:00.971924 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 159 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:00.973038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:00.982937 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:00.992940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:00.993967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] Allocated IP 172.20.0.1 (9636bfff-8e74-468a-bd36-23db9868f00f/ab352553-110b-4a28-bdb0-1a9f4bb412fb/e7f5f50e-d994-4e1b-b684-b1e392aef100) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:01.005471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] Calling delete_port for ca026fa0-96e8-43f4-b760-0998d047580e owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:01.037862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:01.038708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.044132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.046473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-344bd71b-1a1c-4207-b73b-355013fdad41 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:01.047550 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4b454750-c4d7-4d34-aa03-7e7ef2375025 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d HTTP/1.1" status: 204 len: 168 time: 2.5487120 Nov 24 04:10:01.070680 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58406) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:01.160557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.161811 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b263c023-0949-4950-af94-0b32d669598c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0852714 Nov 24 04:10:01.163598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58408) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:01.169741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:01.191780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] For port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:01.192387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.194796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 830f76ad-7a2f-47ad-becd-81e9ca3f103e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:01.195402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.202055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.214624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.218718 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/c025adea-51c3-4eb6-a148-813b50abc4c2 HTTP/1.1" status: 204 len: 168 time: 1.3490753 Nov 24 04:10:01.222883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58410) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:01.247838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-6f2f52d2-291a-4b66-b139-f4b1ba652d5d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:01.248198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-6f2f52d2-291a-4b66-b139-f4b1ba652d5d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:01.257575 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4614e012-b659-4e9e-8f0c-7807fc3c2088 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 4.3093638 Nov 24 04:10:01.258715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.267747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58412) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:01.274772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8', 'fixed_ip_address': '172.20.0.8'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:01.282770 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d83867bd-ccd1-4dfc-8e93-1b0274947001 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:01.283665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d83867bd-ccd1-4dfc-8e93-1b0274947001 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:01.290586 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d83867bd-ccd1-4dfc-8e93-1b0274947001 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/c025adea-51c3-4eb6-a148-813b50abc4c2 HTTP/1.1" status: 404 len: 339 time: 0.0574155 Nov 24 04:10:01.295908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c89148-309f-4e99-a779-1d7ed43b119f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=c025adea-51c3-4eb6-a148-813b50abc4c2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:01.298089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58414) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:01.310573 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1052269437', 'description': 'd1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:01.362544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:01.367546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.442594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 151, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:01.456840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.457490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 9efb803e-0d4f-40e6-b1ca-a99b4448c7a9 of type vlan for network 3ca93b6c-d365-488d-a235-b3f46ddeea7b Nov 24 04:10:01.474966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.api [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:10:01.474966 dv-neutron-819049-1-hyperv neutron-server[103381]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 24 04:10:01.474966 dv-neutron-819049-1-hyperv neutron-server[103381]: [parameters: {'project_id_1': '69073a2d6ab34b54a6451825f7590db1', 'expiration_1': datetime.datetime(2021, 11, 24, 4, 9, 41, 390097)}] Nov 24 04:10:01.474966 dv-neutron-819049-1-hyperv neutron-server[103381]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103381) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:01.475375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG oslo_db.api [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:01.502102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-599ce3b8-0018-43fd-b6c8-c4c9233542db None None] Network c025adea-51c3-4eb6-a148-813b50abc4c2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:01.534480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.549171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:01.553430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.574252 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-599ce3b8-0018-43fd-b6c8-c4c9233542db None None] Network c025adea-51c3-4eb6-a148-813b50abc4c2 could not be found, it might have been deleted concurrently. {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 24 04:10:01.634620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:01.635985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] For port e7f5f50e-d994-4e1b-b684-b1e392aef100, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7f5f50e-d994-4e1b-b684-b1e392aef100,segment=NetworkSegment(88ff4684-70ec-40d1-a214-97fbe7672f4e),segment_id=88ff4684-70ec-40d1-a214-97fbe7672f4e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:01.645603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7f5f50e-d994-4e1b-b684-b1e392aef100 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:01.652667 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.663886 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] Sync routers for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:01.679345 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:01.680332 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:01.741844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:10:01.767881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] No DVR routers for this DVR port ca026fa0-96e8-43f4-b760-0998d047580e on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:01.810220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12917fd9-b7c9-4021-9342-e11061a8ff47 None None] Pushing event deleted for resources: {'Port': ['ID=ca026fa0-96e8-43f4-b760-0998d047580e,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:01.837298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] No DVR routers for this DVR port 42e80f9b-33db-4c7f-85ba-50908c286ec3 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:01.857919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.861369 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f7ff108d-f40e-422e-bf95-db3071441fd4 req-72921b95-dcee-46e7-8a65-133055331a1a tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.21 "DELETE /v2.0/ports/42e80f9b-33db-4c7f-85ba-50908c286ec3 HTTP/1.1" status: 204 len: 173 time: 6.2986186 Nov 24 04:10:01.863717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'name': 'network-vif-deleted', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:10:01.874333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43afbd7e-0f1a-4c2e-b7fa-dda0874f53d1" -d '{"events": [{"server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "name": "network-vif-deleted", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:10:01.884239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.897271 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:01.898291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.901789 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6f2f52d2-291a-4b66-b139-f4b1ba652d5d None None] Port ca026fa0-96e8-43f4-b760-0998d047580e update to ACTIVE by agent not found {{(pid=103382) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 24 04:10:01.914323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:01.915595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:01.922492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.001505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:02.110043 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e59acfe4-4e02-4e01-bd65-6076c4c4d32d None None] Pushing event updated for resources: {'Port': ['ID=e7f5f50e-d994-4e1b-b684-b1e392aef100,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:02.118541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5082e673-abe9-4a7e-886b-0f650c3a660e None None] Provisioning complete for port 853e0fd0-2955-4f20-ac09-7a3095b390ce triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:02.118912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5082e673-abe9-4a7e-886b-0f650c3a660e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.173215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:02.174681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e7f5f50e-d994-4e1b-b684-b1e392aef100 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:02.175670 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.195635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.233843 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.9287498 Nov 24 04:10:02.234575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58424) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:02.264362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf96cf2-ec44-4cc2-b3a0-e18abe395d19 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=3ca93b6c-d365-488d-a235-b3f46ddeea7b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:02.304598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Subnet': ['ID=874da414-186a-474a-94ec-a512ad74a10b,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:02.320133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 3ca93b6c-d365-488d-a235-b3f46ddeea7b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:02.334095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7a1fc8-702c-41be-958b-37aee194fefd req-294947ee-ba77-4481-8226-95f1884159f7 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:02.337302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e210fcce-4cf4-4264-b0af-9ce1a3712ef8 req-c93bb784-f1b2-4e2a-80fc-9c0bc8248799 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:02.340424 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e210fcce-4cf4-4264-b0af-9ce1a3712ef8 req-c93bb784-f1b2-4e2a-80fc-9c0bc8248799 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.7762177 Nov 24 04:10:02.351663 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0e7a1fc8-702c-41be-958b-37aee194fefd req-294947ee-ba77-4481-8226-95f1884159f7 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 946 time: 0.6143241 Nov 24 04:10:02.426527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.427045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.427493 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Floating IP c8213094-8b2a-4d86-9a1d-aa88ab727763 disassociated. External IP: 172.26.5.8, port: a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b. Nov 24 04:10:02.427948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Calling delete_port for a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:02.659547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:02.694052 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:35Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:02.701063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2220c886-052e-4538-a840-a2d9d3b8efd9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:02.702883 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2220c886-052e-4538-a840-a2d9d3b8efd9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks?id=3ca93b6c-d365-488d-a235-b3f46ddeea7b HTTP/1.1" status: 200 len: 765 time: 0.4646618 Nov 24 04:10:02.707612 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58428) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:02.751366 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] Checking router: 4f8aa7cd-415d-4905-bed0-488cc84270e3 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:10:02.757959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'description': 'd2'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:02.789996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.791657 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:02.792963 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:02.813782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Router cd7a63ff-28d8-4da2-a035-37e18bb65342 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:10:02.819666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:02.901303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:02.955162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:02.955953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:02.986595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] Deleting port 853e0fd0-2955-4f20-ac09-7a3095b390ce {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:02.987813 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.018687 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0e7a1fc8-702c-41be-958b-37aee194fefd req-079ef49b-7a5c-417c-8392-9e30c694b395 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups?id=76b249c4-619a-41db-83bc-ecf04415e0cf&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.6609781 Nov 24 04:10:03.020166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event deleted for resources: {'Port': ['ID=a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:03.022080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Checking segment: {'id': 'd833e0c0-1270-44b9-8027-09ae0e7f8cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:03.027660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network hostable DHCP agents. Network: 78c0685f-61f4-48a9-87dd-048ba3c3b855, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:03.061491 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:03.152375 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e210fcce-4cf4-4264-b0af-9ce1a3712ef8 req-de1eb3af-6f29-4b40-b32d-78b67e64b885 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7867773 Nov 24 04:10:03.206355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a7c38af-0ceb-48ba-9b5e-6c5ea5b38ea4 None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:03.239077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:10:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e85db660-c40c-4680-82c7-1970f697cc66 x-openstack-request-id: req-e85db660-c40c-4680-82c7-1970f697cc66 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:10:03.239554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d51233ff-7801-4fe5-a044-3dbd25635580", "name": "network-vif-deleted", "tag": "42e80f9b-33db-4c7f-85ba-50908c286ec3", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:10:03.239798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-e85db660-c40c-4680-82c7-1970f697cc66 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:10:03.240200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd51233ff-7801-4fe5-a044-3dbd25635580', 'name': 'network-vif-deleted', 'tag': '42e80f9b-33db-4c7f-85ba-50908c286ec3', 'status': 'completed', 'code': 200} Nov 24 04:10:03.284243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58432) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:03.303253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] For port 853e0fd0-2955-4f20-ac09-7a3095b390ce, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=853e0fd0-2955-4f20-ac09-7a3095b390ce,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:03.303590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:03.303724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.322884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] Calling delete_port for 853e0fd0-2955-4f20-ac09-7a3095b390ce owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:03.433822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7f5f50e-d994-4e1b-b684-b1e392aef100 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:03.444665 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.516818 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:35Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:03.550171 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e062be4-3eac-48c8-92bb-c030a32e69bb None None] The sync data for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv is: [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:25Z', 'revision_number': 4, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6df9846b-1643-450c-93a1-74fa97e85511', 'name': '', 'network_id': 'bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'mac_address': 'fa:16:3e:c9:c3:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 121, 'fixed_ips': [{'subnet_id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:23Z', 'updated_at': '2021-11-24T04:08:35Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'subnets': [{'id': 'd6b900d5-6e1c-467d-a80c-b932fd4e77fd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:03.559161 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] No DVR routers for this DVR port 853e0fd0-2955-4f20-ac09-7a3095b390ce on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:03.563224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-568af279-05f6-4717-94f3-df8043c630f1 None None] Pushing event deleted for resources: {'Port': ['ID=853e0fd0-2955-4f20-ac09-7a3095b390ce,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:03.579656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-220f9a8e-bb3e-421c-b6ef-516e6f496a25 None None] Provisioning complete for port e7f5f50e-d994-4e1b-b684-b1e392aef100 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:03.581721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-220f9a8e-bb3e-421c-b6ef-516e6f496a25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.609490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_pluggable_backend [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Port 853e0fd0-2955-4f20-ac09-7a3095b390ce was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=103380) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Nov 24 04:10:03.609804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_pluggable_backend [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Reverting IP allocation for 2001:db8::f816:3eff:fe24:ffcf {{(pid=103380) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Nov 24 04:10:03.630431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_pluggable_backend [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fe24:ffcf {{(pid=103380) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Nov 24 04:10:03.632527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.645180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.688793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.727365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:03.728687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e7f5f50e-d994-4e1b-b684-b1e392aef100 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:03.728687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.758402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:03.759991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 3ca93b6c-d365-488d-a235-b3f46ddeea7b is not hosted by any dhcp agent {{(pid=103380) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:10:03.766026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:03.766694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.770626 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "PUT /v2.0/networks/3ca93b6c-d365-488d-a235-b3f46ddeea7b HTTP/1.1" status: 200 len: 762 time: 1.0195041 Nov 24 04:10:03.770626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:03.770626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.790082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7b27b5d-b3a2-4f19-bbde-3840d67681f1 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:03.793486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58434) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:03.870372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 78c0685f-61f4-48a9-87dd-048ba3c3b855) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:03.871120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=dcb31614-0f41-463c-be02-aaf883b8ca54,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:03.879897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1096c57-c0ed-4df0-a3dc-c2dee1c4001f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=3ca93b6c-d365-488d-a235-b3f46ddeea7b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:03.892178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:03.892941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.897220 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-82656501-d379-41ab-a6d5-dbec63bbc422 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.7290008 Nov 24 04:10:03.899800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58436) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:03.901421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b36893b-c84a-41eb-8260-e822d0bfbceb None None] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:03.921615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:03.932964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:03.936438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 3ca93b6c-d365-488d-a235-b3f46ddeea7b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:03.956533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:03.959520 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-175e656c-37ac-4c34-9603-d14e72cb1e5b tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "PUT /v2.0/routers/cd7a63ff-28d8-4da2-a035-37e18bb65342 HTTP/1.1" status: 200 len: 916 time: 10.3876481 Nov 24 04:10:03.969752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58438) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:03.971063 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4c43ec0-a038-4dc4-9164-a7f466abed5e None None] New status for floating IP 02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c: DOWN {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:10:03.995480 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3f23dff8-d178-45c7-98ff-5e58ae702c59 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 3.9415555 Nov 24 04:10:04.019641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58440) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.025804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] Sync routers for ids ['cd7a63ff-28d8-4da2-a035-37e18bb65342'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:04.052425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'port': {'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855', 'name': 'tempest-NetworksIpV6TestAttrs-480027760'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:04.096131 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87f78cd6-c268-4877-8e79-66dae8c157f3 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.124694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Router 8f58b51f-193c-43f1-ae94-d69a879a0453 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:04.148196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] Routers {'cd7a63ff-28d8-4da2-a035-37e18bb65342'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:04.150365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cd7a63ff-28d8-4da2-a035-37e18bb65342'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:04.180194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87f78cd6-c268-4877-8e79-66dae8c157f3 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.233212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-151326ba-5ceb-4f14-b5f7-4d3d047402de tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:04.240687 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-151326ba-5ceb-4f14-b5f7-4d3d047402de tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks?id=3ca93b6c-d365-488d-a235-b3f46ddeea7b HTTP/1.1" status: 200 len: 765 time: 0.4462965 Nov 24 04:10:04.241360 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58446) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.245485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.282738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:04.315221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] Routers {'cd7a63ff-28d8-4da2-a035-37e18bb65342'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:04.315541 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7505f815-8dc3-45f6-a378-0dc2cb05cce3 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/cd7a63ff-28d8-4da2-a035-37e18bb65342 HTTP/1.1" status: 200 len: 922 time: 0.3377557 Nov 24 04:10:04.315937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cd7a63ff-28d8-4da2-a035-37e18bb65342'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:04.336981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58448) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.361140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-78c0685f-61f4-48a9-87dd-048ba3c3b855', 'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855', 'tenant_id': 'b122491e0fb34122afbcabe86bf340c9', 'fixed_ips': [{'subnet_id': '874da414-186a-474a-94ec-a512ad74a10b'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:04.362305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.363602 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-afee7854-aadf-481b-bac2-ae929d53898f req-bc63c5b3-ff2c-4434-8465-088192aaf3ee tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.1791892 Nov 24 04:10:04.426951 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:04.427868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d5eb7c6-fee7-4895-ad74-70c8c3dc4c3f None None] The sync data for ids ['cd7a63ff-28d8-4da2-a035-37e18bb65342'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:04.432945 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 853e0fd0-2955-4f20-ac09-7a3095b390ce no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:04.478286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 853e0fd0-2955-4f20-ac09-7a3095b390ce {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:04.478702 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 853e0fd0-2955-4f20-ac09-7a3095b390ce not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:04.479124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ca026fa0-96e8-43f4-b760-0998d047580e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:04.512054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:04.515937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.587479 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ca026fa0-96e8-43f4-b760-0998d047580e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:04.588234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ca026fa0-96e8-43f4-b760-0998d047580e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:04.613596 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf38f02d-39e2-4efb-8eba-b135335a00c1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:04.619182 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cf38f02d-39e2-4efb-8eba-b135335a00c1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.3741031 Nov 24 04:10:04.619986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58450) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.653148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'dcb31614-0f41-463c-be02-aaf883b8ca54'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:04.654442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.656987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ca0982a3-0305-4726-afb5-8a90fb5c5e12 None None] Provisioning complete for port e7f5f50e-d994-4e1b-b684-b1e392aef100 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:04.657669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ca0982a3-0305-4726-afb5-8a90fb5c5e12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.674518 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ee3b451b-c729-4ce5-9e38-c26830a3225e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 207 time: 0.0527906 Nov 24 04:10:04.675322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:04.678944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.698347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58452) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.719404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] device_id is not set on port 89d611a7-346e-4d15-b118-f122ebf39cf1 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:04.764885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Allocated IP 2001:db8::f816:3eff:feb3:e094 (78c0685f-61f4-48a9-87dd-048ba3c3b855/874da414-186a-474a-94ec-a512ad74a10b/a69c4036-71d8-4e73-85d6-b937dbb4375e) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:04.798174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87f78cd6-c268-4877-8e79-66dae8c157f3 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.800877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87f78cd6-c268-4877-8e79-66dae8c157f3 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.804679 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-87f78cd6-c268-4877-8e79-66dae8c157f3 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "DELETE /v2.0/security-groups/c44ed4b6-b064-46c5-b181-829da0b490b1 HTTP/1.1" status: 204 len: 168 time: 1.5122051 Nov 24 04:10:04.804679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:04.820849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58454) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.832814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] Sync routers for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:04.833042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0e7d91-11c7-4a64-ba05-9671d5665319 req-9536e0d0-3fec-45d7-8fd8-e95b33d77630 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:04.835045 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-da0e7d91-11c7-4a64-ba05-9671d5665319 req-9536e0d0-3fec-45d7-8fd8-e95b33d77630 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.5254109 Nov 24 04:10:04.846283 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-690e514f-c528-451d-a9cd-afe95a2b7f30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] show failed (client error): The resource could not be found. Nov 24 04:10:04.852510 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-690e514f-c528-451d-a9cd-afe95a2b7f30 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "GET /v2.0/security-groups/c44ed4b6-b064-46c5-b181-829da0b490b1 HTTP/1.1" status: 404 len: 347 time: 0.0235541 Nov 24 04:10:04.852765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efd975ec-5f97-4ae3-a686-7982f80492c5 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:04.852765 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-efd975ec-5f97-4ae3-a686-7982f80492c5 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=cd7a63ff-28d8-4da2-a035-37e18bb65342&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.5112700 Nov 24 04:10:04.852948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58456) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.853024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58458) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:04.854387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:04.855612 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:04.882906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f78cd6-c268-4877-8e79-66dae8c157f3 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c44ed4b6-b064-46c5-b181-829da0b490b1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:04.931230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.933408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] No DVR routers for this DVR port a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:04.943800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:04.947182 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ae322de8-d006-4f60-a899-44126e09b589 req-73bf5cf0-aaf1-4856-916f-530563900c28 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.21 "DELETE /v2.0/ports/a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b HTTP/1.1" status: 204 len: 173 time: 5.7767749 Nov 24 04:10:04.991240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.254 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/371f95f2-5a08-4d3c-a261-ebef200a940f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:04.997323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3b52714-b8a3-4d09-8b71-60831690a6a3 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.001550 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a3b52714-b8a3-4d09-8b71-60831690a6a3 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.1450238 Nov 24 04:10:05.003375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58460) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.014454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:05.062681 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8bb7ed68-2570-453d-b8ec-3de9493d2567 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=cd7a63ff-28d8-4da2-a035-37e18bb65342 HTTP/1.1" status: 200 len: 205 time: 0.0480602 Nov 24 04:10:05.062681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:05.068544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.069215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.072246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58462) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.083819 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-da0e7d91-11c7-4a64-ba05-9671d5665319 req-4f90a68b-c981-4388-b8f0-462c3c1af2f7 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2056413 Nov 24 04:10:05.110687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.116627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.123851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.129817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.137521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.144964 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.153229 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4bc98506-51ae-454f-b4bd-8a79d694d91d tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3731 time: 0.4511461 Nov 24 04:10:05.154244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58466) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.164185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=641ca6d1-3b91-405b-9c75-da69801a406c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:05.242771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1ba8fbf4-2882-46f4-b2da-14a4e61ef5f5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3334396 Nov 24 04:10:05.269785 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-daa19fd3-7030-4e7d-af61-92ed194cca05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.272503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'name': 'network-vif-deleted', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:10:05.274449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58468) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.275403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5dd6936b-9df7-4b58-885b-07f44af82983" -d '{"events": [{"server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "name": "network-vif-deleted", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:10:05.300814 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e86a0827-f6b5-447c-94c8-f10c122a248a tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 813 time: 0.1443560 Nov 24 04:10:05.303360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Allocated IP 2001:db8::f816:3eff:fe1b:b83a (a2b36c78-43a6-4954-8102-cb5638999bb1/dcb31614-0f41-463c-be02-aaf883b8ca54/01f5df4f-0724-4d40-904b-72624e51e972) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:05.306615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:7e:12:c7', 'name': 'tempest-NetworksTestDHCPv6-2102064627'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:05.312361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58472) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.345916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:05.389949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c20558b9-8c01-49a8-a701-710aa4f16120 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.391593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c20558b9-8c01-49a8-a701-710aa4f16120 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.393347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c20558b9-8c01-49a8-a701-710aa4f16120 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.396501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c20558b9-8c01-49a8-a701-710aa4f16120 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.397221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:10:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56cf4bd2-2f6d-4d63-a8fc-733b73802716 x-openstack-request-id: req-56cf4bd2-2f6d-4d63-a8fc-733b73802716 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:10:05.397794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c20558b9-8c01-49a8-a701-710aa4f16120 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.398251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d26d57b-23c2-438d-bb96-bdfc03eeb675", "name": "network-vif-deleted", "tag": "a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:10:05.398678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-56cf4bd2-2f6d-4d63-a8fc-733b73802716 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:10:05.399244 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d26d57b-23c2-438d-bb96-bdfc03eeb675', 'name': 'network-vif-deleted', 'tag': 'a9ed43d3-5dd4-4c00-b9ad-eccc4869a63b', 'status': 'completed', 'code': 200} Nov 24 04:10:05.400974 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c20558b9-8c01-49a8-a701-710aa4f16120 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.0832725 Nov 24 04:10:05.410217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58478) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.476843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Deleting port 8aac0b0c-6dbb-49ea-85cb-46c26161b754 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:05.481359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.486297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.517400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.592419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.592811 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.603649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.606763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Calling delete_port for 8aac0b0c-6dbb-49ea-85cb-46c26161b754 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:05.658446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.674177 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-db0fa4d5-4896-4680-bd2e-c04e460a9a4f req-d74070a9-0981-4db2-8b78-39a2c66d383e tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/ports?device_id=4d26d57b-23c2-438d-bb96-bdfc03eeb675 HTTP/1.1" status: 200 len: 210 time: 0.0727279 Nov 24 04:10:05.682204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:05.708821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6ad5783-4e5a-4d2b-bdbc-2ec73a9a1a72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.710600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6ad5783-4e5a-4d2b-bdbc-2ec73a9a1a72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.711065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:05.712004 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6ad5783-4e5a-4d2b-bdbc-2ec73a9a1a72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.713522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6ad5783-4e5a-4d2b-bdbc-2ec73a9a1a72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.713639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:05.715546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6ad5783-4e5a-4d2b-bdbc-2ec73a9a1a72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.720438 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c6ad5783-4e5a-4d2b-bdbc-2ec73a9a1a72 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.3057554 Nov 24 04:10:05.733797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Pushing event updated for resources: {'Port': ['ID=a69c4036-71d8-4e73-85d6-b937dbb4375e,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:05.739245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58480) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:05.787036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-6846d3aa-8955-4329-92d1-cd0a5811537d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.788780 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-6846d3aa-8955-4329-92d1-cd0a5811537d service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.2027521 Nov 24 04:10:05.837451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Attempting to bind port a69c4036-71d8-4e73-85d6-b937dbb4375e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:05.837796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Attempting to bind port a69c4036-71d8-4e73-85d6-b937dbb4375e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd833e0c0-1270-44b9-8027-09ae0e7f8cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:05.838688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Attempting to bind port a69c4036-71d8-4e73-85d6-b937dbb4375e on network 78c0685f-61f4-48a9-87dd-048ba3c3b855 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:05.840133 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.850521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:49Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:05.858565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.871365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.890854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:05.891314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Checking segment: {'id': 'd833e0c0-1270-44b9-8027-09ae0e7f8cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:05.891701 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.892085 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Bound using segment: {'id': 'd833e0c0-1270-44b9-8027-09ae0e7f8cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:05.892578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Bound port: a69c4036-71d8-4e73-85d6-b937dbb4375e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd833e0c0-1270-44b9-8027-09ae0e7f8cae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '78c0685f-61f4-48a9-87dd-048ba3c3b855'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:05.892972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.895666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] Checking router: 8f58b51f-193c-43f1-ae94-d69a879a0453 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:10:05.898809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:05.919918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6b4e4a-2136-457d-9adb-24ebc8b5f9d5 req-fca5f3aa-84a6-4928-b665-744a36d1899c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:05.927248 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ee6b4e4a-2136-457d-9adb-24ebc8b5f9d5 req-fca5f3aa-84a6-4928-b665-744a36d1899c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2021725 Nov 24 04:10:05.931215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:05.944808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:05.948809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:05.971288 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:05.975829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:05.976001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Allocated IP 2001:db8::f816:3eff:fe6e:25cf (78c0685f-61f4-48a9-87dd-048ba3c3b855/874da414-186a-474a-94ec-a512ad74a10b/89d611a7-346e-4d15-b118-f122ebf39cf1) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:05.976343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:09:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:05.982130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:05.989916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:06.007384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=371f95f2-5a08-4d3c-a261-ebef200a940f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:06.030318 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:06.030551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-a22a3fb7-10de-4f01-b14f-3bbbd2fdbd35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:06.030837 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:06.032166 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-a22a3fb7-10de-4f01-b14f-3bbbd2fdbd35 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.2360542 Nov 24 04:10:06.123556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.131357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.133016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] For port a69c4036-71d8-4e73-85d6-b937dbb4375e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:06.153955 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ee6b4e4a-2136-457d-9adb-24ebc8b5f9d5 req-68c9a908-c104-4381-85c2-5342adbec112 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2218900 Nov 24 04:10:06.168349 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-efd81dad-f59c-4342-b17c-f5f1ee95b858 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1001 time: 0.1255975 Nov 24 04:10:06.169359 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] For port a69c4036-71d8-4e73-85d6-b937dbb4375e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a69c4036-71d8-4e73-85d6-b937dbb4375e,segment=NetworkSegment(d833e0c0-1270-44b9-8027-09ae0e7f8cae),segment_id=d833e0c0-1270-44b9-8027-09ae0e7f8cae)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:06.172467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Deleting port 9374eb0d-5c32-4eab-8013-93e515c3eab9 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:06.172467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.172660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Attempting to bind port 01f5df4f-0724-4d40-904b-72624e51e972 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:06.172903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Attempting to bind port 01f5df4f-0724-4d40-904b-72624e51e972 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:06.173207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Attempting to bind port 01f5df4f-0724-4d40-904b-72624e51e972 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:06.183531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.189317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 9, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:06.189571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:06.189896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.190322 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:06.190913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Bound port: 01f5df4f-0724-4d40-904b-72624e51e972, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:06.191035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Pushing event deleted for resources: {'Port': ['ID=8aac0b0c-6dbb-49ea-85cb-46c26161b754,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:06.191299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.210852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abf8a273-26f0-419b-ab09-07c09f0405c7 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:06.212451 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-abf8a273-26f0-419b-ab09-07c09f0405c7 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks/96924243-5b50-48fb-b900-d2dd42606c99 HTTP/1.1" status: 200 len: 804 time: 0.4704504 Nov 24 04:10:06.219444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-24175cfd-3eea-4727-a0a9-e1e0164735eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:06.220889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-24175cfd-3eea-4727-a0a9-e1e0164735eb service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.0448959 Nov 24 04:10:06.230523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58482) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:06.232172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46646f0f-c3e1-4bde-b53a-9470032dd7d7 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:06.253295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:06.298192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 1ae068be-93bf-42f1-8697-36c677b3f994 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:06.310114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.313037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.314529 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-be2811de-0c7a-4ab0-b027-d2926b674781 tempest-ServersTestManualDisk-876110805 tempest-ServersTestManualDisk-876110805-project] 10.222.0.48 "DELETE /v2.0/floatingips/02f7f5f1-9bbf-496a-b1dd-0fc992bbaa1c HTTP/1.1" status: 204 len: 168 time: 1.3642406 Nov 24 04:10:06.318763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58484) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:06.342365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf1468a-7542-4235-a2b9-ec2684ead75b None None] Pushing event updated for resources: {'Port': ['ID=a69c4036-71d8-4e73-85d6-b937dbb4375e,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:06.417251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-631f2641-1661-47ec-9355-2cf594373963 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:06.433476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-631f2641-1661-47ec-9355-2cf594373963 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:06.465326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.570134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631f2641-1661-47ec-9355-2cf594373963 None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:06.654047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:49Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:06.702288 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2349f12-6fa2-496d-92ef-62dbe37209b0 None None] The sync data for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv is: [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:08:30Z', 'revision_number': 4, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '6f666d10-1f35-49b9-8b78-f904cf455c7c', 'name': '', 'network_id': '9279fc65-0f7e-4ac5-8fda-e94ff426a487', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'mac_address': 'fa:16:3e:68:22:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_interface', 'standard_attr_id': 147, 'fixed_ips': [{'subnet_id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:29Z', 'updated_at': '2021-11-24T04:08:49Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'subnets': [{'id': 'ac08ee4f-45d7-4c2e-ab90-055d80970c38', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:06.944822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:06.953867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58490) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:07.003520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Calling delete_port for 9374eb0d-5c32-4eab-8013-93e515c3eab9 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:07.014983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-12ec0e15-fc03-41ac-9d4f-91d57a5f392c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:07.017097 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-12ec0e15-fc03-41ac-9d4f-91d57a5f392c service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.7677262 Nov 24 04:10:07.095034 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16b39277-27f3-4b70-970e-dac36e815c54 None None] New status for floating IP c8213094-8b2a-4d86-9a1d-aa88ab727763: DOWN {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:10:07.159666 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3679c207-c0b0-48c9-91c3-6d53f036c90e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/networks/96924243-5b50-48fb-b900-d2dd42606c99?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 320 time: 0.9228539 Nov 24 04:10:07.161789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58492) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:07.247482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.294839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3055a4f9-30f8-406e-a82b-0068937342b5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.390059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a69c4036-71d8-4e73-85d6-b937dbb4375e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:07.424656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-989cb81f-2a2f-4499-81db-c58a6d8dc279 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:07.430214 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-989cb81f-2a2f-4499-81db-c58a6d8dc279 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/subnets/1bacb3a7-3670-41c2-ab32-f3272ff96726 HTTP/1.1" status: 200 len: 843 time: 0.2594316 Nov 24 04:10:07.430214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 172.20.0.8 (a2b36c78-43a6-4954-8102-cb5638999bb1/641ca6d1-3b91-405b-9c75-da69801a406c/1ae068be-93bf-42f1-8697-36c677b3f994) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:07.431914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58496) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:07.462299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a69c4036-71d8-4e73-85d6-b937dbb4375e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:07.462812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.463980 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-d6beb0cc-0d96-40ea-acd6-dd9a38fcd360 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4321699 Nov 24 04:10:07.466072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3055a4f9-30f8-406e-a82b-0068937342b5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.487590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fe7e:12c7 (a2b36c78-43a6-4954-8102-cb5638999bb1/dcb31614-0f41-463c-be02-aaf883b8ca54/1ae068be-93bf-42f1-8697-36c677b3f994) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:07.522840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.526468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83113712-8f8b-42e4-a596-1b1b06876b2b req-7372a4b7-c6f7-460e-bcd6-3bd6a9d22009 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:07.532039 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-83113712-8f8b-42e4-a596-1b1b06876b2b req-7372a4b7-c6f7-460e-bcd6-3bd6a9d22009 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2753847 Nov 24 04:10:07.570641 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.612758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port a69c4036-71d8-4e73-85d6-b937dbb4375e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a69c4036-71d8-4e73-85d6-b937dbb4375e,segment=NetworkSegment(d833e0c0-1270-44b9-8027-09ae0e7f8cae),segment_id=d833e0c0-1270-44b9-8027-09ae0e7f8cae)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:07.621028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.621257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:07.622472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:07.657900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:07.670924 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f34276e4-7978-4500-9bc6-c8d6dd4fbe5a tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['shared'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:07.677402 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f34276e4-7978-4500-9bc6-c8d6dd4fbe5a tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "GET /v2.0/subnets/1bacb3a7-3670-41c2-ab32-f3272ff96726?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.2422471 Nov 24 04:10:07.678757 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:07.686550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:07.687647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.691292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58498) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:07.702244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Port': ['ID=89d611a7-346e-4d15-b118-f122ebf39cf1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:07.705059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-146894041'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:07.723234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=a69c4036-71d8-4e73-85d6-b937dbb4375e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:07.736987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:07.737541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.745053 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-14e1cbfd-487a-4c1b-a78e-65ba032a3aab tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 3.7240381 Nov 24 04:10:07.752840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58500) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:07.831643 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting subnet 874da414-186a-474a-94ec-a512ad74a10b {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:07.835365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.858534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.869957 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-83113712-8f8b-42e4-a596-1b1b06876b2b req-6c23999a-8f9e-40ed-9edd-2e966743be07 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3087797 Nov 24 04:10:07.880640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:07.888143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.927482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3055a4f9-30f8-406e-a82b-0068937342b5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.930326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3055a4f9-30f8-406e-a82b-0068937342b5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.931714 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3055a4f9-30f8-406e-a82b-0068937342b5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "DELETE /v2.0/security-groups/76b249c4-619a-41db-83bc-ecf04415e0cf HTTP/1.1" status: 204 len: 168 time: 0.9685493 Nov 24 04:10:07.941783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:07.946533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58502) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:07.948190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:07.952459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.009249 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-e8b7dc7a-984b-4b02-b229-e71a51a71924 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] show failed (client error): The resource could not be found. Nov 24 04:10:08.011941 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e8b7dc7a-984b-4b02-b229-e71a51a71924 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "GET /v2.0/security-groups/76b249c4-619a-41db-83bc-ecf04415e0cf HTTP/1.1" status: 404 len: 347 time: 0.0561895 Nov 24 04:10:08.012905 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.018327 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2acaa889-e8a3-41ca-911a-da29e55f1cb6 req-19ec09e8-c43f-40ce-9ef9-64ab4a5e264b service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5407319 Nov 24 04:10:08.020668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58504) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:08.030358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.127801 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3055a4f9-30f8-406e-a82b-0068937342b5 tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=76b249c4-619a-41db-83bc-ecf04415e0cf,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:08.133187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event deleted for resources: {'Port': ['ID=9374eb0d-5c32-4eab-8013-93e515c3eab9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:08.176174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:08.185794 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-093625b9-d184-4890-acdb-72d31d7e8c1e None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:08.190514 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bab99f19-5303-4ce0-9839-9a49b4e9f662 None None] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:08.260727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] vlan segment allocate from pool success with {'vlan_id': 167, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:08.289988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f45f3f36-0112-4c56-ad5e-e82c9db6fc1c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.313709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f6745add-76ba-4ed9-8b62-76001e54bd36 None None] Provisioning complete for port a69c4036-71d8-4e73-85d6-b937dbb4375e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:08.314091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f6745add-76ba-4ed9-8b62-76001e54bd36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.341629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.359141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.359490 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Added segment 22679353-171a-487c-a5ad-723e8922683b of type vlan for network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 Nov 24 04:10:08.371056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.484734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.511817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.560976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d13917e-351e-4152-8ad0-a7af7f9ced68 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:08.563536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.569866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Deleting port c7e79400-9389-41db-8a8d-3154de89f8c1 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:08.570264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.599354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.606978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.611915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.629738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.674407 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-48753d9a-6864-4266-bb5b-24d00eec1835 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:08.674780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-48753d9a-6864-4266-bb5b-24d00eec1835 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.701807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.702727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Fanout notify agent at l3_agent the message router_deleted on router cd7a63ff-28d8-4da2-a035-37e18bb65342 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:08.725227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.731099 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-64e48c34-fd60-497d-ad8d-c60d8e095701 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/cd7a63ff-28d8-4da2-a035-37e18bb65342 HTTP/1.1" status: 204 len: 168 time: 3.6529617 Nov 24 04:10:08.733225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58506) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:08.754330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1813299459', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:08.759043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:08.768028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.770831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:08.783556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:08.805018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.811035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:08.811719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.843299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=1ae068be-93bf-42f1-8697-36c677b3f994,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:08.875219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.884961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.884961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.888333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.889386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.944053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Calling delete_port for c7e79400-9389-41db-8a8d-3154de89f8c1 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:08.947729 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 1.2464759 Nov 24 04:10:08.954810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58510) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:08.960846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:08.970227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe5970e-d0f9-4e28-9244-7c90fd4a585e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Network': ['ID=8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:08.976791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Subnet': ['ID=874da414-186a-474a-94ec-a512ad74a10b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:08.984773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:08.985023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.990520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:08.992732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:08.996668 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-deef9988-0cdf-45ef-a8f0-9bda25b732be tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/874da414-186a-474a-94ec-a512ad74a10b HTTP/1.1" status: 204 len: 168 time: 1.2427027 Nov 24 04:10:09.001783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58512) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:09.046924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': 'dcb31614-0f41-463c-be02-aaf883b8ca54', 'ip_address': '2001:db8::f816:3eff:fe1b:b83a'}, {'subnet_id': '641ca6d1-3b91-405b-9c75-da69801a406c'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '01f5df4f-0724-4d40-904b-72624e51e972'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:10:09.102910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e2484032-5fe9-4b89-8164-aa0e9fbf4c28 None None] Provisioning complete for port a69c4036-71d8-4e73-85d6-b937dbb4375e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:09.103349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e2484032-5fe9-4b89-8164-aa0e9fbf4c28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.116434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.119106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.133666 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fd240a94-4957-4743-96b7-bcc62e3701ca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 3.8292110 Nov 24 04:10:09.142531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58514) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:09.206039 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b6ad8e3-50af-4dbd-b757-21ff6f6b06a0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:09.206289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.207734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b6ad8e3-50af-4dbd-b757-21ff6f6b06a0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:09.210710 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9b6ad8e3-50af-4dbd-b757-21ff6f6b06a0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.2046831 Nov 24 04:10:09.219139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58516) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:09.223692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.289058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=371f95f2-5a08-4d3c-a261-ebef200a940f,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:09.299308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-500e2015-30d6-4591-9741-eca0f1ec9197 req-558e748b-a06b-4d1f-8f2c-2675110e5388 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:09.300908 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-500e2015-30d6-4591-9741-eca0f1ec9197 req-558e748b-a06b-4d1f-8f2c-2675110e5388 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2371509 Nov 24 04:10:09.363110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.369399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Made reservation on behalf of ba0c2bd89365441e9aa39277bb74c7f3 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:09.374655 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.377910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5435fcc-9ff0-4972-b2b5-1101bfefc40f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:09.383825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5435fcc-9ff0-4972-b2b5-1101bfefc40f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:09.385457 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e5435fcc-9ff0-4972-b2b5-1101bfefc40f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1784 time: 0.2394390 Nov 24 04:10:09.389424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58518) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:09.412592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a69c4036-71d8-4e73-85d6-b937dbb4375e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:09.413289 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-94c13812-4b0d-4e04-94db-4a09f08e82cd tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.415186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-875ac465-47bf-40a9-8856-98e92d736d3f None None] Network 78c0685f-61f4-48a9-87dd-048ba3c3b855 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:09.470577 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-94c13812-4b0d-4e04-94db-4a09f08e82cd tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 24 04:10:09.471675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-94c13812-4b0d-4e04-94db-4a09f08e82cd tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:09.478851 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-94c13812-4b0d-4e04-94db-4a09f08e82cd tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/78c0685f-61f4-48a9-87dd-048ba3c3b855 HTTP/1.1" status: 409 len: 405 time: 0.2550426 Nov 24 04:10:09.496728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58520) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:09.499543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Performing IP validity checks on allocation pools {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:10:09.500076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:10:09.504294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-292728293'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:09.509486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.520584 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-500e2015-30d6-4591-9741-eca0f1ec9197 req-4ccf8a9e-c476-4ce0-b71d-177d87e66ab1 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1690838 Nov 24 04:10:09.563284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.597687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:09.602749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.617927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecc558fa-60f9-4f9b-9216-9bb11eb45c08 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:09.652795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Pushing event deleted for resources: {'Port': ['ID=c7e79400-9389-41db-8a8d-3154de89f8c1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:09.707433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] Allocated IP 172.20.0.2 (a2b36c78-43a6-4954-8102-cb5638999bb1/641ca6d1-3b91-405b-9c75-da69801a406c/01f5df4f-0724-4d40-904b-72624e51e972) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:09.711913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a69c4036-71d8-4e73-85d6-b937dbb4375e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:09.712292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.713520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] vlan segment allocate from pool success with {'vlan_id': 177, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:09.719721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e2484032-5fe9-4b89-8164-aa0e9fbf4c28 None None] Provisioning complete for port 89d611a7-346e-4d15-b118-f122ebf39cf1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:09.720172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e2484032-5fe9-4b89-8164-aa0e9fbf4c28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.729347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.733179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.737149 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1cc40646-c702-454b-ab20-05b2be82004a tempest-ServersTestJSON-103269613 tempest-ServersTestJSON-103269613-project] 10.222.0.48 "DELETE /v2.0/floatingips/c8213094-8b2a-4d86-9a1d-aa88ab727763 HTTP/1.1" status: 204 len: 168 time: 1.7009161 Nov 24 04:10:09.737496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58524) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:09.739926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.740272 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Added segment 6db2b4b5-d751-45c5-a529-9f5ae87783a2 of type vlan for network 13504368-6cfa-468c-b387-3c5a27add0ff Nov 24 04:10:09.746695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Deleting port 6df9846b-1643-450c-93a1-74fa97e85511 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:09.747029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.831688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e2484032-5fe9-4b89-8164-aa0e9fbf4c28 None None] Port 89d611a7-346e-4d15-b118-f122ebf39cf1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:09.890488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.959746 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] DHCP port deletion for 78c0685f-61f4-48a9-87dd-048ba3c3b855 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:09.973644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:09.979406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:09.981205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] For port 6df9846b-1643-450c-93a1-74fa97e85511, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6df9846b-1643-450c-93a1-74fa97e85511,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:09.981601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.991377 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:09.997381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:09.997940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.013779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Calling delete_port for 6df9846b-1643-450c-93a1-74fa97e85511 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:10.075527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e3901fbd-0a19-4717-8b7f-878a389ad632 None None] Provisioning complete for port 89d611a7-346e-4d15-b118-f122ebf39cf1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:10.076140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e3901fbd-0a19-4717-8b7f-878a389ad632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.104556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.121381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.133873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.179409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e3901fbd-0a19-4717-8b7f-878a389ad632 None None] Port 89d611a7-346e-4d15-b118-f122ebf39cf1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:10.224606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f65a14d-41ca-4c53-8ca2-594184c96034 req-dd699124-a307-4995-92e3-76f0a8dc83a9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:10.226231 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f65a14d-41ca-4c53-8ca2-594184c96034 req-dd699124-a307-4995-92e3-76f0a8dc83a9 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.6193295 Nov 24 04:10:10.231027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:10.231545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.233710 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP f5fcddb2-a8ce-46ba-a223-bd75bf422c60 associated. External IP: 172.26.5.254, port: 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8. Nov 24 04:10:10.236266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.242378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] Deleting port a69c4036-71d8-4e73-85d6-b937dbb4375e {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:10.242921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.306570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ccb485-ac16-4189-8048-4c90d4f5e2ac None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:10.345693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 1ae068be-93bf-42f1-8697-36c677b3f994 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:10.346037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.370419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] For port a69c4036-71d8-4e73-85d6-b937dbb4375e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a69c4036-71d8-4e73-85d6-b937dbb4375e,segment=NetworkSegment(d833e0c0-1270-44b9-8027-09ae0e7f8cae),segment_id=d833e0c0-1270-44b9-8027-09ae0e7f8cae)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:10.371423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.392460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] Calling delete_port for a69c4036-71d8-4e73-85d6-b937dbb4375e owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:10.440052 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.9410219 Nov 24 04:10:10.451108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58526) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:10.458037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=97f4a043-cff2-4afb-9057-9e3bcd830463,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:10.486082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'subnet': {'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:10.492647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca00e8ce-2cf5-46a7-91e8-b7796375cbdf tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Network': ['ID=13504368-6cfa-468c-b387-3c5a27add0ff,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:10.522555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 13504368-6cfa-468c-b387-3c5a27add0ff details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:10.566369 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f65a14d-41ca-4c53-8ca2-594184c96034 req-e841930c-5b4a-43d5-9889-1fa7ee02253a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3277321 Nov 24 04:10:10.570641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Checking segment: {'id': '22679353-171a-487c-a5ad-723e8922683b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:10.571246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network hostable DHCP agents. Network: 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:10.601489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.614998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] No DVR routers for this DVR port a69c4036-71d8-4e73-85d6-b937dbb4375e on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:10.642303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3befa7f0-eb22-4e43-8eff-56834d1faff3 None None] Pushing event deleted for resources: {'Port': ['ID=a69c4036-71d8-4e73-85d6-b937dbb4375e,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:10.718966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.761982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 1ae068be-93bf-42f1-8697-36c677b3f994 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:10.767810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:10.771713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.826260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:10.852979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.859748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.935556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:10.937284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:10.948473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da1027e8-87f6-40bb-b0f7-dc212847e538 None None] Network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:10.965059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:10.965738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.000786 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:11.008622 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e87a61cb-6706-4786-9ee6-6773add5e613 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 2.0491221 Nov 24 04:10:11.011562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58532) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:11.018611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:11.026127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.102656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Pushing event deleted for resources: {'Port': ['ID=6df9846b-1643-450c-93a1-74fa97e85511,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:11.110356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-523d9956-ecc4-46ad-8c6c-65e2b6c5b3db req-4b864126-b355-416f-8217-48cd6028dd64 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:11.111955 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-523d9956-ecc4-46ad-8c6c-65e2b6c5b3db req-4b864126-b355-416f-8217-48cd6028dd64 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2217870 Nov 24 04:10:11.373459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-4111412'] for subnet, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.378691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Allocated IP 172.26.5.220 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/b1b07034-94c4-489e-81e5-01f4874f2354) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:11.395582 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-523d9956-ecc4-46ad-8c6c-65e2b6c5b3db req-130e1f58-b154-4cc9-9242-4f04754ab3c5 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2500906 Nov 24 04:10:11.471831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3', 'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3', 'tenant_id': 'ba0c2bd89365441e9aa39277bb74c7f3', 'fixed_ips': [{'subnet_id': '97f4a043-cff2-4afb-9057-9e3bcd830463'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:11.473894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.527146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ea6f50d9-fd83-4d4d-a78a-91fee9b528ae None None] Provisioning complete for port 1ae068be-93bf-42f1-8697-36c677b3f994 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:11.527680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ea6f50d9-fd83-4d4d-a78a-91fee9b528ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.532187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:11.559986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:11.572477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.650568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.652791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:11.673265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.719347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:11.729472 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.765146 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0191af20-0ac4-45bd-9cf2-e7aff68b3d41 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 10.4912233 Nov 24 04:10:11.773873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:11.774715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:11.805335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.809136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=1ae068be-93bf-42f1-8697-36c677b3f994,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:11.813557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58538) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:11.818305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:11.818962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ea6f50d9-fd83-4d4d-a78a-91fee9b528ae None None] Port 1ae068be-93bf-42f1-8697-36c677b3f994 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:11.822885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:11.844465 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.849404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ea6f50d9-fd83-4d4d-a78a-91fee9b528ae None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:11.849917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ea6f50d9-fd83-4d4d-a78a-91fee9b528ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.851849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:11.852600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:11.921178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:11.922070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:11.925658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:11.926225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ecfc868-c99d-4b28-a52b-63d3c1ef2a33 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:11.952978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Subnet': ['ID=5c373f7e-fd4c-4fd4-91d9-17f526cab719,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:12.029232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.042743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4295609a-5b83-4556-885a-5cdc6827b263 req-db5bc76f-17df-4e62-9f8c-7b255ef41a07 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:12.044278 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4295609a-5b83-4556-885a-5cdc6827b263 req-db5bc76f-17df-4e62-9f8c-7b255ef41a07 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2801516 Nov 24 04:10:12.078978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.084219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.112118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Checking segment: {'id': '6db2b4b5-d751-45c5-a529-9f5ae87783a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:12.112748 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network hostable DHCP agents. Network: 13504368-6cfa-468c-b387-3c5a27add0ff, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:12.115058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.121006 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e014cc89-99e6-4353-ad72-7bc82fad1e83 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/1ae068be-93bf-42f1-8697-36c677b3f994 HTTP/1.1" status: 204 len: 168 time: 2.7175860 Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.121963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.122410 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.122807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.123201 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:12.123759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58540) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:12.125302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a69c4036-71d8-4e73-85d6-b937dbb4375e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:12.146580 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: a69c4036-71d8-4e73-85d6-b937dbb4375e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:12.146928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a69c4036-71d8-4e73-85d6-b937dbb4375e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:12.180644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3f0e27a9-61fa-4580-9e38-892b499d5ace None None] Could not find standard attr ID for object 1ae068be-93bf-42f1-8697-36c677b3f994. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:10:12.184607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 13504368-6cfa-468c-b387-3c5a27add0ff is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:12.232784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:12.237051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 13504368-6cfa-468c-b387-3c5a27add0ff) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:12.248177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb6a6fef-1bdb-45be-9a1f-e233c8c1d67d None None] Network 13504368-6cfa-468c-b387-3c5a27add0ff requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:12.249349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:12.249948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.252062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:12.264225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event updated for resources: {'Port': ['ID=b1b07034-94c4-489e-81e5-01f4874f2354,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:12.264322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8769089902457', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-3452072'] for subnet, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.268667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:12.289210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d246400-3146-4440-be7c-80e609321c6f None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:12.307152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76b4d040-0920-4e5f-9575-d5e0ff7e1432 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:12.309374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76b4d040-0920-4e5f-9575-d5e0ff7e1432 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:12.312514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76b4d040-0920-4e5f-9575-d5e0ff7e1432 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:12.314564 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-76b4d040-0920-4e5f-9575-d5e0ff7e1432 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1729228 Nov 24 04:10:12.317632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58542) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:12.323258 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3394e542-cf37-4bae-b7db-53c590a0c664 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 1.8705869 Nov 24 04:10:12.340718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58544) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:12.371404 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4295609a-5b83-4556-885a-5cdc6827b263 req-5f7d6a86-904a-46d9-9eba-dbb2f6cfcfa0 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2863755 Nov 24 04:10:12.399279 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:12.399948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.405809 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "PUT /v2.0/subnets/97f4a043-cff2-4afb-9057-9e3bcd830463 HTTP/1.1" status: 200 len: 900 time: 1.3930612 Nov 24 04:10:12.410798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58546) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:12.421557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Allocated IP 2001:db8::3 (8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3/97f4a043-cff2-4afb-9057-9e3bcd830463/cb6b0a3c-befc-4a71-aab6-5d6666aabd5f) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:12.435901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eff2a8c5-589b-4cdb-ada6-65a174d5e51a None None] Provisioning complete for port b1b07034-94c4-489e-81e5-01f4874f2354 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:12.436425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eff2a8c5-589b-4cdb-ada6-65a174d5e51a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.441294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.567241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eff2a8c5-589b-4cdb-ada6-65a174d5e51a None None] Port b1b07034-94c4-489e-81e5-01f4874f2354 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:12.576491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c6f057-36d3-456b-9fee-176ea8909ef1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event updated for resources: {'Subnet': ['ID=97f4a043-cff2-4afb-9057-9e3bcd830463,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:12.642063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-13504368-6cfa-468c-b387-3c5a27add0ff', 'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff', 'tenant_id': 'b122491e0fb34122afbcabe86bf340c9', 'fixed_ips': [{'subnet_id': '5c373f7e-fd4c-4fd4-91d9-17f526cab719'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:12.643096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.651095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 641ca6d1-3b91-405b-9c75-da69801a406c {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:12.692743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.793603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.796552 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.806015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.832067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.832357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.850245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Router 4f8aa7cd-415d-4905-bed0-488cc84270e3 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:12.857086 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.857403 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP f5fcddb2-a8ce-46ba-a223-bd75bf422c60 disassociated. External IP: 172.26.5.254, port: 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8. Nov 24 04:10:12.870299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Deleting port 6f666d10-1f35-49b9-8b78-f904cf455c7c {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:12.870637 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:12.893436 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Allocated IP 2001:db8::f816:3eff:fec7:c386 (13504368-6cfa-468c-b387-3c5a27add0ff/5c373f7e-fd4c-4fd4-91d9-17f526cab719/865b741d-62f2-4d4c-986e-9ed786703fb4) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:12.908997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:12.914378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:12.920474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Pushing event updated for resources: {'Port': ['ID=cb6b0a3c-befc-4a71-aab6-5d6666aabd5f,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:12.923793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:13.028472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Attempting to bind port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:13.029048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Attempting to bind port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '22679353-171a-487c-a5ad-723e8922683b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:13.029476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Attempting to bind port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f on network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:13.038596 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:13.039070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Checking segment: {'id': '22679353-171a-487c-a5ad-723e8922683b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:13.039545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.040021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Bound using segment: {'id': '22679353-171a-487c-a5ad-723e8922683b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:13.040561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Bound port: cb6b0a3c-befc-4a71-aab6-5d6666aabd5f, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '22679353-171a-487c-a5ad-723e8922683b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:13.041014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.139716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.160867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.169706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] For port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:13.173417 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.177165 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] For port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=cb6b0a3c-befc-4a71-aab6-5d6666aabd5f,segment=NetworkSegment(22679353-171a-487c-a5ad-723e8922683b),segment_id=22679353-171a-487c-a5ad-723e8922683b)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:13.206701 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.229918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Network 13504368-6cfa-468c-b387-3c5a27add0ff is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:13.239442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:13.245424 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:13.249056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Pushing event updated for resources: {'Port': ['ID=865b741d-62f2-4d4c-986e-9ed786703fb4,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:13.260196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.260696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.261729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.262187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.262623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.263082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.263535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.263985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.264431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.264859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.265292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.265715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:13.307848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:13.353752 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Attempting to bind port 865b741d-62f2-4d4c-986e-9ed786703fb4 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:13.354437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Attempting to bind port 865b741d-62f2-4d4c-986e-9ed786703fb4 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '6db2b4b5-d751-45c5-a529-9f5ae87783a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:13.355126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Attempting to bind port 865b741d-62f2-4d4c-986e-9ed786703fb4 on network 13504368-6cfa-468c-b387-3c5a27add0ff {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:13.371680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:13.372062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Checking segment: {'id': '6db2b4b5-d751-45c5-a529-9f5ae87783a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:13.372476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.372882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Bound using segment: {'id': '6db2b4b5-d751-45c5-a529-9f5ae87783a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:13.373375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Bound port: 865b741d-62f2-4d4c-986e-9ed786703fb4, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6db2b4b5-d751-45c5-a529-9f5ae87783a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '13504368-6cfa-468c-b387-3c5a27add0ff'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:13.373778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.384997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6f2516-13e3-4a08-a711-94bd6b08bb27 None None] Pushing event updated for resources: {'Port': ['ID=cb6b0a3c-befc-4a71-aab6-5d6666aabd5f,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:13.445724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.449485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.474331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] For port 865b741d-62f2-4d4c-986e-9ed786703fb4, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:13.479053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] For port 865b741d-62f2-4d4c-986e-9ed786703fb4, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=865b741d-62f2-4d4c-986e-9ed786703fb4,segment=NetworkSegment(6db2b4b5-d751-45c5-a529-9f5ae87783a2),segment_id=6db2b4b5-d751-45c5-a529-9f5ae87783a2)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:13.485893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.566560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c4ba72-84c9-43ff-9a1a-a5788d1a3b1e None None] Pushing event updated for resources: {'Port': ['ID=865b741d-62f2-4d4c-986e-9ed786703fb4,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:13.589739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:13.593850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.610663 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:13.630809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.631748 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:13.632571 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:13.637555 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-34248f4b-4171-4b8f-9b50-f76a297d8732 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/floatingips/f5fcddb2-a8ce-46ba-a223-bd75bf422c60 HTTP/1.1" status: 200 len: 688 time: 1.8226326 Nov 24 04:10:13.640271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58550) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:13.701336 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:13.702372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:13.703211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.715456 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:13.716154 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:13.762026 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:13.763031 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a53e900-7f01-4b93-a912-1ca269764672 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:13.810322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] For port 6f666d10-1f35-49b9-8b78-f904cf455c7c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6f666d10-1f35-49b9-8b78-f904cf455c7c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:13.810702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.873087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Calling delete_port for 6f666d10-1f35-49b9-8b78-f904cf455c7c owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:13.891698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] For port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=cb6b0a3c-befc-4a71-aab6-5d6666aabd5f,segment=NetworkSegment(22679353-171a-487c-a5ad-723e8922683b),segment_id=22679353-171a-487c-a5ad-723e8922683b)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:13.892141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.907862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2da272-d2fc-493c-81e6-49277762f0f7 req-84eed504-c300-49f0-9269-7d0f29e57dc4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:13.909598 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9c2da272-d2fc-493c-81e6-49277762f0f7 req-84eed504-c300-49f0-9269-7d0f29e57dc4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3407173 Nov 24 04:10:13.913168 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:13.922857 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-778e33d5-acea-4c64-b11b-b909ee50483f admin admin] 10.222.0.48 "PUT /v2.0/routers/4f8aa7cd-415d-4905-bed0-488cc84270e3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6011541 Nov 24 04:10:13.923020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58552) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:13.940444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] Sync routers for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:13.954856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Calling delete_port for cb6b0a3c-befc-4a71-aab6-5d6666aabd5f owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:13.963073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:13.966987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:13.969461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:14.001249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 371f95f2-5a08-4d3c-a261-ebef200a940f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:14.001615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.018034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.053278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Subnet': ['ID=5c373f7e-fd4c-4fd4-91d9-17f526cab719,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:14.117022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Router ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:10:14.147711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.154321 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/641ca6d1-3b91-405b-9c75-da69801a406c HTTP/1.1" status: 204 len: 168 time: 1.8345947 Nov 24 04:10:14.162494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58554) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:14.174275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.174838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.187670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbe6e4af-7bfb-4b71-abec-259871ae738a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=641ca6d1-3b91-405b-9c75-da69801a406c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:14.207029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 371f95f2-5a08-4d3c-a261-ebef200a940f owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:14.254603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.268403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:14.280220 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9c2da272-d2fc-493c-81e6-49277762f0f7 req-df51fa55-3c92-45b5-ab23-708570433f29 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3412645 Nov 24 04:10:14.324475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['13504368-6cfa-468c-b387-3c5a27add0ff']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:14.339464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.373904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet dcb31614-0f41-463c-be02-aaf883b8ca54 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:14.377761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6db2b4b5-d751-45c5-a529-9f5ae87783a2') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:14.378063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6db2b4b5-d751-45c5-a529-9f5ae87783a2') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:14.399485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.463329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.488073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32b61266-d357-4dbc-9485-4ab1f874bc38 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:14.585325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.765343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.767993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.817461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:10:10Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:14.819893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88203d2b-6eae-40d7-b6b2-4b2d2d45fa74 None None] Network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:14.860107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.869414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 177 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:14.869861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.913975 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] Checking router: 4f8aa7cd-415d-4905-bed0-488cc84270e3 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:10:14.925275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:14.938037 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] Sync routers for ids ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:14.953789 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] Routers {'ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:14.962515 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:14.972242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:14.975769 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:15.002532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] Routers {'4f8aa7cd-415d-4905-bed0-488cc84270e3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:15.003783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['4f8aa7cd-415d-4905-bed0-488cc84270e3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:15.007100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ba6d9dc2-a40d-4526-87fb-02bd565e3552 None None] Provisioning complete for port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:15.007696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba6d9dc2-a40d-4526-87fb-02bd565e3552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.045716 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:15.055975 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.056550 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] Routers {'ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:15.057376 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:15.066732 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f6909ee3-76f9-48ef-a043-05d0c34598d3 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 6.3201261 Nov 24 04:10:15.069104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=371f95f2-5a08-4d3c-a261-ebef200a940f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:15.074004 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58560) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:15.084411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:15.109312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=dcb31614-0f41-463c-be02-aaf883b8ca54,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:15.123455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:10:15.123455 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:10:15.123455 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'id': '13504368-6cfa-468c-b387-3c5a27add0ff'}] Nov 24 04:10:15.123455 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:15.123783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:15.136415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.139632 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f073994d-5143-4578-b50a-363af07218f2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/dcb31614-0f41-463c-be02-aaf883b8ca54 HTTP/1.1" status: 204 len: 168 time: 0.9709940 Nov 24 04:10:15.144837 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:15.146724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.149619 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2cfba0ce-e173-4c8e-a58f-11cee93b26a2 None None] The sync data for ids ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:15.153135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58562) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:15.201203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.206748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.207166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.207580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.208846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.210293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.210901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.211330 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-51b6336b-8e10-46e0-b499-ae967fb9fbe3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0523262 Nov 24 04:10:15.211480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.211723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.212138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.212546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.213007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.213360 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:10:15.216627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.219596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.225428 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-07843e65-cd10-45d0-b1f8-c4c6ca7cf8e9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/floatingips/f5fcddb2-a8ce-46ba-a223-bd75bf422c60 HTTP/1.1" status: 204 len: 168 time: 1.5795074 Nov 24 04:10:15.225428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58564) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:15.225428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58566) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:15.232001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:15.238501 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3557c20-6957-4ba8-a027-0d8b2397552f None None] Network 13504368-6cfa-468c-b387-3c5a27add0ff requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:15.239737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '5ee20480-1bf7-450b-b47b-dbf62c478f88'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:15.244391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Pushing event deleted for resources: {'Port': ['ID=6f666d10-1f35-49b9-8b78-f904cf455c7c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:15.283645 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea9818-0fa6-4304-9736-81befecc27f2 req-5d09c732-d0b3-4bed-9f76-2d396cd29038 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:15.293117 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-52ea9818-0fa6-4304-9736-81befecc27f2 req-5d09c732-d0b3-4bed-9f76-2d396cd29038 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.5665636 Nov 24 04:10:15.315569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.319121 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ba6d9dc2-a40d-4526-87fb-02bd565e3552 None None] Could not find standard attr ID for object cb6b0a3c-befc-4a71-aab6-5d6666aabd5f. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:10:15.334327 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.plugins.ml2.db [None req-ba6d9dc2-a40d-4526-87fb-02bd565e3552 None None] No ports have port_id starting with cb6b0a3c-befc-4a71-aab6-5d6666aabd5f Nov 24 04:10:15.404682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-831fa5a7-2bb6-444b-82a5-eec9df6fb8cd None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': 'dcb31614-0f41-463c-be02-aaf883b8ca54'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '01f5df4f-0724-4d40-904b-72624e51e972'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:10:15.406875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Port': ['ID=cb6b0a3c-befc-4a71-aab6-5d6666aabd5f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:15.459240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] Set router 4f8aa7cd-415d-4905-bed0-488cc84270e3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:15.465692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device cb6b0a3c-befc-4a71-aab6-5d6666aabd5f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:15.481096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No DVR routers for this DVR port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:15.490584 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-52ea9818-0fa6-4304-9736-81befecc27f2 req-d124b4e7-e34a-4af0-bd11-32ac34849e5f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1965578 Nov 24 04:10:15.564698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.585748 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.596970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: cb6b0a3c-befc-4a71-aab6-5d6666aabd5f {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:15.597370 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device cb6b0a3c-befc-4a71-aab6-5d6666aabd5f not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:10:15.601636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-831fa5a7-2bb6-444b-82a5-eec9df6fb8cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.663293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.681650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Deleting port 56919873-aabb-4651-947d-5d6a306972db {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:15.681997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.693527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port cb6b0a3c-befc-4a71-aab6-5d6666aabd5f not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:10:15.693946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 865b741d-62f2-4d4c-986e-9ed786703fb4 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:15.730866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.741406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:15.746115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.749592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d8a34afc-ab55-4856-9146-daa6ac8a4740 None None] Provisioning complete for port 865b741d-62f2-4d4c-986e-9ed786703fb4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:15.750014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d8a34afc-ab55-4856-9146-daa6ac8a4740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.756935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.828518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=97f4a043-cff2-4afb-9057-9e3bcd830463,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:15.933247 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2742f21a-1748-4274-806d-30631a910bca None None] Network 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:15.966975 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.968119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:15.970848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting port 865b741d-62f2-4d4c-986e-9ed786703fb4 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:15.971505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.028928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:16.041096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 865b741d-62f2-4d4c-986e-9ed786703fb4 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:16.041583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.066909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e2e3054-b4e3-4421-86dc-67724e3561f1 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:16.070709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '22679353-171a-487c-a5ad-723e8922683b') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:16.071008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '22679353-171a-487c-a5ad-723e8922683b') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:16.088585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.101199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] For port 865b741d-62f2-4d4c-986e-9ed786703fb4, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=865b741d-62f2-4d4c-986e-9ed786703fb4,segment=NetworkSegment(6db2b4b5-d751-45c5-a529-9f5ae87783a2),segment_id=6db2b4b5-d751-45c5-a529-9f5ae87783a2)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:16.101719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.107577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] DHCP port deletion for 13504368-6cfa-468c-b387-3c5a27add0ff request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:16.123845 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:16.155908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Calling delete_port for 865b741d-62f2-4d4c-986e-9ed786703fb4 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:16.158033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.170864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:16.180077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 167 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:16.180333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=ccfbaa0d-a530-44e7-9dc8-6518b7c60224,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:16.180422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.187862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:16.188367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.191684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:16.198967 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:16.203518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] For port 56919873-aabb-4651-947d-5d6a306972db, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56919873-aabb-4651-947d-5d6a306972db,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:16.203906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.260285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Calling delete_port for 56919873-aabb-4651-947d-5d6a306972db owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:16.315675 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca3ee0e0-0f5c-426b-b75e-9e5b82e38dd9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0875056 Nov 24 04:10:16.321198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58568) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:16.328449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:16.341375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d8a34afc-ab55-4856-9146-daa6ac8a4740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.349152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.354338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.358014 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 HTTP/1.1" status: 204 len: 168 time: 3.9159207 Nov 24 04:10:16.363269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58570) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:16.399242 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ecb119-8762-4a96-8013-5ba273367aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:16.400936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.408658 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-ce8da2bd-4b55-4bff-869c-add4119413d9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:16.409335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ce8da2bd-4b55-4bff-869c-add4119413d9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:16.413351 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ce8da2bd-4b55-4bff-869c-add4119413d9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/97f4a043-cff2-4afb-9057-9e3bcd830463 HTTP/1.1" status: 404 len: 337 time: 0.0455701 Nov 24 04:10:16.423153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58572) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:16.450815 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-1df82ca4-c958-43a6-a595-1d4e38df02a3 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:16.451606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1df82ca4-c958-43a6-a595-1d4e38df02a3 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:16.454607 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1df82ca4-c958-43a6-a595-1d4e38df02a3 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 HTTP/1.1" status: 404 len: 339 time: 0.0302887 Nov 24 04:10:16.460451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58574) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:16.478504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d8a34afc-ab55-4856-9146-daa6ac8a4740 None None] For port 865b741d-62f2-4d4c-986e-9ed786703fb4, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=865b741d-62f2-4d4c-986e-9ed786703fb4,segment=NetworkSegment(6db2b4b5-d751-45c5-a529-9f5ae87783a2),segment_id=6db2b4b5-d751-45c5-a529-9f5ae87783a2)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:16.493448 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Router 8f58b51f-193c-43f1-ae94-d69a879a0453 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:16.494389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.495649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d8a34afc-ab55-4856-9146-daa6ac8a4740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.504352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:10:10Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:16.574913 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.192 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/bce2925c-f33a-4a62-97ff-f816806c74f3) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:16.580677 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3b85a4a-f5b4-49d9-a7f4-7591bab3bf4d None None] DHCP port deletion for 8e3f66d5-8b58-4b63-b0b9-20f0362f6ef3 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:16.589807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.603522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a34afc-ab55-4856-9146-daa6ac8a4740 None None] Pushing event deleted for resources: {'Port': ['ID=865b741d-62f2-4d4c-986e-9ed786703fb4,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:16.605480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5baafab1-e84f-4eb3-9e03-29af76977943 None None] The sync data for ids ['4f8aa7cd-415d-4905-bed0-488cc84270e3'] in dv-neutron-819049-1-hyperv is: [{'id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'name': 'tempest-ServersTestManualDisk-369546969-router', 'tenant_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177'}], 'enable_snat': True}, 'gw_port_id': '56919873-aabb-4651-947d-5d6a306972db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:10:10Z', 'revision_number': 5, 'project_id': 'f983a1d6cdc44b639c49bee8aa3a5f49', 'gw_port': {'id': '56919873-aabb-4651-947d-5d6a306972db', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:74:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8aa7cd-415d-4905-bed0-488cc84270e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 97, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:17Z', 'updated_at': '2021-11-24T04:08:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:16.625006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Deleting port 865b741d-62f2-4d4c-986e-9ed786703fb4 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:16.625394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.659317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No DVR routers for this DVR port 865b741d-62f2-4d4c-986e-9ed786703fb4 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:16.672212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Port': ['ID=865b741d-62f2-4d4c-986e-9ed786703fb4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:16.709567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.748656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5d28707f-0be9-4aab-a62d-77218351e433 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:16.748971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5d28707f-0be9-4aab-a62d-77218351e433 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.757649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] For port 865b741d-62f2-4d4c-986e-9ed786703fb4, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:16.758046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.799350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Calling delete_port for 865b741d-62f2-4d4c-986e-9ed786703fb4 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:16.804132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Port 865b741d-62f2-4d4c-986e-9ed786703fb4 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:10:16.805692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Deleting port b1b07034-94c4-489e-81e5-01f4874f2354 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:16.806273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.809230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.821425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a0d357-a946-4077-a81b-83ff1e31a61a req-4694720a-a567-415b-afa3-4791a5a69ecf tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:16.823585 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f3a0d357-a946-4077-a81b-83ff1e31a61a req-4694720a-a567-415b-afa3-4791a5a69ecf tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1635404 Nov 24 04:10:16.841933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] Pushing event deleted for resources: {'Port': ['ID=865b741d-62f2-4d4c-986e-9ed786703fb4,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:16.848027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f30a529-5c7c-4e75-b88b-82e6536ecf1e None None] No DVR routers for this DVR port 865b741d-62f2-4d4c-986e-9ed786703fb4 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:16.895069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.897785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:16.901913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.939792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.946617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': 'ccfbaa0d-a530-44e7-9dc8-6518b7c60224'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '01f5df4f-0724-4d40-904b-72624e51e972'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:10:16.954326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.979584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:16.992834 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Pushing event deleted for resources: {'Port': ['ID=56919873-aabb-4651-947d-5d6a306972db,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:17.003013 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['13504368-6cfa-468c-b387-3c5a27add0ff']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.024875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6db2b4b5-d751-45c5-a529-9f5ae87783a2') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.025175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6db2b4b5-d751-45c5-a529-9f5ae87783a2') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.026255 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f3a0d357-a946-4077-a81b-83ff1e31a61a req-9ec6cad7-79af-4ea4-bcca-51e6302d8b1d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1772444 Nov 24 04:10:17.082790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.096093 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.138354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Calling delete_port for b1b07034-94c4-489e-81e5-01f4874f2354 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:17.146904 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50f43996-cea3-4d7f-a193-f1cd21ded086 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:17.196720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.247120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.286060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] Allocated IP 172.20.0.2 (a2b36c78-43a6-4954-8102-cb5638999bb1/ccfbaa0d-a530-44e7-9dc8-6518b7c60224/01f5df4f-0724-4d40-904b-72624e51e972) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:17.392288 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device cb6b0a3c-befc-4a71-aab6-5d6666aabd5f no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:17.422624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: cb6b0a3c-befc-4a71-aab6-5d6666aabd5f {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:17.422989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device cb6b0a3c-befc-4a71-aab6-5d6666aabd5f not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:17.423395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:17.461657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:17.484655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.504812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.510366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:17.522188 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-58cad21e-b711-4f06-b732-9ac66adf6034 admin admin] 10.222.0.48 "PUT /v2.0/routers/8f58b51f-193c-43f1-ae94-d69a879a0453/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.7789197 Nov 24 04:10:17.523215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58580) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:17.529723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.544303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] Sync routers for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:17.549240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.602555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ca93b6c-d365-488d-a235-b3f46ddeea7b']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.607972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 177 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:17.608743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.613556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:17.616269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:17.617361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.619300 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:17.619439 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:17.623768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:17.629919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=bce2925c-f33a-4a62-97ff-f816806c74f3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:17.632740 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:17.639111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.644243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.650187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9efb803e-0d4f-40e6-b1ca-a99b4448c7a9') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.650489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9efb803e-0d4f-40e6-b1ca-a99b4448c7a9') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:17.695080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-725d15f9-41b3-4af6-823b-4ead2db369eb None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=7']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:17.747047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.778709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:17.779074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:17.787779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.793909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.794610 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4f8aa7cd-415d-4905-bed0-488cc84270e3 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:17.799054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a127662-70a3-4c8c-9fa1-395243842abc req-818937e4-9772-4003-ad05-58b9e4e5271c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:17.800750 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4a127662-70a3-4c8c-9fa1-395243842abc req-818937e4-9772-4003-ad05-58b9e4e5271c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3117092 Nov 24 04:10:17.803384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.804554 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3ef0411-efa9-4776-8211-2b026980ad31 admin admin] 10.222.0.48 "DELETE /v2.0/routers/4f8aa7cd-415d-4905-bed0-488cc84270e3 HTTP/1.1" status: 204 len: 168 time: 3.8795662 Nov 24 04:10:17.811117 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58582) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:17.821967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.826332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.833414 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/13504368-6cfa-468c-b387-3c5a27add0ff HTTP/1.1" status: 204 len: 168 time: 5.4914210 Nov 24 04:10:17.834721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:17.837808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 151 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:17.838235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:17.841267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58584) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:17.846589 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:17.852282 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-784815119'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:17.923595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3fefd6-cfca-4050-8aa0-54f514ba2631 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Network': ['ID=13504368-6cfa-468c-b387-3c5a27add0ff,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:18.000149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Deleting subnet d6b900d5-6e1c-467d-a80c-b932fd4e77fd {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:18.002421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.009948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.094667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.139253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.155192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9136c571-1690-4532-a8f2-cc3e02fae6ef None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:18.161673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Pushing event deleted for resources: {'Port': ['ID=b1b07034-94c4-489e-81e5-01f4874f2354,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:18.168939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:10:14Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:18.187216 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4a127662-70a3-4c8c-9fa1-395243842abc req-d0749217-fb2f-4630-a694-bdaaf3a98307 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3721259 Nov 24 04:10:18.191053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.199032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:18.202921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.204156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] Checking router: 8f58b51f-193c-43f1-ae94-d69a879a0453 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:10:18.215205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] Routers {'8f58b51f-193c-43f1-ae94-d69a879a0453'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:18.215825 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8f58b51f-193c-43f1-ae94-d69a879a0453'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:18.277227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.288826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.292696 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/3ca93b6c-d365-488d-a235-b3f46ddeea7b HTTP/1.1" status: 204 len: 168 time: 1.8273332 Nov 24 04:10:18.300228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58588) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:18.332067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] vlan segment allocate from pool success with {'vlan_id': 162, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:18.343180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.343913 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Added segment 8bad8a89-6627-448e-8747-0c211eff1dfc of type vlan for network 2c32a762-8159-46fe-a2e9-eae7358623f8 Nov 24 04:10:18.388202 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.414359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c65fb74-4ca4-41ca-9925-5529cc52c787 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=3ca93b6c-d365-488d-a235-b3f46ddeea7b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:18.424314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.430053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:18.430739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.488328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.550739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.571608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] Set router 8f58b51f-193c-43f1-ae94-d69a879a0453 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:10:18.601675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Network': ['ID=2c32a762-8159-46fe-a2e9-eae7358623f8,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:18.618751 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4511807b-6b94-463a-84cc-75ec2f31d6d5 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.7712095 Nov 24 04:10:18.623471 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f4a8f90-92d9-4681-91c0-4d94390fb656 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:18.623956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f4a8f90-92d9-4681-91c0-4d94390fb656 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:18.627393 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3f4a8f90-92d9-4681-91c0-4d94390fb656 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/7a13a54e-2e51-4a11-a88e-418f4ec8b1c8 HTTP/1.1" status: 404 len: 337 time: 0.3138180 Nov 24 04:10:18.629020 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58590) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:18.637446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'subnet': {'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:18.642841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 2c32a762-8159-46fe-a2e9-eae7358623f8 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:18.645951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58592) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:18.692076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d76f8101-f659-4a02-a893-c3f13fd149ec tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:18.692736 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:18.692858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d76f8101-f659-4a02-a893-c3f13fd149ec tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:18.700537 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d76f8101-f659-4a02-a893-c3f13fd149ec tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/c025adea-51c3-4eb6-a148-813b50abc4c2 HTTP/1.1" status: 404 len: 339 time: 0.0475311 Nov 24 04:10:18.708888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58594) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:18.740260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.740877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 865b741d-62f2-4d4c-986e-9ed786703fb4 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:18.748510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7384240a-b987-4d15-9521-7edf3d641054 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:18.788733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f04944-d2f6-4ee2-b999-60473f356a8a req-c3a5d94a-2db1-477e-9ab2-1fda3d5ca3a4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:18.790271 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d3f04944-d2f6-4ee2-b999-60473f356a8a req-c3a5d94a-2db1-477e-9ab2-1fda3d5ca3a4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.5111632 Nov 24 04:10:18.791570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.856867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 865b741d-62f2-4d4c-986e-9ed786703fb4 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:18.857120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 865b741d-62f2-4d4c-986e-9ed786703fb4 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:18.857533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6df9846b-1643-450c-93a1-74fa97e85511 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:18.869042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Deleting port 5503f0ee-7113-45e0-8806-1eb6b4320966 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:18.869394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.889166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting subnet ab352553-110b-4a28-bdb0-1a9f4bb412fb {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:18.899229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.931770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.936659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6df9846b-1643-450c-93a1-74fa97e85511 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:18.937007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6df9846b-1643-450c-93a1-74fa97e85511 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:18.952829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.960862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.967776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f45f1009-2d61-4b36-a000-25594a4e1f20 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:18.968780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f45f1009-2d61-4b36-a000-25594a4e1f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:18.972578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=8']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:19.042916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.084278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:19.087766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.100341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:19.176144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f45f1009-2d61-4b36-a000-25594a4e1f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.183771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:10:14Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:19.206824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] For port 5503f0ee-7113-45e0-8806-1eb6b4320966, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=5503f0ee-7113-45e0-8806-1eb6b4320966,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:19.207218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.218348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce1275e5-2eff-4837-889f-60f711a86cbf None None] The sync data for ids ['8f58b51f-193c-43f1-ae94-d69a879a0453'] in dv-neutron-819049-1-hyperv is: [{'id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'name': 'tempest-ServersTestJSON-482089353-router', 'tenant_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108'}], 'enable_snat': True}, 'gw_port_id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:16Z', 'updated_at': '2021-11-24T04:10:14Z', 'revision_number': 5, 'project_id': 'ca64a4f493b349449d44be7e1d9fb98c', 'gw_port': {'id': '5503f0ee-7113-45e0-8806-1eb6b4320966', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:84:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f58b51f-193c-43f1-ae94-d69a879a0453', 'device_owner': 'network:router_gateway', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.108', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:19Z', 'updated_at': '2021-11-24T04:08:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:19.269693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f45f1009-2d61-4b36-a000-25594a4e1f20 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:19.274795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Calling delete_port for 5503f0ee-7113-45e0-8806-1eb6b4320966 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:19.279478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f45f1009-2d61-4b36-a000-25594a4e1f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.289048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': 'ccfbaa0d-a530-44e7-9dc8-6518b7c60224', 'ip_address': '172.20.0.2'}, {'subnet_id': 'cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '01f5df4f-0724-4d40-904b-72624e51e972'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:10:19.351680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.380105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45f1009-2d61-4b36-a000-25594a4e1f20 None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=9']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:19.423316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.441478 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d3f04944-d2f6-4ee2-b999-60473f356a8a req-b5203499-69d2-45e1-90e5-c03b08ac6aed tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6194003 Nov 24 04:10:19.450624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.509194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Router ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:19.518056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d6b900d5-6e1c-467d-a80c-b932fd4e77fd,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:19.525704 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.530399 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2a1a2758-0250-42b8-b60b-4efb7580eda7 admin admin] 10.222.0.48 "DELETE /v2.0/subnets/d6b900d5-6e1c-467d-a80c-b932fd4e77fd HTTP/1.1" status: 204 len: 168 time: 1.7079294 Nov 24 04:10:19.547562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58598) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:19.547796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee908263-8758-48d3-8ccc-7a2b4fb1868e None None] Network bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:19.635162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 2001:db8::f816:3eff:fe1b:b83a-f600aa40-0b52-475a-90cc-711bbd26f6 {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:19.635162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:19.643025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.647754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:19.654178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.673072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.674298 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-36f6997b-aed7-4480-a3ad-b9e9ecf1eef2 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "PUT /v2.0/routers/ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 200 len: 706 time: 4.5935936 Nov 24 04:10:19.676891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58600) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:19.693013 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] Sync routers for ids ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:19.707026 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] Routers {'ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:19.707890 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:19.709160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:19.764100 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:19.784958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:19.786041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.786266 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] Routers {'ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:19.787427 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:19.830580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.831411 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b1416cef-732a-4575-8bc5-696910b01bc9 tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/routers/ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 200 len: 741 time: 0.1534228 Nov 24 04:10:19.834394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58602) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:19.884854 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:19.888862 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-94240cc3-0c93-4f3d-98e4-d6c4e198eaeb tempest-RoutersAdminTest-1540441334 tempest-RoutersAdminTest-1540441334-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 200 len: 205 time: 0.0532286 Nov 24 04:10:19.892662 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0429f3bb-d274-41d8-8efd-c7666dfb89cc None None] The sync data for ids ['ae4c0819-0c6e-4a11-a70f-c05f69ae36b2'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:19.902788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58604) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:19.927465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] DHCP port deletion for bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:19.929891 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.939835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=ab352553-110b-4a28-bdb0-1a9f4bb412fb,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:19.949790 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-293f243e-7d57-4e3d-959e-a56617594108 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 200 len: 205 time: 0.0458152 Nov 24 04:10:19.952372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58606) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:19.961368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:19.964716 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-947d7de1-183a-43ff-a9a5-cab4aea13887 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/ab352553-110b-4a28-bdb0-1a9f4bb412fb HTTP/1.1" status: 204 len: 168 time: 1.2481260 Nov 24 04:10:19.968709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b9b9604-04a5-4bf5-937b-c7ccf9e2394e None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:19.970127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58608) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:19.972996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.074105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9194ae7-8692-4e02-99f6-eaeb211f2e32 req-48e32438-0fdc-4d0d-9f32-8ce4a336e7da tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:20.075650 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a9194ae7-8692-4e02-99f6-eaeb211f2e32 req-48e32438-0fdc-4d0d-9f32-8ce4a336e7da tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.4899952 Nov 24 04:10:20.077771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.080287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56919873-aabb-4651-947d-5d6a306972db no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:20.116216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 56919873-aabb-4651-947d-5d6a306972db {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:20.116511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56919873-aabb-4651-947d-5d6a306972db not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:20.209361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.232577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] Deleting port 70b28543-0e73-41ab-be7f-487bfec19b39 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:20.232953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.244141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Subnet': ['ID=a05a4ddb-356e-4f54-8bc4-dd221548a44c,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:20.249720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting subnet 00a22817-3b62-4e1a-a6a5-9779ed61a227 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:20.258267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.269432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.270020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.278876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.282431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.287247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.351500 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Pushing event deleted for resources: {'Port': ['ID=5503f0ee-7113-45e0-8806-1eb6b4320966,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:20.388878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.389576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Fanout notify agent at l3_agent the message router_deleted on router ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:20.400195 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a9194ae7-8692-4e02-99f6-eaeb211f2e32 req-48d97c39-0536-4442-b04a-1b1d379908d3 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2976527 Nov 24 04:10:20.407556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.408840 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9cc1c854-3762-4e3e-982d-93679f022f9d tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 204 len: 168 time: 0.4555595 Nov 24 04:10:20.413360 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58610) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.414237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=bce2925c-f33a-4a62-97ff-f816806c74f3,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:20.444041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e5f9918-9063-45b7-91ae-cd09c2e28b7b None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:20.448732 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-13f2551d-baf9-4b09-826b-b5c69b5ca7f6 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 200 len: 205 time: 0.0306399 Nov 24 04:10:20.451679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58612) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.458853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Checking segment: {'id': '8bad8a89-6627-448e-8747-0c211eff1dfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:20.459220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network hostable DHCP agents. Network: 2c32a762-8159-46fe-a2e9-eae7358623f8, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:20.461524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.484673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.530172 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-517c7eb7-7621-4bda-b7bf-4951772f255b tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] delete failed (client error): The resource could not be found. Nov 24 04:10:20.531464 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-517c7eb7-7621-4bda-b7bf-4951772f255b tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/ae4c0819-0c6e-4a11-a70f-c05f69ae36b2 HTTP/1.1" status: 404 len: 336 time: 0.0787423 Nov 24 04:10:20.538074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58616) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.540838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] For port 70b28543-0e73-41ab-be7f-487bfec19b39, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70b28543-0e73-41ab-be7f-487bfec19b39,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:20.541102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.560161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:20.570448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] Calling delete_port for 70b28543-0e73-41ab-be7f-487bfec19b39 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:20.586958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Deleting port 70b28543-0e73-41ab-be7f-487bfec19b39 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:20.587350 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.605342 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9f449da6-8ddd-4a4f-a26f-50d13df8796b tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=cd7a63ff-28d8-4da2-a035-37e18bb65342 HTTP/1.1" status: 200 len: 205 time: 0.0578868 Nov 24 04:10:20.605342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.610869 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 4c166adf-64ad-4b1f-acc0-a6d718ed4163 associated. External IP: 172.26.5.192, port: 5ee20480-1bf7-450b-b47b-dbf62c478f88. Nov 24 04:10:20.613687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58618) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.688339 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-9aa8506b-f732-44fa-a645-1a23ce9b97f8 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] delete failed (client error): The resource could not be found. Nov 24 04:10:20.689655 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9aa8506b-f732-44fa-a645-1a23ce9b97f8 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/cd7a63ff-28d8-4da2-a035-37e18bb65342 HTTP/1.1" status: 404 len: 336 time: 0.0742228 Nov 24 04:10:20.693949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58620) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.735886 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-db75d474-2900-4c65-8133-0534f150ae82 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 HTTP/1.1" status: 200 len: 205 time: 0.0364354 Nov 24 04:10:20.747405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:20.764034 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58622) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.781278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] Pushing event deleted for resources: {'Port': ['ID=70b28543-0e73-41ab-be7f-487bfec19b39,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:20.789232 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-affb49be-9b93-4954-8f7c-3d15842e6eac None None] No DVR routers for this DVR port 70b28543-0e73-41ab-be7f-487bfec19b39 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:20.821822 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-0d356388-0846-4778-b993-782edf2b85e8 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] delete failed (client error): The resource could not be found. Nov 24 04:10:20.822914 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0d356388-0846-4778-b993-782edf2b85e8 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/ca97f8f3-3f7b-497f-875f-fdb9fd4e7193 HTTP/1.1" status: 404 len: 336 time: 0.0576749 Nov 24 04:10:20.826394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58624) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.863631 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-317117a5-4fe9-4d80-ae3e-25812d0a28b6 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=6f32a371-4603-4af4-8fd1-deb0d04e6c8d HTTP/1.1" status: 200 len: 205 time: 0.0360820 Nov 24 04:10:20.865927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.907126 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-878a9e23-1e27-45f6-868b-3bff989ccedc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] delete failed (client error): The resource could not be found. Nov 24 04:10:20.910782 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-878a9e23-1e27-45f6-868b-3bff989ccedc tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/6f32a371-4603-4af4-8fd1-deb0d04e6c8d HTTP/1.1" status: 404 len: 336 time: 0.0413406 Nov 24 04:10:20.954188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58628) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:20.991542 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4d8dbe36-3521-4284-8ea9-5576d188fdcf tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=254035a8-de52-4bcb-8176-a8d74b1e3452 HTTP/1.1" status: 200 len: 205 time: 0.0336993 Nov 24 04:10:20.993006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58630) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.063709 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-b1ee920b-9cb8-41f0-8435-d4472af39695 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] delete failed (client error): The resource could not be found. Nov 24 04:10:21.066288 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b1ee920b-9cb8-41f0-8435-d4472af39695 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/254035a8-de52-4bcb-8176-a8d74b1e3452 HTTP/1.1" status: 404 len: 336 time: 0.0712709 Nov 24 04:10:21.068792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58632) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.082237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 2c32a762-8159-46fe-a2e9-eae7358623f8 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:21.101552 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c48a1a65-9992-47ed-a10e-7b5ab8c26671 tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "GET /v2.0/ports?device_id=3d7560cf-46f6-4f4f-ac2f-a48f0342f627 HTTP/1.1" status: 200 len: 205 time: 0.0314016 Nov 24 04:10:21.103862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58634) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.146608 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-9b2b3792-6013-4c68-b088-27dcb5c89ceb tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] delete failed (client error): The resource could not be found. Nov 24 04:10:21.149814 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b2b3792-6013-4c68-b088-27dcb5c89ceb tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/routers/3d7560cf-46f6-4f4f-ac2f-a48f0342f627 HTTP/1.1" status: 404 len: 336 time: 0.0422339 Nov 24 04:10:21.150441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58636) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.165198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.174010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:21.174507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:21.174622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.176505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 2c32a762-8159-46fe-a2e9-eae7358623f8) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:21.181161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] For port 70b28543-0e73-41ab-be7f-487bfec19b39, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70b28543-0e73-41ab-be7f-487bfec19b39,segment=NetworkSegment(cbe779b8-68a9-4f40-be0b-27da35492bc4),segment_id=cbe779b8-68a9-4f40-be0b-27da35492bc4)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:21.181527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.184474 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-6c908812-2246-486a-8501-47b84b31d05c tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:21.184633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.184938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6c908812-2246-486a-8501-47b84b31d05c tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:21.185951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.186725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.188016 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6c908812-2246-486a-8501-47b84b31d05c tempest-RoutersAdminTest-1624222282 tempest-RoutersAdminTest-1624222282-project] 10.222.0.48 "DELETE /v2.0/subnets/d77a702d-35de-44c6-8fe9-03bced4d3eba HTTP/1.1" status: 404 len: 337 time: 0.0348644 Nov 24 04:10:21.190039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:21.191211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8149088d-6da2-40f5-8ff7-3039f879daf8 None None] Network 2c32a762-8159-46fe-a2e9-eae7358623f8 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:21.208014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:21.208613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.245877 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.250677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Calling delete_port for 70b28543-0e73-41ab-be7f-487bfec19b39 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:21.385211 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:10:21.400022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:21.403537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:21.409107 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2b63ef5f-f101-4eaf-b237-f94d6030dab0 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.7766709 Nov 24 04:10:21.409820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.410369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8f58b51f-193c-43f1-ae94-d69a879a0453 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:21.420662 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58640) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.430855 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:21.464706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:21.465387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.466996 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-866b21d7-1e48-4d5e-a1ad-f7903d058e6a admin admin] 10.222.0.48 "DELETE /v2.0/routers/8f58b51f-193c-43f1-ae94-d69a879a0453 HTTP/1.1" status: 204 len: 168 time: 3.9397590 Nov 24 04:10:21.474556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:21.476422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:21.479206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:21.479794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.485865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58642) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.494671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-fcfc3f3b-51aa-4120-ac65-50f53dd446f9 None None] Provisioning complete for port e7f5f50e-d994-4e1b-b684-b1e392aef100 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:21.495375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fcfc3f3b-51aa-4120-ac65-50f53dd446f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.538126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=11']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:21.555388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:21.556052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:21.593516 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4bbcd1dc-4dc8-4e30-8715-dfca99e3108a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 5.2703836 Nov 24 04:10:21.600015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58646) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.608072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-2c32a762-8159-46fe-a2e9-eae7358623f8', 'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8', 'tenant_id': 'b122491e0fb34122afbcabe86bf340c9', 'fixed_ips': [{'subnet_id': 'a05a4ddb-356e-4f54-8bc4-dd221548a44c'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:21.609546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.619853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:ab:a1:5d', 'name': 'tempest-NetworksTestDHCPv6-1721811707'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:21.621252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.635386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.658684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Deleting subnet ac08ee4f-45d7-4c2e-ab90-055d80970c38 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:21.658893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:21.663416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.676274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58648) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.709496 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2e29a516-7a04-45f5-b3a6-603b076fe816 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 6.4735632 Nov 24 04:10:21.712813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58652) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.717041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.717758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:21.718430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:21.746826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=00a22817-3b62-4e1a-a6a5-9779ed61a227,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:21.748657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.752002 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-22ef10dc-6b0e-47ed-bd4e-d037c46caa8e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/00a22817-3b62-4e1a-a6a5-9779ed61a227 HTTP/1.1" status: 204 len: 168 time: 1.7768872 Nov 24 04:10:21.759456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58654) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.787372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.803341 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:21.803895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.804058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89505ba8-f9b4-4179-b4a0-537217b68b3b None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:21.811835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cfb4d6a-fb94-4a49-9fd0-01ed3125a00c None None] Network 9636bfff-8e74-468a-bd36-23db9868f00f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:21.822280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.860741 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-40d29499-75b5-4393-bfb4-11be4cbdfdeb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/floatingips/4c166adf-64ad-4b1f-acc0-a6d718ed4163 HTTP/1.1" status: 200 len: 978 time: 0.1465251 Nov 24 04:10:21.863719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:21.864389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58656) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:21.893767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Pushing event deleted for resources: {'Port': ['ID=70b28543-0e73-41ab-be7f-487bfec19b39,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:21.953010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] No DVR routers for this DVR port 70b28543-0e73-41ab-be7f-487bfec19b39 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:21.973160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9fd95cca-4c18-4f98-a30f-0fa2f9a682ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.021255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.099323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:22.099874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.148213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.152655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:22.181542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Allocated IP 2001:db8::2 (2c32a762-8159-46fe-a2e9-eae7358623f8/a05a4ddb-356e-4f54-8bc4-dd221548a44c/fb8d03f6-77fb-4a32-b908-8604cbeb132c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:22.188717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.242451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:22.269341 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-89376be7-52ff-4fc3-b84e-5ac9d6ee2e7b tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 981 time: 0.4013376 Nov 24 04:10:22.270198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58658) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:22.275402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'port_id': '6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:22.275583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cbe779b8-68a9-4f40-be0b-27da35492bc4') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:22.275744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cbe779b8-68a9-4f40-be0b-27da35492bc4') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:22.312557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] DHCP port deletion for 9636bfff-8e74-468a-bd36-23db9868f00f request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:22.336137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.341737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.371938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.396400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Releasing vlan 160 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:22.396822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:22.418524 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:22.430385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.455370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9fd95cca-4c18-4f98-a30f-0fa2f9a682ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.483099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.497629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting port e7f5f50e-d994-4e1b-b684-b1e392aef100 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:22.497970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.499632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9fd95cca-4c18-4f98-a30f-0fa2f9a682ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.563201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:22.585749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-454fe26b-27ab-4310-9bca-2e3abba967dc None None] Network 9279fc65-0f7e-4ac5-8fda-e94ff426a487 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:22.592007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ac08ee4f-45d7-4c2e-ab90-055d80970c38,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:22.594003 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.598086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.603587 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-44bd66ad-8899-47bf-8453-bb84ae5a49e9 admin admin] 10.222.0.48 "DELETE /v2.0/subnets/ac08ee4f-45d7-4c2e-ab90-055d80970c38 HTTP/1.1" status: 204 len: 168 time: 1.1131766 Nov 24 04:10:22.604365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58660) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:22.607782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 6fcdd7cf-a7cc-4996-a2a2-09000d520674 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:22.612566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] Deleting port e7f5f50e-d994-4e1b-b684-b1e392aef100 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:22.612939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.624793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6f666d10-1f35-49b9-8b78-f904cf455c7c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:22.627557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.634058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.640578 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] 10.222.0.48 "DELETE /v2.0/networks/bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30 HTTP/1.1" status: 204 len: 168 time: 3.0901120 Nov 24 04:10:22.693973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6f666d10-1f35-49b9-8b78-f904cf455c7c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:22.694417 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6f666d10-1f35-49b9-8b78-f904cf455c7c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:22.694868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70b28543-0e73-41ab-be7f-487bfec19b39 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:22.712953 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9fd95cca-4c18-4f98-a30f-0fa2f9a682ac admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=b81593e7bb2447cd929d817e7f91b3f4&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0331466 Nov 24 04:10:22.723508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58664) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:22.726483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.729558 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd792d7-989b-4c11-bf11-58b0e9150653 admin admin] Pushing event deleted for resources: {'Network': ['ID=bd9a2ff7-ffec-4009-8f18-6d3e7ae3ed30,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:22.736287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.747946 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] For port e7f5f50e-d994-4e1b-b684-b1e392aef100, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7f5f50e-d994-4e1b-b684-b1e392aef100,segment=NetworkSegment(88ff4684-70ec-40d1-a214-97fbe7672f4e),segment_id=88ff4684-70ec-40d1-a214-97fbe7672f4e)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:22.748274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.751243 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd95cca-4c18-4f98-a30f-0fa2f9a682ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4796450-7df4-457d-9c51-7074b5ee6df2,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:22.765083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.775936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.785447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Calling delete_port for e7f5f50e-d994-4e1b-b684-b1e392aef100 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:22.808422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 70b28543-0e73-41ab-be7f-487bfec19b39 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:22.808422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70b28543-0e73-41ab-be7f-487bfec19b39 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:22.834941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.862951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Subnet': ['ID=a05a4ddb-356e-4f54-8bc4-dd221548a44c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:22.870831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] For port e7f5f50e-d994-4e1b-b684-b1e392aef100, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7f5f50e-d994-4e1b-b684-b1e392aef100,segment=NetworkSegment(88ff4684-70ec-40d1-a214-97fbe7672f4e),segment_id=88ff4684-70ec-40d1-a214-97fbe7672f4e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:22.871230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:22.911886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Network 2c32a762-8159-46fe-a2e9-eae7358623f8 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:22.931175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:22.934773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:22.939304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] Calling delete_port for e7f5f50e-d994-4e1b-b684-b1e392aef100 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:22.947038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Pushing event updated for resources: {'Port': ['ID=fb8d03f6-77fb-4a32-b908-8604cbeb132c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:22.983871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58666) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:22.985736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.002132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f253f5d6-9b45-479a-94f0-005a5ccac10a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.047559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f253f5d6-9b45-479a-94f0-005a5ccac10a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.060177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.090909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c32a762-8159-46fe-a2e9-eae7358623f8']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:23.103227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No DVR routers for this DVR port e7f5f50e-d994-4e1b-b684-b1e392aef100 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:23.105957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Port': ['ID=e7f5f50e-d994-4e1b-b684-b1e392aef100,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.121648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8bad8a89-6627-448e-8747-0c211eff1dfc') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:23.122247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8bad8a89-6627-448e-8747-0c211eff1dfc') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:23.146980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.183585 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-644d9aa3-2424-43d4-b65b-6f4d2638b0d2 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=f983a1d6cdc44b639c49bee8aa3a5f49&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1937006 Nov 24 04:10:23.187491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58668) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:23.188700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.212134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 162 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:23.213020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:23.227793 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:23.257858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.278543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Attempting to bind port fb8d03f6-77fb-4a32-b908-8604cbeb132c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:23.279248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Attempting to bind port fb8d03f6-77fb-4a32-b908-8604cbeb132c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8bad8a89-6627-448e-8747-0c211eff1dfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:23.279248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Attempting to bind port fb8d03f6-77fb-4a32-b908-8604cbeb132c on network 2c32a762-8159-46fe-a2e9-eae7358623f8 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:23.281157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c8bb89-98dc-403e-8a5f-3b05c78a51f3 None None] Pushing event updated for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=12']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.290538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 172.20.0.7 (a2b36c78-43a6-4954-8102-cb5638999bb1/ccfbaa0d-a530-44e7-9dc8-6518b7c60224/6fcdd7cf-a7cc-4996-a2a2-09000d520674) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:23.300906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:23.301283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Checking segment: {'id': '8bad8a89-6627-448e-8747-0c211eff1dfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:23.301691 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.302125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Bound using segment: {'id': '8bad8a89-6627-448e-8747-0c211eff1dfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:23.302685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Bound port: fb8d03f6-77fb-4a32-b908-8604cbeb132c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8bad8a89-6627-448e-8747-0c211eff1dfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': '2c32a762-8159-46fe-a2e9-eae7358623f8'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:23.303111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.303236 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9636bfff-8e74-468a-bd36-23db9868f00f']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:23.306469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:feab:a15d (a2b36c78-43a6-4954-8102-cb5638999bb1/cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c/6fcdd7cf-a7cc-4996-a2a2-09000d520674) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:23.329488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88ff4684-70ec-40d1-a214-97fbe7672f4e') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:23.331613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88ff4684-70ec-40d1-a214-97fbe7672f4e') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:23.357489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f253f5d6-9b45-479a-94f0-005a5ccac10a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.360070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f253f5d6-9b45-479a-94f0-005a5ccac10a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.374646 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f253f5d6-9b45-479a-94f0-005a5ccac10a admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/a4796450-7df4-457d-9c51-7074b5ee6df2 HTTP/1.1" status: 204 len: 168 time: 0.6329072 Nov 24 04:10:23.383202 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.399191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] DHCP port deletion for 9279fc65-0f7e-4ac5-8fda-e94ff426a487 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:23.403716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.417666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.resource_extend [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:10:23.424461 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Deleting port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:23.429416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.446664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f253f5d6-9b45-479a-94f0-005a5ccac10a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4796450-7df4-457d-9c51-7074b5ee6df2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.450852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.453033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] For port fb8d03f6-77fb-4a32-b908-8604cbeb132c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:23.468446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 197 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:23.468889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:23.473060 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:23.499663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.api [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:10:23.499663 dv-neutron-819049-1-hyperv neutron-server[103381]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:10:23.499663 dv-neutron-819049-1-hyperv neutron-server[103381]: [parameters: {'id': '2c32a762-8159-46fe-a2e9-eae7358623f8'}] Nov 24 04:10:23.499663 dv-neutron-819049-1-hyperv neutron-server[103381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103381) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:23.500327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG oslo_db.api [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:23.504197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:23.507976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] Pushing event deleted for resources: {'Port': ['ID=e7f5f50e-d994-4e1b-b684-b1e392aef100,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.510217 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e61608ae-419a-4d6f-b5b5-a80765508fde None None] No DVR routers for this DVR port e7f5f50e-d994-4e1b-b684-b1e392aef100 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:23.589155 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.600911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] For port fb8d03f6-77fb-4a32-b908-8604cbeb132c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fb8d03f6-77fb-4a32-b908-8604cbeb132c,segment=NetworkSegment(8bad8a89-6627-448e-8747-0c211eff1dfc),segment_id=8bad8a89-6627-448e-8747-0c211eff1dfc)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:23.608057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.614123 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/9636bfff-8e74-468a-bd36-23db9868f00f HTTP/1.1" status: 204 len: 168 time: 1.8482890 Nov 24 04:10:23.614430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.619351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58672) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:23.631923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.662797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] For port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:23.663542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.668229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0deb47a0-af01-4af2-8e6b-3e9f77323c24 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.673209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] Deleting port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:23.673932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.675712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372f1313-533a-4aa1-abea-2d7c0e782aa1 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=9636bfff-8e74-468a-bd36-23db9868f00f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.695935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.738684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.741185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Calling delete_port for 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:23.769486 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ff1195-b02c-4ea0-aaf0-2bc57202a785 None None] Pushing event updated for resources: {'Port': ['ID=fb8d03f6-77fb-4a32-b908-8604cbeb132c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.787322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.807664 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-04d24c40-9952-4447-8f6f-53d23d599ad7 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:23.808252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-04d24c40-9952-4447-8f6f-53d23d599ad7 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:23.811166 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-04d24c40-9952-4447-8f6f-53d23d599ad7 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/21b77914-7e45-44eb-a4cd-2bd05f5a8f16 HTTP/1.1" status: 404 len: 337 time: 0.1776247 Nov 24 04:10:23.820573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58676) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:23.832136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] For port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,segment=NetworkSegment(667b698e-2807-47a4-bcfc-45f0f3202512),segment_id=667b698e-2807-47a4-bcfc-45f0f3202512)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:23.832642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.844187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0deb47a0-af01-4af2-8e6b-3e9f77323c24 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:23.862225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=6fcdd7cf-a7cc-4996-a2a2-09000d520674,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:23.864799 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c9e9c89-a75d-4581-8372-a48182dd506e None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:23.874211 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-d475f4f4-06b2-4a6d-bb0b-2ca78bd61aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:23.874641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:23.874758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d475f4f4-06b2-4a6d-bb0b-2ca78bd61aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:23.876225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] Calling delete_port for 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:23.876353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:23.878502 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d475f4f4-06b2-4a6d-bb0b-2ca78bd61aaf tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/d668fe39-f315-48ad-a281-ce3c1e32a77d HTTP/1.1" status: 404 len: 339 time: 0.0525765 Nov 24 04:10:23.882849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:23.886392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58678) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:23.960205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-4696f562-46ce-4fd8-b1a6-7e5403526fb3 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:23.961190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4696f562-46ce-4fd8-b1a6-7e5403526fb3 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:23.964769 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4696f562-46ce-4fd8-b1a6-7e5403526fb3 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/8c55ca26-c5a1-43b5-83c0-5afdab99fa63 HTTP/1.1" status: 404 len: 337 time: 0.0762274 Nov 24 04:10:23.967921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58680) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:23.975083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdf4fc8f-88a9-4e04-a039-135c4cdf9dd1 None None] Network 2c32a762-8159-46fe-a2e9-eae7358623f8 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:23.993081 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-101c6cc4-da14-45ee-9c96-b60d7b88e5fc tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:23.993594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-101c6cc4-da14-45ee-9c96-b60d7b88e5fc tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:23.997979 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-101c6cc4-da14-45ee-9c96-b60d7b88e5fc tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/86ab2784-1c7c-49c8-a410-580753aaecdb HTTP/1.1" status: 404 len: 339 time: 0.0292838 Nov 24 04:10:24.001036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58682) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.002754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.020033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:24.020698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.022312 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 4c166adf-64ad-4b1f-acc0-a6d718ed4163 associated. External IP: 172.26.5.192, port: 5ee20480-1bf7-450b-b47b-dbf62c478f88. Nov 24 04:10:24.060091 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-104f2981-5168-489a-aa7e-706b13c376a9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:24.060608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-104f2981-5168-489a-aa7e-706b13c376a9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:24.063754 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-104f2981-5168-489a-aa7e-706b13c376a9 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/af108464-aeb6-461a-9325-8e45f71c19dc HTTP/1.1" status: 404 len: 337 time: 0.0618420 Nov 24 04:10:24.064627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58684) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.078957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58686) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.085450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:24.085830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.091357 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-937ed147-d3d7-40cb-bf30-353b7a70fbab tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.4899402 Nov 24 04:10:24.092111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58688) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.092214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0deb47a0-af01-4af2-8e6b-3e9f77323c24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.094505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0deb47a0-af01-4af2-8e6b-3e9f77323c24 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.098089 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0deb47a0-af01-4af2-8e6b-3e9f77323c24 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/1d22bf61-baf3-4793-9d23-a40fdd7b7104 HTTP/1.1" status: 204 len: 168 time: 0.9025626 Nov 24 04:10:24.112351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.118705 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1e9178e4-efd7-423d-a156-54c3814454d9 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:24.119206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1e9178e4-efd7-423d-a156-54c3814454d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.131200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-92a8645b-57fb-4740-b766-20d92445f41e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:24.131804 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-92a8645b-57fb-4740-b766-20d92445f41e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:24.137973 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-92a8645b-57fb-4740-b766-20d92445f41e tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/beab3bda-7c8e-463e-8007-e4bcafe99977 HTTP/1.1" status: 404 len: 339 time: 0.0523283 Nov 24 04:10:24.138871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58692) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.157819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0deb47a0-af01-4af2-8e6b-3e9f77323c24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d22bf61-baf3-4793-9d23-a40fdd7b7104,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:24.163133 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.196303 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2ae17328-c2b5-415f-8de4-952628d1b5cc admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=cbb7c05c40054eb690b9e741395338ee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1305923 Nov 24 04:10:24.200623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58694) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.213667 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccb39788-528f-488f-baba-8dbb9efda8f8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:24.220734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccb39788-528f-488f-baba-8dbb9efda8f8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:24.226045 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ccb39788-528f-488f-baba-8dbb9efda8f8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1864 time: 0.1322422 Nov 24 04:10:24.227409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58696) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.237164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] No DVR routers for this DVR port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:24.247361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting subnet 349c4db4-9db8-40f6-b5d1-f1e10cf06f3e {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:24.251085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.258993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Pushing event deleted for resources: {'Port': ['ID=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:24.279075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] Pushing event deleted for resources: {'Port': ['ID=8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:24.283743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee8c1f78-dee6-4a85-b858-713fccabd9b1 None None] No DVR routers for this DVR port 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:24.365634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.516679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.578212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5503f0ee-7113-45e0-8806-1eb6b4320966 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:24.612833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 5503f0ee-7113-45e0-8806-1eb6b4320966 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:24.613535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 5503f0ee-7113-45e0-8806-1eb6b4320966 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:24.613811 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7f5f50e-d994-4e1b-b684-b1e392aef100 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:24.622400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.652658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e7f5f50e-d994-4e1b-b684-b1e392aef100 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:24.653158 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7f5f50e-d994-4e1b-b684-b1e392aef100 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:24.672073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.674066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6067c6b5-ef99-410b-8f8f-5a9bd7b214cd None None] Network 9a49573f-b949-41da-8c25-9ae3174f545b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:24.677476 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/349c4db4-9db8-40f6-b5d1-f1e10cf06f3e HTTP/1.1" status: 204 len: 168 time: 0.5368850 Nov 24 04:10:24.701763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58706) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:24.711239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5c95d5-e000-4059-8383-f8647018f453 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=349c4db4-9db8-40f6-b5d1-f1e10cf06f3e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:24.821538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.827242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting port fb8d03f6-77fb-4a32-b908-8604cbeb132c {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:24.827816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.841279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.909544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting port 68085816-de5c-415b-93be-5558699fefc8 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:24.911092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.930067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] DHCP port deletion for 9a49573f-b949-41da-8c25-9ae3174f545b request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:24.972770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673ebe3a-cb16-4e74-9b47-9c082e2ebe94 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:24.993354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9279fc65-0f7e-4ac5-8fda-e94ff426a487']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.039513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-af24f855-f044-4d31-a2a1-7c1c63d81e22 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:25.039889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af24f855-f044-4d31-a2a1-7c1c63d81e22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.040805 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] For port 68085816-de5c-415b-93be-5558699fefc8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=68085816-de5c-415b-93be-5558699fefc8,segment=NetworkSegment(49d23002-af0e-47fe-af58-60e30b337f6e),segment_id=49d23002-af0e-47fe-af58-60e30b337f6e)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:25.041237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.051856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673ebe3a-cb16-4e74-9b47-9c082e2ebe94 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.060248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Calling delete_port for 68085816-de5c-415b-93be-5558699fefc8 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:25.086847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] Deleting port 68085816-de5c-415b-93be-5558699fefc8 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:25.087228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.135810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '667b698e-2807-47a4-bcfc-45f0f3202512') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.136181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '667b698e-2807-47a4-bcfc-45f0f3202512') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.172665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.177408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.183858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] For port fb8d03f6-77fb-4a32-b908-8604cbeb132c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fb8d03f6-77fb-4a32-b908-8604cbeb132c,segment=NetworkSegment(8bad8a89-6627-448e-8747-0c211eff1dfc),segment_id=8bad8a89-6627-448e-8747-0c211eff1dfc)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:25.184311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.211889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] For port 68085816-de5c-415b-93be-5558699fefc8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=68085816-de5c-415b-93be-5558699fefc8,segment=NetworkSegment(49d23002-af0e-47fe-af58-60e30b337f6e),segment_id=49d23002-af0e-47fe-af58-60e30b337f6e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:25.212516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.228566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 6fcdd7cf-a7cc-4996-a2a2-09000d520674 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:25.228927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.232522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.235188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No DVR routers for this DVR port 68085816-de5c-415b-93be-5558699fefc8 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:25.239580 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] Calling delete_port for 68085816-de5c-415b-93be-5558699fefc8 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:25.242024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Calling delete_port for fb8d03f6-77fb-4a32-b908-8604cbeb132c owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:25.259610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Port': ['ID=68085816-de5c-415b-93be-5558699fefc8,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:25.269618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Releasing vlan 158 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:25.270024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:25.271912 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:25.296978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673ebe3a-cb16-4e74-9b47-9c082e2ebe94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.299942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673ebe3a-cb16-4e74-9b47-9c082e2ebe94 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.301105 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-673ebe3a-cb16-4e74-9b47-9c082e2ebe94 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/81f22f8f-2786-45c3-ad7d-6a6398f7af17 HTTP/1.1" status: 204 len: 168 time: 1.0979052 Nov 24 04:10:25.334522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-af24f855-f044-4d31-a2a1-7c1c63d81e22 None None] Provisioning complete for port 6fcdd7cf-a7cc-4996-a2a2-09000d520674 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:25.336308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af24f855-f044-4d31-a2a1-7c1c63d81e22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.370402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 68085816-de5c-415b-93be-5558699fefc8 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:25.401663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.422827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 68085816-de5c-415b-93be-5558699fefc8 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:25.423402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 68085816-de5c-415b-93be-5558699fefc8 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:25.423989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:25.426862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a49573f-b949-41da-8c25-9ae3174f545b']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.439100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49d23002-af0e-47fe-af58-60e30b337f6e') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.439588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49d23002-af0e-47fe-af58-60e30b337f6e') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.451806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:25.452762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-673ebe3a-cb16-4e74-9b47-9c082e2ebe94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81f22f8f-2786-45c3-ad7d-6a6398f7af17,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:25.462171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.475741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:25.476363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8f7d2aab-ed9e-4587-a3d0-ca9facb03b2c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:25.478071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-af24f855-f044-4d31-a2a1-7c1c63d81e22 None None] Port 6fcdd7cf-a7cc-4996-a2a2-09000d520674 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:25.487536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.500898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.507511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 164 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:25.507926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:25.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:25.524252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.549318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.552578 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] 10.222.0.48 "DELETE /v2.0/networks/9279fc65-0f7e-4ac5-8fda-e94ff426a487 HTTP/1.1" status: 204 len: 168 time: 2.9467311 Nov 24 04:10:25.569844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] Pushing event deleted for resources: {'Port': ['ID=68085816-de5c-415b-93be-5558699fefc8,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:25.576887 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d448d03-8a36-4d8f-b65c-b8e3f73136cb None None] No DVR routers for this DVR port 68085816-de5c-415b-93be-5558699fefc8 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:25.605808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53f75c2a-2e5e-46cc-8aef-dc18753f4b49 None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:10:25.622036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.632538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee0a4bfa-ccc7-462f-bed3-7b1e0825540b admin admin] Pushing event deleted for resources: {'Network': ['ID=9279fc65-0f7e-4ac5-8fda-e94ff426a487,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:25.644775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4f185a9-7544-4e47-b199-6c805fa82b7f None None] Provisioning complete for port 6fcdd7cf-a7cc-4996-a2a2-09000d520674 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:25.645286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4f185a9-7544-4e47-b199-6c805fa82b7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.671971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 6fcdd7cf-a7cc-4996-a2a2-09000d520674 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:25.710327 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.717329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.722763 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/9a49573f-b949-41da-8c25-9ae3174f545b HTTP/1.1" status: 204 len: 168 time: 1.0187879 Nov 24 04:10:25.725881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58726) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:25.734328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:25.810665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Port': ['ID=fb8d03f6-77fb-4a32-b908-8604cbeb132c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:25.823100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No DVR routers for this DVR port fb8d03f6-77fb-4a32-b908-8604cbeb132c on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:25.845174 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a78b651-2db2-48ea-8cad-90bc230acd49 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:25.845567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1a78b651-2db2-48ea-8cad-90bc230acd49 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:25.853528 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1a78b651-2db2-48ea-8cad-90bc230acd49 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/e196d631-e150-44a2-834f-5c8ac192bceb HTTP/1.1" status: 404 len: 337 time: 0.1125312 Nov 24 04:10:25.858312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01324c76-8d37-4547-aca1-2e7e6a3c513f tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=9a49573f-b949-41da-8c25-9ae3174f545b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:25.864686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58730) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:25.878771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:25.893731 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:25.910296 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:25.911190 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:25.912554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b4f185a9-7544-4e47-b199-6c805fa82b7f None None] Port 6fcdd7cf-a7cc-4996-a2a2-09000d520674 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:25.929185 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-044c5861-4859-4690-ba5d-b27916b9b799 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:25.929709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-044c5861-4859-4690-ba5d-b27916b9b799 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:25.937082 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-044c5861-4859-4690-ba5d-b27916b9b799 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/d67ce1fa-0a12-4693-91ed-d0858961a4e7 HTTP/1.1" status: 404 len: 339 time: 0.0690439 Nov 24 04:10:25.937248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58732) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:25.971924 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.001304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53f75c2a-2e5e-46cc-8aef-dc18753f4b49 None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:10:26.013612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c32a762-8159-46fe-a2e9-eae7358623f8']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:26.025347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58736) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:26.035923 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:26.053207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8bad8a89-6627-448e-8747-0c211eff1dfc') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:26.053207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8bad8a89-6627-448e-8747-0c211eff1dfc') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:26.059813 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:26.062313 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:26.069615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.092152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting subnet 1bacb3a7-3670-41c2-ab32-f3272ff96726 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:26.120604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.130659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.146348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 162 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:26.146926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:26.152207 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:26.174559 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:26.175092 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f73f62e-8ef9-42ef-a733-5a823ddaa1a0 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:26.217207 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a6d46a26-6446-44b6-9068-671a2d6924a4 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=ca64a4f493b349449d44be7e1d9fb98c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1872599 Nov 24 04:10:26.224128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58746) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:26.247384 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.306856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.324971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.331431 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/2c32a762-8159-46fe-a2e9-eae7358623f8 HTTP/1.1" status: 204 len: 168 time: 4.9053133 Nov 24 04:10:26.363312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58752) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:26.370965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-750182404'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:26.374220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.376027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc09733-4c6e-4879-9bfe-2c2103c7310d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Network': ['ID=2c32a762-8159-46fe-a2e9-eae7358623f8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:26.388563 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.447522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bab434ef-f729-4104-a5f5-5ad20888a600 None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:10:26.456832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=6fcdd7cf-a7cc-4996-a2a2-09000d520674,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:26.488301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.502394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:26.506599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.537072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Subnet': ['ID=1bacb3a7-3670-41c2-ab32-f3272ff96726,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:26.544856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.553581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58756) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:26.556255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:26.564677 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6ccc5cf0-fd2f-473a-96a8-016c99870138 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/subnets/1bacb3a7-3670-41c2-ab32-f3272ff96726 HTTP/1.1" status: 204 len: 168 time: 0.6263430 Nov 24 04:10:26.588105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc058358-cfc2-4fa1-98d0-4c9e678ff787 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.630072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc058358-cfc2-4fa1-98d0-4c9e678ff787 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.631754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Provisioning complete for port 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:26.632131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.692038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bab434ef-f729-4104-a5f5-5ad20888a600 None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:10:26.694010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Port 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:26.719272 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Provisioning complete for port 9c22bb44-3211-49e7-bcde-f7d29f0a526d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:26.719656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.737662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc058358-cfc2-4fa1-98d0-4c9e678ff787 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.740936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc058358-cfc2-4fa1-98d0-4c9e678ff787 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.745534 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dc058358-cfc2-4fa1-98d0-4c9e678ff787 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/e6d556a2-92d9-4a4f-b8c6-de3a57b1cc6a HTTP/1.1" status: 204 len: 168 time: 0.5150204 Nov 24 04:10:26.756909 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc058358-cfc2-4fa1-98d0-4c9e678ff787 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6d556a2-92d9-4a4f-b8c6-de3a57b1cc6a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:26.793965 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58768) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:26.858138 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Port 9c22bb44-3211-49e7-bcde-f7d29f0a526d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:26.886964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Provisioning complete for port 5ee20480-1bf7-450b-b47b-dbf62c478f88 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:26.887509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.951791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9a98f3ea-d249-49c3-af2d-18d66924b266 None None] Port 5ee20480-1bf7-450b-b47b-dbf62c478f88 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:26.973985 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.978936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] vlan segment allocate from pool success with {'vlan_id': 156, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:26.985082 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:26.990543 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-17206a9c-463f-426f-b514-6943fce17113 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/6fcdd7cf-a7cc-4996-a2a2-09000d520674 HTTP/1.1" status: 204 len: 168 time: 2.7561493 Nov 24 04:10:26.990880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58776) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:27.029926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.030375 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Added segment 0520e700-2316-494c-beaa-d360a144f708 of type vlan for network 1f0134be-da60-412e-9e00-5a7b46a9485f Nov 24 04:10:27.098133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f57b302c-3e56-4882-9f67-75543744857a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:27.100218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f57b302c-3e56-4882-9f67-75543744857a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:27.102711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f57b302c-3e56-4882-9f67-75543744857a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:27.111373 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f57b302c-3e56-4882-9f67-75543744857a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1119928 Nov 24 04:10:27.111992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58778) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:27.141833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.147253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab4a2cf0-256a-4873-b5f2-b38a9c8a1684 None None] Network 96924243-5b50-48fb-b900-d2dd42606c99 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:27.206759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-667868660', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:27.210721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:27.236051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.239400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:27.276944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Made reservation on behalf of 53e7c8dd3d44486cbaf260355228ad3b for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:27.277158 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:27.277382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:27.280503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.292423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.307845 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:27.308812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.313055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.320757 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:27.358557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:27.359202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:27.417693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:27.418318 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11ef76a7-b2ad-4c55-a3ad-7d6ee8cd8098 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:27.459422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Deleting port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:27.459638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.462761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet ccfbaa0d-a530-44e7-9dc8-6518b7c60224 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:27.480209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.506453 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.515962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.530613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] DHCP port deletion for 96924243-5b50-48fb-b900-d2dd42606c99 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:27.550432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] device_id is not set on port aa18c758-37a2-4bb0-bc11-c1a1df0ed57f yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:27.557865 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.1933737 Nov 24 04:10:27.562481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdc30da3-fdb7-4952-aef2-a8bc4ace6fd4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:27.567761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58792) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:27.585635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Request body: {'subnet': {'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:27.590920 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-52196292-2d8e-443e-8cdc-1d369ab0e9f9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/floatingips/4c166adf-64ad-4b1f-acc0-a6d718ed4163 HTTP/1.1" status: 200 len: 978 time: 5.3202124 Nov 24 04:10:27.596854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58796) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:27.601913 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e39d5ae-862f-433d-95ff-da79d307fc15 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Network': ['ID=1f0134be-da60-412e-9e00-5a7b46a9485f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:27.628445 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 1f0134be-da60-412e-9e00-5a7b46a9485f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:27.638009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.652214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] Deleting port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:27.652958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.659131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:27.696802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] For port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,segment=NetworkSegment(a10d4f6d-ed5d-43bb-8e18-aae4f2c75848),segment_id=a10d4f6d-ed5d-43bb-8e18-aae4f2c75848)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:27.697172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.723049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.728379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Calling delete_port for 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:27.773639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] For port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,segment=NetworkSegment(a10d4f6d-ed5d-43bb-8e18-aae4f2c75848),segment_id=a10d4f6d-ed5d-43bb-8e18-aae4f2c75848)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:27.774214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.788222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] Calling delete_port for 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:27.888311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.893854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:27.938413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] Pushing event deleted for resources: {'Port': ['ID=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:27.943243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Port': ['ID=1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:27.947170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] No DVR routers for this DVR port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:27.959587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1778002e-de71-4f73-8f8a-030fed4520f5 None None] No DVR routers for this DVR port 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:28.066701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.099815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96924243-5b50-48fb-b900-d2dd42606c99']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:28.113559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:28.113856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a10d4f6d-ed5d-43bb-8e18-aae4f2c75848') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:28.128305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.143916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.152858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Releasing vlan 199 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:28.153287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:28.158363 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:28.249522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.257350 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.264338 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] 10.222.0.48 "DELETE /v2.0/networks/96924243-5b50-48fb-b900-d2dd42606c99 HTTP/1.1" status: 204 len: 168 time: 1.7060781 Nov 24 04:10:28.278564 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d6c772-a85e-4c23-941c-7b90de62f5e0 tempest-NetworksIpV6Test-1344159784 tempest-NetworksIpV6Test-1344159784-project] Pushing event deleted for resources: {'Network': ['ID=96924243-5b50-48fb-b900-d2dd42606c99,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:28.364699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58822) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:28.374848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.433190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Allocated IP 172.26.5.101 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/aa18c758-37a2-4bb0-bc11-c1a1df0ed57f) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:28.460776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Made reservation on behalf of b122491e0fb34122afbcabe86bf340c9 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:28.464798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.478133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.478606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-1931191582'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:28.501226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.501763 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 4c166adf-64ad-4b1f-acc0-a6d718ed4163 disassociated. External IP: 172.26.5.192, port: 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8. Nov 24 04:10:28.510322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.511997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.608337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58832) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:28.684244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.707469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.715045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.739946 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=ccfbaa0d-a530-44e7-9dc8-6518b7c60224,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:28.755195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.756786 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-825739e1-d051-41b9-9748-6fe8ad778457 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 0.3917937 Nov 24 04:10:28.758082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-453b790f-0140-4f1e-97b3-0aef71641c51 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:28.761240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58840) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:28.766423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.772251 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0a8e9ad4-c677-4cf3-8355-9e56bf0078e1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ccfbaa0d-a530-44e7-9dc8-6518b7c60224 HTTP/1.1" status: 204 len: 168 time: 1.6592722 Nov 24 04:10:28.776920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58842) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:28.843220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:28.915848 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-acbcb9db-9fdf-42c4-9d7f-a694036788eb admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=ba0c2bd89365441e9aa39277bb74c7f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3037586 Nov 24 04:10:28.917617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58846) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:28.945666 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:28.991760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.075122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.077886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.124137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fc1c6627-1763-4fac-9aa9-cbf30dc2a545 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.148550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.148937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.149109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 06245579-1608-471b-9510-d2f5a6e502b1 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:29.155393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.156434 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9fe967a9-f633-4857-9a3d-6c732731ee05 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "DELETE /v2.0/routers/06245579-1608-471b-9510-d2f5a6e502b1 HTTP/1.1" status: 204 len: 168 time: 0.3938575 Nov 24 04:10:29.158594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fc1c6627-1763-4fac-9aa9-cbf30dc2a545 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.160229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58850) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:29.162227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.166522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Request body: {'router': {'name': 'tempest-router-628258877', 'distributed': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:29.221929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.223759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.268305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:29.289392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.294324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fc1c6627-1763-4fac-9aa9-cbf30dc2a545 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.298578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fc1c6627-1763-4fac-9aa9-cbf30dc2a545 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.300602 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fc1c6627-1763-4fac-9aa9-cbf30dc2a545 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/f1a44e7b-802f-4f89-b8d2-ab191f13eddb HTTP/1.1" status: 204 len: 168 time: 0.3783178 Nov 24 04:10:29.305700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:29.306737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.321476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc1c6627-1763-4fac-9aa9-cbf30dc2a545 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1a44e7b-802f-4f89-b8d2-ab191f13eddb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:29.334802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.336118 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c429ce9c-0650-4672-9209-ad3f2621a106 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.1749537 Nov 24 04:10:29.339191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58858) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:29.367306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:29.367923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1f2807a4-e5a8-4e4d-8aa6-15877cd0ec66 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:29.430468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:29.444418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.449158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.512992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.521156 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.674180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.677401 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.721801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event updated for resources: {'Subnet': ['ID=7cc50257-5728-4209-a33c-cc750f038f5e,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:29.745190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:29.750978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.751696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a834fbfe-c7fb-4d10-91d5-5da02214785d {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:29.758341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.759637 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-86f779b7-2a8a-4b85-923d-54bc580166a0 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "DELETE /v2.0/routers/a834fbfe-c7fb-4d10-91d5-5da02214785d HTTP/1.1" status: 204 len: 168 time: 0.4192662 Nov 24 04:10:29.763938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58874) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:29.776507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Request body: {'router': {'name': 'tempest-router-888106200', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': '5bd4ca8c8a5543368d6c09be39d2721c'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:29.783580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:29.795906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:29.802415 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a57db318-39c8-4bf5-93fc-77cfe22ac6ab None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:29.809653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Pushing event updated for resources: {'Port': ['ID=aa18c758-37a2-4bb0-bc11-c1a1df0ed57f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:29.838394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.841349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.854844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58876) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:29.881720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Checking segment: {'id': '0520e700-2316-494c-beaa-d360a144f708', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:29.886268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network hostable DHCP agents. Network: 1f0134be-da60-412e-9e00-5a7b46a9485f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:29.900285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.906894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c1375da4-bf2f-4b2e-b11e-6e8bc8eccc30 None None] Provisioning complete for port aa18c758-37a2-4bb0-bc11-c1a1df0ed57f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:29.907584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c1375da4-bf2f-4b2e-b11e-6e8bc8eccc30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.933446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.942441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.970159 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:29.974494 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3afaeb65-ead0-4cfb-a3a3-1a3b6b734ffc tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.2091146 Nov 24 04:10:29.974949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58882) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:29.979280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Request body: {'router': {'distributed': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:29.982717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:29.984189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c1375da4-bf2f-4b2e-b11e-6e8bc8eccc30 None None] Port aa18c758-37a2-4bb0-bc11-c1a1df0ed57f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:29.996664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:30.008112 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:30.013878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.024781 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:30.025631 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:30.035207 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.036949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8bf5c77-a030-4d7c-b64e-f876c1886f8d None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:30.038849 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a11dc4ce-d328-4a09-9b7d-134e9b156b0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c HTTP/1.1" status: 204 len: 168 time: 1.2538776 Nov 24 04:10:30.040426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:30.041110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.046527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58884) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:30.101429 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-abee8232-24bb-4537-a201-5fb3141feeef tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0536978 Nov 24 04:10:30.105169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Network 1f0134be-da60-412e-9e00-5a7b46a9485f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:30.107351 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58888) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:30.113478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:30.127327 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7c32eb6b-fa02-4f24-a425-3c69eb70add6 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/floatingips/4c166adf-64ad-4b1f-acc0-a6d718ed4163 HTTP/1.1" status: 200 len: 688 time: 2.4917996 Nov 24 04:10:30.141168 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:30.147169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58892) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:30.154459 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c09f57dd-6a18-4811-b6e8-14215f4b0fc8 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 3.3590934 Nov 24 04:10:30.163427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58894) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:30.165267 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:30.166768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 1f0134be-da60-412e-9e00-5a7b46a9485f) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:30.169794 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:30.187793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57717ce2-7f0f-4bea-9c68-c57847721a5c None None] Network 1f0134be-da60-412e-9e00-5a7b46a9485f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:30.208508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.101'}]}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:30.226824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:30.227634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.259131 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:30.260036 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07ea0ad4-ed2b-47a9-8971-357ede65a92c None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:30.269163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4d72de7-bde1-41ea-baf8-db57a94f8dc0 None None] Provisioning complete for port 01f5df4f-0724-4d40-904b-72624e51e972 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:30.269545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4d72de7-bde1-41ea-baf8-db57a94f8dc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.277404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.277960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.372167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:30.406361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.407654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.419495 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1d696c52-6ae5-42bb-b64c-f53cf8c034eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 2.8420246 Nov 24 04:10:30.424139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58900) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:30.435950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=103381) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Nov 24 04:10:30.436407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Router 2947b62e-9606-4c24-9965-6e831593dfc4 migrating from provider to provider. {{(pid=103381) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Nov 24 04:10:30.436809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.461827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.472396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.477789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58902) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:30.495892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.522370 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:30.563358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.591292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:30.595711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.598575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-1f0134be-da60-412e-9e00-5a7b46a9485f', 'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f', 'tenant_id': 'b122491e0fb34122afbcabe86bf340c9', 'fixed_ips': [{'subnet_id': '7cc50257-5728-4209-a33c-cc750f038f5e'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:30.600308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.693415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port bce2925c-f33a-4a62-97ff-f816806c74f3 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:30.693791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.724772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] Deleting port 01f5df4f-0724-4d40-904b-72624e51e972 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:30.725113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.832116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] For port 01f5df4f-0724-4d40-904b-72624e51e972, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=01f5df4f-0724-4d40-904b-72624e51e972,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:30.832969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.843347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Allocated IP 2001:db8::f816:3eff:fef6:b3e2 (1f0134be-da60-412e-9e00-5a7b46a9485f/7cc50257-5728-4209-a33c-cc750f038f5e/358310bc-8f75-41cc-ba10-aa19cbe30670) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:30.844202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-327220829'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:30.853460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] Calling delete_port for 01f5df4f-0724-4d40-904b-72624e51e972 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:30.873455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.881210 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.scheduler.l3_agent_scheduler [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] No L3 agents can host the router 2947b62e-9606-4c24-9965-6e831593dfc4 Nov 24 04:10:30.893016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.927285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:30.930941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.938165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.938694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.947096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:30.983176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for bce2925c-f33a-4a62-97ff-f816806c74f3 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:31.059879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.078659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.089555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.092627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.098480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] Pushing event deleted for resources: {'Port': ['ID=01f5df4f-0724-4d40-904b-72624e51e972,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.104840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Hosts for router 2947b62e-9606-4c24-9965-6e831593dfc4: [] {{(pid=103381) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Nov 24 04:10:31.105694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e10dc9c-ca53-4c59-8efb-2282ccfc26e0 None None] No DVR routers for this DVR port 01f5df4f-0724-4d40-904b-72624e51e972 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:31.123754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.170915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Hosts for other DVR routers connected to router 2947b62e-9606-4c24-9965-6e831593dfc4: set() {{(pid=103381) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Nov 24 04:10:31.173628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Network 1f0134be-da60-412e-9e00-5a7b46a9485f is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:31.173807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.175075 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0d1796fc-99a0-48f7-abcf-0ff4ddd11f02 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "PUT /v2.0/routers/2947b62e-9606-4c24-9965-6e831593dfc4 HTTP/1.1" status: 200 len: 716 time: 1.1991811 Nov 24 04:10:31.178519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:31.180145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Pushing event updated for resources: {'Port': ['ID=358310bc-8f75-41cc-ba10-aa19cbe30670,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.183443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:31.183622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58906) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:31.258344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Attempting to bind port 358310bc-8f75-41cc-ba10-aa19cbe30670 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:31.258873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Attempting to bind port 358310bc-8f75-41cc-ba10-aa19cbe30670 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '0520e700-2316-494c-beaa-d360a144f708', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:31.259344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Attempting to bind port 358310bc-8f75-41cc-ba10-aa19cbe30670 on network 1f0134be-da60-412e-9e00-5a7b46a9485f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:31.266842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:31.267398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Checking segment: {'id': '0520e700-2316-494c-beaa-d360a144f708', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:31.268059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.268816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Bound using segment: {'id': '0520e700-2316-494c-beaa-d360a144f708', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:31.269430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Bound port: 358310bc-8f75-41cc-ba10-aa19cbe30670, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0520e700-2316-494c-beaa-d360a144f708', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '1f0134be-da60-412e-9e00-5a7b46a9485f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:31.269924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.319790 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-18e6c47f-7041-4afb-8a0a-f1024ea5a791 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "GET /v2.0/routers/2947b62e-9606-4c24-9965-6e831593dfc4 HTTP/1.1" status: 200 len: 716 time: 0.1355507 Nov 24 04:10:31.328527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58908) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:31.365324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.376395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Allocated IP 172.26.5.53 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/6b9a35b3-3efe-4b5b-b831-575209b85d34) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:31.379035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.409602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 180, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:31.446825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.447173 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 5e8be725-013e-4c27-a049-fca6589e6a5e of type vlan for network da5b46da-0cce-4707-ae4e-c2246ebc0995 Nov 24 04:10:31.464213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'SecurityGroup': ['ID=50a6cafd-d71d-4a82-8689-3af92613ee6e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.496548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:31.523898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 01f5df4f-0724-4d40-904b-72624e51e972 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:31.524594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 01f5df4f-0724-4d40-904b-72624e51e972 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:31.592076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] For port 358310bc-8f75-41cc-ba10-aa19cbe30670, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:31.595980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] For port 358310bc-8f75-41cc-ba10-aa19cbe30670, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=358310bc-8f75-41cc-ba10-aa19cbe30670,segment=NetworkSegment(0520e700-2316-494c-beaa-d360a144f708),segment_id=0520e700-2316-494c-beaa-d360a144f708)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:31.600082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.602795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.605128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.628536 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-31784277-6f66-4f64-b336-ef51bb461ef2 tempest-RoutersTestDVR-166806201 tempest-RoutersTestDVR-166806201-project] 10.222.0.48 "GET /v2.0/routers/2947b62e-9606-4c24-9965-6e831593dfc4 HTTP/1.1" status: 200 len: 682 time: 0.2988698 Nov 24 04:10:31.633349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58912) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:31.640399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.661959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:31.665784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa99f77-3410-4e67-a058-b178ed049430 None None] Pushing event updated for resources: {'Port': ['ID=358310bc-8f75-41cc-ba10-aa19cbe30670,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.673977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:31.677507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:31.678321 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.690052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58a8d18d-cb22-4548-92c0-374ff0e45768 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:31.722685 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=50c2f613-f46e-4578-ba41-577ee0fbb7c0,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.748691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.752582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.758280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:31.759092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.777499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.787561 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ae8ee1eb-6664-41fc-8d2b-d4e4c514479e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6789539 Nov 24 04:10:31.791308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58914) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:31.800389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:31.808420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Subnet': ['ID=7cc50257-5728-4209-a33c-cc750f038f5e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.861357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.868525 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.3893528 Nov 24 04:10:31.879260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58916) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:31.890243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-1539032348'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:31.912883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '50c2f613-f46e-4578-ba41-577ee0fbb7c0'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:31.914141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:31.950118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77731172-bb7f-4f17-a737-cf985036cf70 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=da5b46da-0cce-4707-ae4e-c2246ebc0995,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:31.967734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:31.985947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.047956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1f0134be-da60-412e-9e00-5a7b46a9485f']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:32.093410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.095735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.101370 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:32.106126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.119843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.127095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0520e700-2316-494c-beaa-d360a144f708') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:32.127393 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0520e700-2316-494c-beaa-d360a144f708') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:32.139933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=bce2925c-f33a-4a62-97ff-f816806c74f3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:32.168205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.200341 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Allocated IP 172.20.0.2 (a2b36c78-43a6-4954-8102-cb5638999bb1/50c2f613-f46e-4578-ba41-577ee0fbb7c0/181251df-85cb-461e-bd5d-85bf7bbc7572) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:32.205789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.210585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.211101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 2947b62e-9606-4c24-9965-6e831593dfc4 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:32.217866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.222830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.223877 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bebb5857-5d2a-4898-ba86-1d41368c47c6 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "DELETE /v2.0/routers/2947b62e-9606-4c24-9965-6e831593dfc4 HTTP/1.1" status: 204 len: 168 time: 0.5859549 Nov 24 04:10:32.227415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:32.228552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:32.232045 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 156 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:32.232668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.233211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58918) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.238062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:32.247020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Request body: {'router': {'name': 'tempest-router-2118522683', 'distributed': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:32.251869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:32.253765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Port': ['ID=6b9a35b3-3efe-4b5b-b831-575209b85d34,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:32.253950 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:32.268487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.286768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.287116 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 8d841b8d-0511-4bc6-a050-40a630a7a969 of type vlan for network f6a28ac9-8f2a-460e-8287-e5737a0a01fa Nov 24 04:10:32.337829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.340444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.341628 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7a1a4da6-c726-46f6-bef9-d5ae84773c99 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/floatingips/4c166adf-64ad-4b1f-acc0-a6d718ed4163 HTTP/1.1" status: 204 len: 168 time: 2.1910653 Nov 24 04:10:32.343412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.344451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.351308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58920) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.354127 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.391344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.400732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.422874 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.426216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.433186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:32.433996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.437814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:32.444081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:32.445344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.446683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:32.448832 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-3977cff7-8d70-40c8-81c8-8a94deba4147 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] delete failed (client error): The resource could not be found. Nov 24 04:10:32.450085 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3977cff7-8d70-40c8-81c8-8a94deba4147 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/floatingips/4c166adf-64ad-4b1f-acc0-a6d718ed4163 HTTP/1.1" status: 404 len: 345 time: 0.0975909 Nov 24 04:10:32.456857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:32.465900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.472205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58922) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.474598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:10:32.474598 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:10:32.474598 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'id': '1f0134be-da60-412e-9e00-5a7b46a9485f'}] Nov 24 04:10:32.474598 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:32.475333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:32.501451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Pushing event updated for resources: {'Port': ['ID=181251df-85cb-461e-bd5d-85bf7bbc7572,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:32.519225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Attempting to bind port 181251df-85cb-461e-bd5d-85bf7bbc7572 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:32.519601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Attempting to bind port 181251df-85cb-461e-bd5d-85bf7bbc7572 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:32.519970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Attempting to bind port 181251df-85cb-461e-bd5d-85bf7bbc7572 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:32.525368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:32.525972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:32.526234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.526570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:32.527035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Bound port: 181251df-85cb-461e-bd5d-85bf7bbc7572, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:32.527459 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.555635 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.6750171 Nov 24 04:10:32.561737 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58924) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.570824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:32.582222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.583939 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-117e576f-9502-4afe-8e0e-0837da1d38c8 tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.3466194 Nov 24 04:10:32.597433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58926) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.599771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] For port 181251df-85cb-461e-bd5d-85bf7bbc7572, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:32.603336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] For port 181251df-85cb-461e-bd5d-85bf7bbc7572, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=181251df-85cb-461e-bd5d-85bf7bbc7572,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:32.608063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.631082 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df558e3c-34ee-46ba-8ec4-0f072ab7b521 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=f6a28ac9-8f2a-460e-8287-e5737a0a01fa,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:32.640632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.662603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19f7cd7e-f43f-46ad-ad7a-bebc5ecc31ba tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:32.663922 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:32.669756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19f7cd7e-f43f-46ad-ad7a-bebc5ecc31ba tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:32.675961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19f7cd7e-f43f-46ad-ad7a-bebc5ecc31ba tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:32.677854 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-19f7cd7e-f43f-46ad-ad7a-bebc5ecc31ba tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/ports?network_id=a47a2785-1e21-4a90-b046-5bf9f26ab1aa HTTP/1.1" status: 200 len: 2358 time: 0.2046781 Nov 24 04:10:32.680570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58930) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.702186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340c6e7a-d7e5-4ef0-8ef9-e1a4f54256e6 None None] Pushing event updated for resources: {'Port': ['ID=181251df-85cb-461e-bd5d-85bf7bbc7572,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:32.751056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.761947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.766983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:32.805488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b34e1f5-253b-450f-95ec-9f32711b0398 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:32.806898 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8b34e1f5-253b-450f-95ec-9f32711b0398 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/subnets/2f7d8ed8-b820-4cb9-a339-78c29b4488cf HTTP/1.1" status: 200 len: 797 time: 0.1252298 Nov 24 04:10:32.812173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58932) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:32.816971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'port': {'network_id': 'a47a2785-1e21-4a90-b046-5bf9f26ab1aa', 'name': 'tempest-FloatingIPTestJSON-2127466348', 'fixed_ips': [{'ip_address': '172.20.0.13'}, {'ip_address': '172.20.0.12'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:32.983027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.145502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.148863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.207955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:33.211473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.216415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.236386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.237167 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a1303364-cd4c-4714-b4f2-8acd4db07f7d {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:33.244114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.267250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6bd79aa-cf4c-435f-8223-c4c95f3b25de None None] Network 1f0134be-da60-412e-9e00-5a7b46a9485f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:33.369578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.378232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.382903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:33.392438 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 24 04:10:33.393517 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8490aa98-3b06-4076-bf80-6c90898a4a73 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 3.2288203 Nov 24 04:10:33.399900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58934) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:33.412069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 358310bc-8f75-41cc-ba10-aa19cbe30670 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:33.450910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.451631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router e40058d0-7e2e-4ce7-838c-3a79abef9267 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:10:33.455867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d7b3efe0-2c8c-46dd-a394-b984cf23aa5c None None] Provisioning complete for port 358310bc-8f75-41cc-ba10-aa19cbe30670 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:33.456248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7b3efe0-2c8c-46dd-a394-b984cf23aa5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.479513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.482233 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-afeb0093-8882-4785-8b7f-fe41981cbfbd tempest-RoutersTestDVR-1566278618 tempest-RoutersTestDVR-1566278618-project-admin] 10.222.0.48 "DELETE /v2.0/routers/e40058d0-7e2e-4ce7-838c-3a79abef9267 HTTP/1.1" status: 204 len: 168 time: 0.8801513 Nov 24 04:10:33.534565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Port': ['ID=6b9a35b3-3efe-4b5b-b831-575209b85d34,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:33.544597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.576518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.583009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.587633 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-96898fdd-4151-4d98-9749-1a853248f839 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.7316020 Nov 24 04:10:33.589108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58938) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:33.592942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 358310bc-8f75-41cc-ba10-aa19cbe30670 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:33.593475 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.605235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-1694091221'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:33.615619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting port 358310bc-8f75-41cc-ba10-aa19cbe30670 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:33.615874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.622844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] device_id is not set on port 88da4fbf-809e-4c85-ad65-edf54d74f3ff yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:33.707130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Made reservation on behalf of 1610a0f31b814395a8b827274e159eaf for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:33.711024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.720799 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] DHCP port deletion for 1f0134be-da60-412e-9e00-5a7b46a9485f request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:33.760591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.776766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7b3efe0-2c8c-46dd-a394-b984cf23aa5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.820914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] For port 358310bc-8f75-41cc-ba10-aa19cbe30670, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=358310bc-8f75-41cc-ba10-aa19cbe30670,segment=NetworkSegment(0520e700-2316-494c-beaa-d360a144f708),segment_id=0520e700-2316-494c-beaa-d360a144f708)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:33.821285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.854630 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Deleting port aa18c758-37a2-4bb0-bc11-c1a1df0ed57f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:33.855224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.878016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d7b3efe0-2c8c-46dd-a394-b984cf23aa5c None None] For port 358310bc-8f75-41cc-ba10-aa19cbe30670, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=358310bc-8f75-41cc-ba10-aa19cbe30670,segment=NetworkSegment(0520e700-2316-494c-beaa-d360a144f708),segment_id=0520e700-2316-494c-beaa-d360a144f708)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:33.897697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7b3efe0-2c8c-46dd-a394-b984cf23aa5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.913780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.945938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.958491 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] Deleting port 358310bc-8f75-41cc-ba10-aa19cbe30670 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:33.958848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:33.995588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Calling delete_port for 358310bc-8f75-41cc-ba10-aa19cbe30670 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:34.010466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Calling delete_port for aa18c758-37a2-4bb0-bc11-c1a1df0ed57f owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:34.091474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b3efe0-2c8c-46dd-a394-b984cf23aa5c None None] Pushing event updated for resources: {'Port': ['ID=358310bc-8f75-41cc-ba10-aa19cbe30670,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.102425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] For port 358310bc-8f75-41cc-ba10-aa19cbe30670, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=358310bc-8f75-41cc-ba10-aa19cbe30670,segment=NetworkSegment(0520e700-2316-494c-beaa-d360a144f708),segment_id=0520e700-2316-494c-beaa-d360a144f708)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:34.102839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.125065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58942) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:34.129892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:34.130290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:34.132449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.133079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] Calling delete_port for 358310bc-8f75-41cc-ba10-aa19cbe30670 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:34.143368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.147058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.13 (a47a2785-1e21-4a90-b046-5bf9f26ab1aa/2f7d8ed8-b820-4cb9-a339-78c29b4488cf/88da4fbf-809e-4c85-ad65-edf54d74f3ff) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:34.166135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.12 (a47a2785-1e21-4a90-b046-5bf9f26ab1aa/2f7d8ed8-b820-4cb9-a339-78c29b4488cf/88da4fbf-809e-4c85-ad65-edf54d74f3ff) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:34.188621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] vlan segment allocate from pool success with {'vlan_id': 159, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:34.192542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'SecurityGroup': ['ID=89a09ced-f235-4be1-9f85-a54d837d81a1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.217785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.218103 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Added segment bb2286bf-7127-4b8f-ac65-aa5b73d7d00c of type vlan for network 12205fb4-dac3-4af0-b4b6-24882f86dd40 Nov 24 04:10:34.255001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.277325 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-12d24513-18d4-41f7-9e23-9bf754d9dda5 None None] Provisioning complete for port 181251df-85cb-461e-bd5d-85bf7bbc7572 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:34.277694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12d24513-18d4-41f7-9e23-9bf754d9dda5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.289394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.372060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.378738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:34.379555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.386817 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.426710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.429177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] Pushing event deleted for resources: {'Port': ['ID=358310bc-8f75-41cc-ba10-aa19cbe30670,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.434239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a736e860-10ea-41ef-9032-4889a6befbcc None None] No DVR routers for this DVR port 358310bc-8f75-41cc-ba10-aa19cbe30670 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:34.469562 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.8725972 Nov 24 04:10:34.470527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58946) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:34.479381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Request body: {'subnet': {'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:34.497136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12d24513-18d4-41f7-9e23-9bf754d9dda5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.514774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.548686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12d24513-18d4-41f7-9e23-9bf754d9dda5 None None] For port 181251df-85cb-461e-bd5d-85bf7bbc7572, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=181251df-85cb-461e-bd5d-85bf7bbc7572,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:34.554540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12d24513-18d4-41f7-9e23-9bf754d9dda5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.613205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3658eb7-1cb7-42d4-ac99-215cacd596d1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Network': ['ID=12205fb4-dac3-4af0-b4b6-24882f86dd40,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.654922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:34.664937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:34.666877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=88da4fbf-809e-4c85-ad65-edf54d74f3ff,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.671161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:34.671869 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port 358310bc-8f75-41cc-ba10-aa19cbe30670 update to ACTIVE by agent not found {{(pid=103382) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 24 04:10:34.673929 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 181251df-85cb-461e-bd5d-85bf7bbc7572 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:34.678595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:34.687987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7719453e-afd8-4892-b43a-4b1d3cfa157d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.717125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:34.722336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Made reservation on behalf of 1610a0f31b814395a8b827274e159eaf for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:34.725300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.735481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02ab31ce-545f-4216-a264-8bbc3b08429e None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:34.742409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d24513-18d4-41f7-9e23-9bf754d9dda5 None None] Pushing event updated for resources: {'Port': ['ID=181251df-85cb-461e-bd5d-85bf7bbc7572,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.749472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:34.750107 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.773974 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a4510033-86d8-42e3-95da-1c88bdc06729 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1010 time: 1.9603522 Nov 24 04:10:34.780272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58948) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:34.782342 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '88da4fbf-809e-4c85-ad65-edf54d74f3ff', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:34.801041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=dfcb001c-d1d5-4a10-90d3-89338c1ce680,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.810711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.818674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 181251df-85cb-461e-bd5d-85bf7bbc7572 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:34.819054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.851760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.890623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Port': ['ID=358310bc-8f75-41cc-ba10-aa19cbe30670,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:34.892692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '5e8be725-013e-4c27-a049-fca6589e6a5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:34.893271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: da5b46da-0cce-4707-ae4e-c2246ebc0995, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:34.898402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No DVR routers for this DVR port 358310bc-8f75-41cc-ba10-aa19cbe30670 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:34.931834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2d165a1d-1231-469c-94ca-c0c0f3083900 None None] Provisioning complete for port 88da4fbf-809e-4c85-ad65-edf54d74f3ff triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:34.932376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d165a1d-1231-469c-94ca-c0c0f3083900 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.992090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f408f1ac-1415-43f2-abb3-7e0a31e7ef03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:34.996189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2d165a1d-1231-469c-94ca-c0c0f3083900 None None] Port 88da4fbf-809e-4c85-ad65-edf54d74f3ff cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:35.031477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.038966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.053519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:35.091602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.110194 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.118387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Pushing event deleted for resources: {'Port': ['ID=aa18c758-37a2-4bb0-bc11-c1a1df0ed57f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:35.119392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Subnet': ['ID=7b52fb93-a07a-4b5c-a3a4-11308879ff75,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:35.143596 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1fe2cc9-4538-4d95-88d6-4681be352662 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:35.166595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Checking segment: {'id': 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:35.166798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, da5b46da-0cce-4707-ae4e-c2246ebc0995) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:35.166957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network hostable DHCP agents. Network: 12205fb4-dac3-4af0-b4b6-24882f86dd40, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:35.175263 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb3c1c11-eec4-4b9a-9715-649e9c6bef2c None None] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:35.204307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:35.204891 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.208793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1f0134be-da60-412e-9e00-5a7b46a9485f']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:35.212340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7719453e-afd8-4892-b43a-4b1d3cfa157d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.216584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.222124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:35.240339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.83 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/d16567e9-41ac-43ab-8236-074b4d22ca76) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:35.242850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 12205fb4-dac3-4af0-b4b6-24882f86dd40) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:35.249667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:35.250351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.273116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0520e700-2316-494c-beaa-d360a144f708') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:35.274688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0520e700-2316-494c-beaa-d360a144f708') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:35.278714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7719453e-afd8-4892-b43a-4b1d3cfa157d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.289313 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6b5a8c6a-8eec-4d64-be5a-8298cc18d0c1 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8138046 Nov 24 04:10:35.292534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58950) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.297142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-358368921', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:35.309483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.341052 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e4eb877f-6bab-4d91-a47d-280f77c9702f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.7741313 Nov 24 04:10:35.355580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58952) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.362324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:35.388760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.392950 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7719453e-afd8-4892-b43a-4b1d3cfa157d admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=5bd4ca8c8a5543368d6c09be39d2721c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2665312 Nov 24 04:10:35.397301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58954) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.399512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.400708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.408128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 156 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:35.408566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:35.411956 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:35.414311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7719453e-afd8-4892-b43a-4b1d3cfa157d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f8ed1df-2ffc-45a5-94c0-29e8465045ff,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:35.415497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.422336 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-edca051f-21e6-456a-a9bf-0425902c2818 tempest-RoutersAdminNegativeTest-2103394138 tempest-RoutersAdminNegativeTest-2103394138-project-admin] 10.222.0.48 "DELETE /v2.0/ports/aa18c758-37a2-4bb0-bc11-c1a1df0ed57f HTTP/1.1" status: 204 len: 168 time: 2.0139382 Nov 24 04:10:35.519438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3910820-4010-4f88-b2a2-aa3aa82622ce None None] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:35.522077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 181251df-85cb-461e-bd5d-85bf7bbc7572 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:35.535279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.578781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85e55907-c6d0-41d7-a366-1d67c16c8e76 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.603095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85e55907-c6d0-41d7-a366-1d67c16c8e76 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.606809 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.625135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-da5b46da-0cce-4707-ae4e-c2246ebc0995', 'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': 'dfcb001c-d1d5-4a10-90d3-89338c1ce680'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:35.626034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.626676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.633497 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/1f0134be-da60-412e-9e00-5a7b46a9485f HTTP/1.1" status: 204 len: 168 time: 5.2037082 Nov 24 04:10:35.635696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] For port 181251df-85cb-461e-bd5d-85bf7bbc7572, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=181251df-85cb-461e-bd5d-85bf7bbc7572,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:35.637459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58960) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.640577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:35.644197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.669379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae65694-1588-4961-af97-44ad0116d2eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Network': ['ID=1f0134be-da60-412e-9e00-5a7b46a9485f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:35.697867 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-3e4b0232-3139-482f-92e8-bbccbe2ef7c3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:35.698360 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3e4b0232-3139-482f-92e8-bbccbe2ef7c3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:35.703720 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3e4b0232-3139-482f-92e8-bbccbe2ef7c3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/7cc50257-5728-4209-a33c-cc750f038f5e HTTP/1.1" status: 404 len: 337 time: 0.0554943 Nov 24 04:10:35.704328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58962) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.724678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.738587 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-967a5e5a-60cf-4fcd-a415-e559b0bd1bd3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:35.739129 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-967a5e5a-60cf-4fcd-a415-e559b0bd1bd3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:35.743078 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-967a5e5a-60cf-4fcd-a415-e559b0bd1bd3 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/1f0134be-da60-412e-9e00-5a7b46a9485f HTTP/1.1" status: 404 len: 339 time: 0.0381985 Nov 24 04:10:35.743674 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58964) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.746830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.749626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58966) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.770373 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.789962 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae3ef85f-f54c-489d-9b35-97b9d4ee7f1c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:35.790606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ae3ef85f-f54c-489d-9b35-97b9d4ee7f1c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:35.797802 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ae3ef85f-f54c-489d-9b35-97b9d4ee7f1c tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/a05a4ddb-356e-4f54-8bc4-dd221548a44c HTTP/1.1" status: 404 len: 337 time: 0.0435016 Nov 24 04:10:35.798928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.799439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.810967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58970) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.877030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85e55907-c6d0-41d7-a366-1d67c16c8e76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.879894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85e55907-c6d0-41d7-a366-1d67c16c8e76 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.883379 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-85e55907-c6d0-41d7-a366-1d67c16c8e76 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/2f8ed1df-2ffc-45a5-94c0-29e8465045ff HTTP/1.1" status: 204 len: 168 time: 0.4770663 Nov 24 04:10:35.903168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Allocated IP 172.20.0.2 (da5b46da-0cce-4707-ae4e-c2246ebc0995/dfcb001c-d1d5-4a10-90d3-89338c1ce680/a7d39ba0-651c-4385-836c-7e01c2f3724c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:35.925502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:35.928503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:35.928844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 181251df-85cb-461e-bd5d-85bf7bbc7572 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:35.929286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.930624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9163349b-3921-4ec1-afd8-51bfc902d001 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:35.959499 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7446a2a-fbf3-4274-b5d9-f81d7fc2fd27 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:35.960250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a7446a2a-fbf3-4274-b5d9-f81d7fc2fd27 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:35.963650 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a7446a2a-fbf3-4274-b5d9-f81d7fc2fd27 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/2c32a762-8159-46fe-a2e9-eae7358623f8 HTTP/1.1" status: 404 len: 339 time: 0.1446059 Nov 24 04:10:35.973406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:35.982216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58974) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:35.987153 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:35.987808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.007392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efba7cd3-26c8-4b06-b86d-87725eb0fb30 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:36.023177 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-a5766194-5df0-4e8c-905f-0da5ee6a8d4d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:36.023895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a5766194-5df0-4e8c-905f-0da5ee6a8d4d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:36.028124 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a5766194-5df0-4e8c-905f-0da5ee6a8d4d tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/5c373f7e-fd4c-4fd4-91d9-17f526cab719 HTTP/1.1" status: 404 len: 337 time: 0.0448806 Nov 24 04:10:36.028667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.035916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e55907-c6d0-41d7-a366-1d67c16c8e76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f8ed1df-2ffc-45a5-94c0-29e8465045ff,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.038555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:36.039271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58976) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:36.049202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:36.066545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-12205fb4-dac3-4af0-b4b6-24882f86dd40', 'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40', 'tenant_id': '1610a0f31b814395a8b827274e159eaf', 'fixed_ips': [{'subnet_id': '7b52fb93-a07a-4b5c-a3a4-11308879ff75'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:36.068593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.086618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=d16567e9-41ac-43ab-8236-074b4d22ca76,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.089370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=bd40dcd2-bd79-4919-806d-c505504e9783,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.095008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=181251df-85cb-461e-bd5d-85bf7bbc7572,revision_number=5']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.101705 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-551f8c1e-ccee-498a-b5a3-80b2ba873a8b tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:36.102348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-551f8c1e-ccee-498a-b5a3-80b2ba873a8b tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:36.106395 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-551f8c1e-ccee-498a-b5a3-80b2ba873a8b tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/13504368-6cfa-468c-b387-3c5a27add0ff HTTP/1.1" status: 404 len: 339 time: 0.0555613 Nov 24 04:10:36.108941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58980) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:36.127944 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-16a46f2c-2993-4116-94b1-ceef7d93c827 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 4.3313856 Nov 24 04:10:36.130871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58982) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:36.161550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:27:a9:bd', 'name': 'tempest-NetworksTestDHCPv6-2111014584'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:36.308677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58984) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:36.363721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:36.377657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64eb110f-c9e8-4049-9323-19517a15642e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.384267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.417650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9163349b-3921-4ec1-afd8-51bfc902d001 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.435089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9163349b-3921-4ec1-afd8-51bfc902d001 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.450398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.470856 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9163349b-3921-4ec1-afd8-51bfc902d001 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=3256b0feaa6e44ecbb73d6655f787d41&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7218268 Nov 24 04:10:36.473604 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.503300 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58986) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:36.542585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Allocated IP 172.20.0.2 (12205fb4-dac3-4af0-b4b6-24882f86dd40/7b52fb93-a07a-4b5c-a3a4-11308879ff75/4402b7af-2a15-48cb-bda5-b588d82f61ab) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:36.572080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:36.589057 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:36.593012 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:36.596341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9163349b-3921-4ec1-afd8-51bfc902d001 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c26c64c-76d0-4456-aee2-9dee13e949ee,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.597450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Pushing event updated for resources: {'Port': ['ID=a7d39ba0-651c-4385-836c-7e01c2f3724c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.665661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 358310bc-8f75-41cc-ba10-aa19cbe30670 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:36.701559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting port 89d611a7-346e-4d15-b118-f122ebf39cf1 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:36.702065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.707301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64eb110f-c9e8-4049-9323-19517a15642e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.726310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64eb110f-c9e8-4049-9323-19517a15642e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.740649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.742585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 358310bc-8f75-41cc-ba10-aa19cbe30670 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:36.742940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 358310bc-8f75-41cc-ba10-aa19cbe30670 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:36.756873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Attempting to bind port a7d39ba0-651c-4385-836c-7e01c2f3724c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:36.757183 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Attempting to bind port a7d39ba0-651c-4385-836c-7e01c2f3724c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '5e8be725-013e-4c27-a049-fca6589e6a5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:36.757552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Attempting to bind port a7d39ba0-651c-4385-836c-7e01c2f3724c on network da5b46da-0cce-4707-ae4e-c2246ebc0995 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:36.773312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:36.774191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Checking segment: {'id': '5e8be725-013e-4c27-a049-fca6589e6a5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:36.774191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.774510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Bound using segment: {'id': '5e8be725-013e-4c27-a049-fca6589e6a5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:36.774992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Bound port: a7d39ba0-651c-4385-836c-7e01c2f3724c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e8be725-013e-4c27-a049-fca6589e6a5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'da5b46da-0cce-4707-ae4e-c2246ebc0995'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:36.775394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.790989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=79a08516-6cbb-4969-91b9-a4463e92bf0a,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.827741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-180deb57-3271-4791-83b1-42fe83369b4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.870919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 9c6e6da7-1d8c-4195-b3fe-83568a4e170f yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:36.882718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.885278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64eb110f-c9e8-4049-9323-19517a15642e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=127c64a6-e787-4269-be53-9f4636ef2c53,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.890579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.895976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] For port a7d39ba0-651c-4385-836c-7e01c2f3724c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:36.901961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] For port a7d39ba0-651c-4385-836c-7e01c2f3724c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a7d39ba0-651c-4385-836c-7e01c2f3724c,segment=NetworkSegment(5e8be725-013e-4c27-a049-fca6589e6a5e),segment_id=5e8be725-013e-4c27-a049-fca6589e6a5e)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:36.902660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.907550 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-64eb110f-c9e8-4049-9323-19517a15642e admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=8caadbda24e04894a6bbf020a5d8fc35&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5979304 Nov 24 04:10:36.928517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58988) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:36.935693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.941315 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '8d841b8d-0511-4bc6-a050-40a630a7a969', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:36.941929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: f6a28ac9-8f2a-460e-8287-e5737a0a01fa, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:36.958304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:36.967978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:36.972990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Pushing event updated for resources: {'Port': ['ID=4402b7af-2a15-48cb-bda5-b588d82f61ab,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:36.975363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:36.980499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-180deb57-3271-4791-83b1-42fe83369b4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:36.986638 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Calling delete_port for 89d611a7-346e-4d15-b118-f122ebf39cf1 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:37.033235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.073557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.087698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:37.144629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Attempting to bind port 4402b7af-2a15-48cb-bda5-b588d82f61ab on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:37.145461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Attempting to bind port 4402b7af-2a15-48cb-bda5-b588d82f61ab by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:37.145461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Attempting to bind port 4402b7af-2a15-48cb-bda5-b588d82f61ab on network 12205fb4-dac3-4af0-b4b6-24882f86dd40 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:37.152984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:37.153467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Checking segment: {'id': 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:37.154049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.154600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Bound using segment: {'id': 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:37.155200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Bound port: 4402b7af-2a15-48cb-bda5-b588d82f61ab, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:37.155707 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.165219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b20f27-6768-4980-948b-0db0498668ae None None] Pushing event updated for resources: {'Port': ['ID=a7d39ba0-651c-4385-836c-7e01c2f3724c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:37.193047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, f6a28ac9-8f2a-460e-8287-e5737a0a01fa) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:37.198585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:37.199178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.222599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cce3e0d8-2e44-4f0f-bd8e-3bc3f45d7d99 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.261176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] For port 4402b7af-2a15-48cb-bda5-b588d82f61ab, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:37.264967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] For port 4402b7af-2a15-48cb-bda5-b588d82f61ab, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4402b7af-2a15-48cb-bda5-b588d82f61ab,segment=NetworkSegment(bb2286bf-7127-4b8f-ac65-aa5b73d7d00c),segment_id=bb2286bf-7127-4b8f-ac65-aa5b73d7d00c)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:37.269215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5f3f68b-12ee-4cf2-95d0-be7f3262ee29 None None] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:37.277316 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2bab3591-b475-4a10-91e9-4e872f013afc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9195063 Nov 24 04:10:37.289096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 58990) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:37.302360 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1363528163', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:37.310008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cce3e0d8-2e44-4f0f-bd8e-3bc3f45d7d99 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.413241 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-180deb57-3271-4791-83b1-42fe83369b4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.416903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-180deb57-3271-4791-83b1-42fe83369b4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.418272 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-180deb57-3271-4791-83b1-42fe83369b4e admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/0c26c64c-76d0-4456-aee2-9dee13e949ee HTTP/1.1" status: 204 len: 168 time: 0.8996687 Nov 24 04:10:37.420175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 172.20.0.9 (a2b36c78-43a6-4954-8102-cb5638999bb1/50c2f613-f46e-4578-ba41-577ee0fbb7c0/9c6e6da7-1d8c-4195-b3fe-83568a4e170f) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:37.428594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.441002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fe27:a9bd (a2b36c78-43a6-4954-8102-cb5638999bb1/bd40dcd2-bd79-4919-806d-c505504e9783/9c6e6da7-1d8c-4195-b3fe-83568a4e170f) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:37.442692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Allocated IP 172.26.5.208 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/2244a5e7-ebab-4a50-8813-dd14b70f9510) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:37.443488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180deb57-3271-4791-83b1-42fe83369b4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c26c64c-76d0-4456-aee2-9dee13e949ee,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:37.451184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.453479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.455453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.532037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 181251df-85cb-461e-bd5d-85bf7bbc7572 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:37.534583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.539799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Port': ['ID=89d611a7-346e-4d15-b118-f122ebf39cf1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:37.545440 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cce3e0d8-2e44-4f0f-bd8e-3bc3f45d7d99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.549787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cce3e0d8-2e44-4f0f-bd8e-3bc3f45d7d99 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.551242 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cce3e0d8-2e44-4f0f-bd8e-3bc3f45d7d99 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/127c64a6-e787-4269-be53-9f4636ef2c53 HTTP/1.1" status: 204 len: 168 time: 0.6215022 Nov 24 04:10:37.585265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.608379 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9098eb19-089c-47c2-9c70-c7cb20c4391e tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/ports/89d611a7-346e-4d15-b118-f122ebf39cf1 HTTP/1.1" status: 204 len: 168 time: 1.4963920 Nov 24 04:10:37.612902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58996) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:37.667152 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d49748b-eb88-433c-afb1-d8ee292e4576 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:37.667868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4d49748b-eb88-433c-afb1-d8ee292e4576 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:37.671934 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4d49748b-eb88-433c-afb1-d8ee292e4576 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/874da414-186a-474a-94ec-a512ad74a10b HTTP/1.1" status: 404 len: 337 time: 0.0580339 Nov 24 04:10:37.676542 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 58998) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:37.719473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce3e0d8-2e44-4f0f-bd8e-3bc3f45d7d99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=127c64a6-e787-4269-be53-9f4636ef2c53,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:37.767693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.775361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.842090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-f6a28ac9-8f2a-460e-8287-e5737a0a01fa', 'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': '79a08516-6cbb-4969-91b9-a4463e92bf0a'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:37.844581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.848893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.972145 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.975961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:37.980602 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9d36c246-134c-47c2-96e5-0ff81b6470ca tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.6852136 Nov 24 04:10:37.983438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59004) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:38.000845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.197626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.237309 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.283006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44cf9db0-a0df-4e93-af99-a019ca88e544 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.294310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['78c0685f-61f4-48a9-87dd-048ba3c3b855']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:38.296908 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea4f2df-5f0f-4518-a067-e217c421f417 None None] Pushing event updated for resources: {'Port': ['ID=4402b7af-2a15-48cb-bda5-b588d82f61ab,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:38.309513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd833e0c0-1270-44b9-8027-09ae0e7f8cae') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:38.309784 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd833e0c0-1270-44b9-8027-09ae0e7f8cae') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:38.322228 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.343231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-627675ff-3003-4cee-93dd-28e9931239bc None None] Provisioning complete for port 181251df-85cb-461e-bd5d-85bf7bbc7572 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:38.343721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-627675ff-3003-4cee-93dd-28e9931239bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.359035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.374060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.388749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 150 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:38.390029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:38.395896 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:38.454463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:38.465529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.468434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:38.484796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:38.489344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59014) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:38.494001 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 181251df-85cb-461e-bd5d-85bf7bbc7572 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:38.494442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.532429 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.549718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.636957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=9c6e6da7-1d8c-4195-b3fe-83568a4e170f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:38.648365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.655902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.666035 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/78c0685f-61f4-48a9-87dd-048ba3c3b855 HTTP/1.1" status: 204 len: 168 time: 0.9880562 Nov 24 04:10:38.669230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59016) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:38.727332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:38.728021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.757266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:38.758690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Allocated IP 172.21.0.2 (f6a28ac9-8f2a-460e-8287-e5737a0a01fa/79a08516-6cbb-4969-91b9-a4463e92bf0a/f849363c-9a70-47bf-9452-acdb0dd2e4fa) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:38.828746 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-be76fc3c-7c77-4609-a8f2-e9623b950e57 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.6968198 Nov 24 04:10:38.848981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59022) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:38.876034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e41a46bb-a9ff-4405-b908-44f0e8849d99 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Network': ['ID=78c0685f-61f4-48a9-87dd-048ba3c3b855,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:38.894255 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-87498f35-3894-4ee4-8b19-31b588364091 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=53e7c8dd3d44486cbaf260355228ad3b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3944621 Nov 24 04:10:38.907798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:38.908677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59026) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:38.946853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:38.950411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:38.956121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=d16567e9-41ac-43ab-8236-074b4d22ca76,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:39.044564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93b5350e-e3e7-414c-bef8-fc4d1cbe6f61 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:39.046551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ee613d8-ec6d-4626-998b-2430270e4463 None None] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:39.063739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2324cc5f-23a1-4a1a-8d80-88d10b015115 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.101400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2324cc5f-23a1-4a1a-8d80-88d10b015115 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.120528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Provisioning complete for port a7d39ba0-651c-4385-836c-7e01c2f3724c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:39.120912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.155658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.183237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2324cc5f-23a1-4a1a-8d80-88d10b015115 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.190117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2324cc5f-23a1-4a1a-8d80-88d10b015115 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.190117 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2324cc5f-23a1-4a1a-8d80-88d10b015115 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/fdc30da3-fdb7-4952-aef2-a8bc4ace6fd4 HTTP/1.1" status: 204 len: 168 time: 0.2749457 Nov 24 04:10:39.214075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting port 93336f5e-041b-4597-a7ad-bd0a641bb977 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:39.214297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.217115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2324cc5f-23a1-4a1a-8d80-88d10b015115 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdc30da3-fdb7-4952-aef2-a8bc4ace6fd4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:39.235836 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59034) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:39.372469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.390701 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 665928ba-5271-4128-95a1-b5b20f371337 associated. External IP: 172.26.5.83, port: 88da4fbf-809e-4c85-ad65-edf54d74f3ff. Nov 24 04:10:39.394113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.404389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Calling delete_port for 93336f5e-041b-4597-a7ad-bd0a641bb977 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:39.475761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] For port a7d39ba0-651c-4385-836c-7e01c2f3724c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a7d39ba0-651c-4385-836c-7e01c2f3724c,segment=NetworkSegment(5e8be725-013e-4c27-a049-fca6589e6a5e),segment_id=5e8be725-013e-4c27-a049-fca6589e6a5e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:39.478431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-1870423728'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:39.487529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.495553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.520691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:39.524627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.538379 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.547486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.554212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a7d39ba0-651c-4385-836c-7e01c2f3724c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:39.589581 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.642584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:39.643329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Port': ['ID=93336f5e-041b-4597-a7ad-bd0a641bb977,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:39.652011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.655804 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ea762b02-86dc-40c5-940e-a44301d0b632 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/ports/93336f5e-041b-4597-a7ad-bd0a641bb977 HTTP/1.1" status: 204 len: 168 time: 0.9703491 Nov 24 04:10:39.658465 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59040) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:39.667836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79ceb733-5b02-47a0-880d-d195e57ff5dd None None] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:39.683582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Port': ['ID=2244a5e7-ebab-4a50-8813-dd14b70f9510,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:39.703240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff909328-6d87-4583-a41a-d647ee3ee98a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:39.704120 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-32fcc74a-c965-41eb-91f5-cbbff0ad99eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] DELETE failed (client error): The resource could not be found. Nov 24 04:10:39.704579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-32fcc74a-c965-41eb-91f5-cbbff0ad99eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:39.706109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff909328-6d87-4583-a41a-d647ee3ee98a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:39.708000 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ff909328-6d87-4583-a41a-d647ee3ee98a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.8579724 Nov 24 04:10:39.713353 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-32fcc74a-c965-41eb-91f5-cbbff0ad99eb tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/c74b2104-0571-42e7-af22-d6bdcf0ac791 HTTP/1.1" status: 404 len: 337 time: 0.0514956 Nov 24 04:10:39.713353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59042) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:39.716682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59044) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:39.787497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Provisioning complete for port 9c6e6da7-1d8c-4195-b3fe-83568a4e170f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:39.787848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.790738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:39.836985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:39.864604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.880963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.894722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:39.907013 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.907245 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Added segment 3e2d0adb-4d09-4c22-ab0c-9c06ac580e68 of type vlan for network 3779787c-a1ad-4c57-b149-36324ecb887c Nov 24 04:10:39.909883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Pushing event updated for resources: {'Port': ['ID=a7d39ba0-651c-4385-836c-7e01c2f3724c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:39.968006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:39.997405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Attempting to bind port f849363c-9a70-47bf-9452-acdb0dd2e4fa on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:39.997827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Attempting to bind port f849363c-9a70-47bf-9452-acdb0dd2e4fa by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8d841b8d-0511-4bc6-a050-40a630a7a969', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:39.998278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Attempting to bind port f849363c-9a70-47bf-9452-acdb0dd2e4fa on network f6a28ac9-8f2a-460e-8287-e5737a0a01fa {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:40.012557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.018340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:40.018967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.032762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f3cc28cc-0c0e-4d40-bd4a-ea3eb9553aed None None] Port 9c6e6da7-1d8c-4195-b3fe-83568a4e170f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:40.058577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:40.059193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Checking segment: {'id': '8d841b8d-0511-4bc6-a050-40a630a7a969', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:40.059609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.060089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Bound using segment: {'id': '8d841b8d-0511-4bc6-a050-40a630a7a969', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:40.061283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Bound port: f849363c-9a70-47bf-9452-acdb0dd2e4fa, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8d841b8d-0511-4bc6-a050-40a630a7a969', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': 'f6a28ac9-8f2a-460e-8287-e5737a0a01fa'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:40.061283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.086521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.091289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a7d39ba0-651c-4385-836c-7e01c2f3724c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:40.091690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.093250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Pushing event updated for resources: {'Port': ['ID=f849363c-9a70-47bf-9452-acdb0dd2e4fa,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:40.163577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.177735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Network': ['ID=3779787c-a1ad-4c57-b149-36324ecb887c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:40.217443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 3779787c-a1ad-4c57-b149-36324ecb887c details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:40.223408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Provisioning complete for port 4402b7af-2a15-48cb-bda5-b588d82f61ab triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:40.223948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.227892 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 0.9912763 Nov 24 04:10:40.230320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0317e7c-1f52-473d-89f0-de995019e3a8 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'SecurityGroup': ['ID=43b9b4a5-2fd5-4ff7-946e-52606e2fe7ea,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:40.238833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59058) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:40.244556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] For port f849363c-9a70-47bf-9452-acdb0dd2e4fa, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:40.258673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'subnet': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:40.336101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] For port f849363c-9a70-47bf-9452-acdb0dd2e4fa, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f849363c-9a70-47bf-9452-acdb0dd2e4fa,segment=NetworkSegment(8d841b8d-0511-4bc6-a050-40a630a7a969),segment_id=8d841b8d-0511-4bc6-a050-40a630a7a969)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:40.360451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 9c6e6da7-1d8c-4195-b3fe-83568a4e170f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:40.360884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.423256 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.439957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.465844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:40.469713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.538997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4402b7af-2a15-48cb-bda5-b588d82f61ab up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:40.589198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.599162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0826cda3-f59c-4573-bdd6-ee384b8c13ce None None] Pushing event updated for resources: {'Port': ['ID=f849363c-9a70-47bf-9452-acdb0dd2e4fa,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:40.629973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 9c6e6da7-1d8c-4195-b3fe-83568a4e170f owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:40.644858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59064) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:40.672893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.700718 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 4402b7af-2a15-48cb-bda5-b588d82f61ab triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:40.701132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.735557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] For port 4402b7af-2a15-48cb-bda5-b588d82f61ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4402b7af-2a15-48cb-bda5-b588d82f61ab,segment=NetworkSegment(bb2286bf-7127-4b8f-ac65-aa5b73d7d00c),segment_id=bb2286bf-7127-4b8f-ac65-aa5b73d7d00c)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:40.747072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.818906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Provisioning complete for port 2244a5e7-ebab-4a50-8813-dd14b70f9510 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:40.819280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.893697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-1587826804'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:40.946217 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Made reservation on behalf of e898eec0924243e0bc8201e7ccaa12b8 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:40.949535 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.986674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:40.990678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:40.998267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.051682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.073937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Pushing event updated for resources: {'Port': ['ID=4402b7af-2a15-48cb-bda5-b588d82f61ab,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:41.097563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.116913 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['522fbdcd-5bc8-4bff-9c8f-bd9985273cca']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.126055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-27cd8729-5818-494b-a6f8-cc994157aa3b None None] Port 2244a5e7-ebab-4a50-8813-dd14b70f9510 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:41.131639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.145991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Subnet': ['ID=becde755-a9f2-4b15-8f7d-32a2169b347a,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:41.170428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.177164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Checking segment: {'id': '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:41.177433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network hostable DHCP agents. Network: 3779787c-a1ad-4c57-b149-36324ecb887c, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:41.203576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.204148 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a7963f32-3e70-4e4f-b118-8ef9c778d4b8') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.215125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=9c6e6da7-1d8c-4195-b3fe-83568a4e170f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:41.232897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.20.0.1 (da5b46da-0cce-4707-ae4e-c2246ebc0995/dfcb001c-d1d5-4a10-90d3-89338c1ce680/6299b5ec-3528-4135-bd7a-fec8d0b93cde) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:41.239289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.269391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:41.282512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-84bfe532-4d94-4267-8013-5ae402b880f0 None None] Provisioning complete for port 4402b7af-2a15-48cb-bda5-b588d82f61ab triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:41.282512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84bfe532-4d94-4267-8013-5ae402b880f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.316280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.346105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.350357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 3779787c-a1ad-4c57-b149-36324ecb887c) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:41.371997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.382681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:41.383524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.383671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74a0bb7c-cd2c-41a8-8101-f41eab2c1ac0 None None] Network 3779787c-a1ad-4c57-b149-36324ecb887c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:41.396426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 198 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:41.396860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:41.399954 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:41.429277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] vlan segment allocate from pool success with {'vlan_id': 184, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:41.464188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.471036 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b76c3afe-fd8a-46a8-b6f7-0983a2fdbddd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/9c6e6da7-1d8c-4195-b3fe-83568a4e170f HTTP/1.1" status: 204 len: 168 time: 1.7556963 Nov 24 04:10:41.473696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3dfb5b9f-0a0f-4c74-8aa4-0924a325ed4f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:41.481543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59068) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:41.498137 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-829448b0-26c8-4195-a9ec-fa4bd6bf2d44 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2581410 Nov 24 04:10:41.499810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.500385 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Added segment 56664322-5612-41c1-88ba-8ac6b9ba52dd of type vlan for network 6b68065f-c06f-472b-9b56-d9c6686f47da Nov 24 04:10:41.501822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59070) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:41.508580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'name': 'tempest-AllowedAddressPairTestJSON-1003217498'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:41.570724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a7d39ba0-651c-4385-836c-7e01c2f3724c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:41.581750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:41.590909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.598277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.602271 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/522fbdcd-5bc8-4bff-9c8f-bd9985273cca HTTP/1.1" status: 204 len: 168 time: 1.8846252 Nov 24 04:10:41.609172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59072) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:41.629434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:41.708209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.721700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a15030c-4c2c-4d9a-ac81-ea709378b3a1 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Network': ['ID=522fbdcd-5bc8-4bff-9c8f-bd9985273cca,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:41.736091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:41.736682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.746064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.757658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.764354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:41.765139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.802073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.844633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 796 time: 1.1972158 Nov 24 04:10:41.849560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59074) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:41.852775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-84bfe532-4d94-4267-8013-5ae402b880f0 None None] Provisioning complete for port a7d39ba0-651c-4385-836c-7e01c2f3724c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:41.853271 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84bfe532-4d94-4267-8013-5ae402b880f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.853385 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b21f0995-a3f2-441d-867a-c815a0af6a3e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 7.0752757 Nov 24 04:10:41.859046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:41.859543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Request body: {'subnet': {'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:41.859663 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.865238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c19620d-41c0-4337-aac6-e552552f0570 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:41.868340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c19620d-41c0-4337-aac6-e552552f0570 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:41.870098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c19620d-41c0-4337-aac6-e552552f0570 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:41.871860 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8c19620d-41c0-4337-aac6-e552552f0570 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.3143241 Nov 24 04:10:41.877227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59076) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:41.877463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59078) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:41.897846 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting subnet d612e6a2-304d-4720-9d39-9d84aa8f3122 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:41.920293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-3779787c-a1ad-4c57-b149-36324ecb887c', 'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'tenant_id': '7e2a6f6d5f1e47fe8be50180d1a55cf4', 'fixed_ips': [{'subnet_id': 'becde755-a9f2-4b15-8f7d-32a2169b347a'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:41.921166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.940017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.943019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a7d39ba0-651c-4385-836c-7e01c2f3724c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:41.943398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:41.944942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:41.945560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27ec5e92-75c3-4be4-97f0-0c2bb0d5eddc None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:41.953013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'port_id': '88da4fbf-809e-4c85-ad65-edf54d74f3ff', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:42.008328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39c5b564-db9e-48c0-a74d-aa686eb14591 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event updated for resources: {'Network': ['ID=6b68065f-c06f-472b-9b56-d9c6686f47da,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:42.024024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.033926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 50c2f613-f46e-4578-ba41-577ee0fbb7c0 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:42.043393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.047642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.069762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 6b68065f-c06f-472b-9b56-d9c6686f47da details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:42.075407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:42.079984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.118342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f30aa796-76f1-4aa8-8c88-87b2505220e6 None None] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:42.125438 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] device_id is not set on port 024067c8-2b6a-415b-b179-aae989ba3c89 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:42.133343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Made reservation on behalf of e898eec0924243e0bc8201e7ccaa12b8 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:42.137541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.212412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.284088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.371896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Allocated IP 172.20.0.2 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/e5d07f5f-eb23-4854-b67a-826db43b2805) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:42.402509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.407983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f849363c-9a70-47bf-9452-acdb0dd2e4fa up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:42.505688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-26e8ad17-ae05-430a-b5c8-a93f00bed689 None None] Provisioning complete for port f849363c-9a70-47bf-9452-acdb0dd2e4fa triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:42.506062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26e8ad17-ae05-430a-b5c8-a93f00bed689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.519863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.527355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.536297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f849363c-9a70-47bf-9452-acdb0dd2e4fa triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:42.536496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.664199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-26e8ad17-ae05-430a-b5c8-a93f00bed689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.683063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.714813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.729832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port f849363c-9a70-47bf-9452-acdb0dd2e4fa, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f849363c-9a70-47bf-9452-acdb0dd2e4fa,segment=NetworkSegment(8d841b8d-0511-4bc6-a050-40a630a7a969),segment_id=8d841b8d-0511-4bc6-a050-40a630a7a969)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:42.735820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.743090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.743882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4402b7af-2a15-48cb-bda5-b588d82f61ab up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:42.756792 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.760303 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/subnets/d612e6a2-304d-4720-9d39-9d84aa8f3122 HTTP/1.1" status: 204 len: 168 time: 1.1503294 Nov 24 04:10:42.772622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59080) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:42.788806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad468294-d14b-4100-b316-af5b60cd73e6 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Subnet': ['ID=d612e6a2-304d-4720-9d39-9d84aa8f3122,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:42.826990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fbf9e1a-e0ab-49a3-910c-925ef1784c37 None None] Network 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:42.853413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.875806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:42.910927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:42.929427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event updated for resources: {'Subnet': ['ID=4e5c79e0-1b5b-4ec0-be41-20460756aebc,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:42.934054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Checking segment: {'id': '56664322-5612-41c1-88ba-8ac6b9ba52dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:42.934447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Network hostable DHCP agents. Network: 6b68065f-c06f-472b-9b56-d9c6686f47da, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:10:42.955616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Network 6b68065f-c06f-472b-9b56-d9c6686f47da is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:10:42.966396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 6b68065f-c06f-472b-9b56-d9c6686f47da) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:42.978254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.981374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:42.982664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:42.983147 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-26e8ad17-ae05-430a-b5c8-a93f00bed689 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:42.983508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-26e8ad17-ae05-430a-b5c8-a93f00bed689 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:43.007469 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0a0a92fc-cc68-43e7-9817-658aa6daaf26 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1547530 Nov 24 04:10:43.011613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59082) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:43.011812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:43.015327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-829fb9c6-3c7d-46f2-b3bf-2e0f87417aea None None] Network 6b68065f-c06f-472b-9b56-d9c6686f47da requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:43.020958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Request body: {'port': {'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-827213259'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:43.040626 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=6299b5ec-3528-4135-bd7a-fec8d0b93cde,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:43.110024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.152734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Made reservation on behalf of e898eec0924243e0bc8201e7ccaa12b8 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:43.156412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.176694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] device_id is not set on port e8eafdb9-21f1-4769-b9e4-c08aead03041 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:43.215259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.227239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=50c2f613-f46e-4578-ba41-577ee0fbb7c0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:43.246960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.252960 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eb3bdbff-41c8-4673-8890-1963dd1cbb04 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/50c2f613-f46e-4578-ba41-577ee0fbb7c0 HTTP/1.1" status: 204 len: 168 time: 1.3733344 Nov 24 04:10:43.264710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59084) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:43.279026 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.311017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Allocated IP 2001:db8::22c (6b68065f-c06f-472b-9b56-d9c6686f47da/4e5c79e0-1b5b-4ec0-be41-20460756aebc/e8eafdb9-21f1-4769-b9e4-c08aead03041) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:43.341054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db985764-006f-4617-8c23-5daccc2c0671 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:43.349265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=f849363c-9a70-47bf-9452-acdb0dd2e4fa,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:43.418871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 4402b7af-2a15-48cb-bda5-b588d82f61ab triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:43.419243 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.467580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Router 5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:10:43.497985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.549310 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet bd40dcd2-bd79-4919-806d-c505504e9783 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:43.550461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.563200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] DHCP port deletion for 6ec1f6c2-69cf-492f-9b2e-e197f9c60baf request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:43.564516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.612310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Network 6b68065f-c06f-472b-9b56-d9c6686f47da is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:43.615697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:43.619699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:43.623151 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.626885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:43.627867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.657480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.699205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event updated for resources: {'Port': ['ID=e8eafdb9-21f1-4769-b9e4-c08aead03041,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:43.704252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Allocated IP 172.20.0.11 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/024067c8-2b6a-415b-b179-aae989ba3c89) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:43.705487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.722115 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-890d4a7d-0d7c-4ec8-b7fd-4c84047e16a2 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 941 time: 0.7085056 Nov 24 04:10:43.726722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59086) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:43.734390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Request body: {'port': {'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1197727653', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:43.735195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.api.validators [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] bootfile-name is not in valid_values {{(pid=103380) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:10:43.735614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.api.validators [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] tftp-server is not in valid_values {{(pid=103380) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:10:43.736042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.api.validators [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] server-ip-address is not in valid_values {{(pid=103380) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:10:43.765582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:43.782831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:43.802318 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:43.805653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Pushing event updated for resources: {'Port': ['ID=e5d07f5f-eb23-4854-b67a-826db43b2805,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:43.815959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.834803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Deleting port 830f76ad-7a2f-47ad-becd-81e9ca3f103e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:43.835201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.851278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.resource_extend [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:10:43.877946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-95304840-c8b2-476e-aaf0-78fe9e8f022b None None] Provisioning complete for port 6299b5ec-3528-4135-bd7a-fec8d0b93cde triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:43.878351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-95304840-c8b2-476e-aaf0-78fe9e8f022b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.887001 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-6b68065f-c06f-472b-9b56-d9c6686f47da', 'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da', 'tenant_id': 'e898eec0924243e0bc8201e7ccaa12b8', 'fixed_ips': [{'subnet_id': '4e5c79e0-1b5b-4ec0-be41-20460756aebc'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:43.887847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:43.997652 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] Deleting port 830f76ad-7a2f-47ad-becd-81e9ca3f103e {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:43.998716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.023670 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-95304840-c8b2-476e-aaf0-78fe9e8f022b None None] Port 6299b5ec-3528-4135-bd7a-fec8d0b93cde cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:44.025247 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Attempting to bind port e5d07f5f-eb23-4854-b67a-826db43b2805 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:44.025676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Attempting to bind port e5d07f5f-eb23-4854-b67a-826db43b2805 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:44.026117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Attempting to bind port e5d07f5f-eb23-4854-b67a-826db43b2805 on network 3779787c-a1ad-4c57-b149-36324ecb887c {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:44.044903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Made reservation on behalf of e898eec0924243e0bc8201e7ccaa12b8 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:44.049034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.054931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.079886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] device_id is not set on port da31c69b-9b69-4a40-90b8-608d5a1b7a2f yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:44.091164 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:44.091636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Checking segment: {'id': '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:44.092075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.092578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Bound using segment: {'id': '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:44.093101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Bound port: e5d07f5f-eb23-4854-b67a-826db43b2805, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:44.093527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.134110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f849363c-9a70-47bf-9452-acdb0dd2e4fa up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:44.192445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.207323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] For port 830f76ad-7a2f-47ad-becd-81e9ca3f103e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=830f76ad-7a2f-47ad-becd-81e9ca3f103e,segment=NetworkSegment(40e5aef9-04c6-425a-9f18-ed721c14f46c),segment_id=40e5aef9-04c6-425a-9f18-ed721c14f46c)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:44.207552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.242446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-95304840-c8b2-476e-aaf0-78fe9e8f022b None None] Provisioning complete for port f849363c-9a70-47bf-9452-acdb0dd2e4fa triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:44.242814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-95304840-c8b2-476e-aaf0-78fe9e8f022b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.263095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Allocated IP 2001:db8::1b2 (6b68065f-c06f-472b-9b56-d9c6686f47da/4e5c79e0-1b5b-4ec0-be41-20460756aebc/da31c69b-9b69-4a40-90b8-608d5a1b7a2f) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:44.270195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:44.277873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] Calling delete_port for 830f76ad-7a2f-47ad-becd-81e9ca3f103e owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:44.279126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:44.287359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:44.318354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=024067c8-2b6a-415b-b179-aae989ba3c89,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:44.355150 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.383393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] For port e5d07f5f-eb23-4854-b67a-826db43b2805, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:44.410040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] For port e5d07f5f-eb23-4854-b67a-826db43b2805, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e5d07f5f-eb23-4854-b67a-826db43b2805,segment=NetworkSegment(3e2d0adb-4d09-4c22-ab0c-9c06ac580e68),segment_id=3e2d0adb-4d09-4c22-ab0c-9c06ac580e68)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:44.418347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f849363c-9a70-47bf-9452-acdb0dd2e4fa triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:44.418860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.426407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:44.427072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.437071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] For port 830f76ad-7a2f-47ad-becd-81e9ca3f103e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=830f76ad-7a2f-47ad-becd-81e9ca3f103e,segment=NetworkSegment(40e5aef9-04c6-425a-9f18-ed721c14f46c),segment_id=40e5aef9-04c6-425a-9f18-ed721c14f46c)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:44.437436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.444034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.456288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:44.456550 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-39ff5f5b-4a8d-499b-be55-1a5308f80455 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.9531190 Nov 24 04:10:44.459624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59088) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:44.465339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'name': 'tempest-AllowedAddressPairTestJSON-861958611', 'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:80:fc:72'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:44.469280 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] Sync routers for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:44.492395 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:44.493304 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:44.502110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.552425 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:44.562544 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:44.563443 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:44.605782 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:44.606866 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-430ee251-03d7-4d18-8f0c-b2fd744a806e None None] The sync data for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:44.641346 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.656636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44254e4c-a75a-4071-a13d-56f2adda4d62 None None] Pushing event updated for resources: {'Port': ['ID=e5d07f5f-eb23-4854-b67a-826db43b2805,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:44.691847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] No DVR routers for this DVR port 830f76ad-7a2f-47ad-becd-81e9ca3f103e on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:44.695533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8943ec89-ff6d-484d-b5f2-24a2daf2cf1a None None] Pushing event deleted for resources: {'Port': ['ID=830f76ad-7a2f-47ad-becd-81e9ca3f103e,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:44.703418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Calling delete_port for 830f76ad-7a2f-47ad-becd-81e9ca3f103e owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:44.713555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.756118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:44.818873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.828481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.832284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 830f76ad-7a2f-47ad-becd-81e9ca3f103e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:44.832750 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bf6ec793-7400-400f-88e7-c085b3740c9c tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 891 time: 9.5362322 Nov 24 04:10:44.839739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.844353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59090) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:44.868603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 830f76ad-7a2f-47ad-becd-81e9ca3f103e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:44.869326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 830f76ad-7a2f-47ad-becd-81e9ca3f103e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:44.959378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=bd40dcd2-bd79-4919-806d-c505504e9783,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:44.963786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.977438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:44.981175 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dfeaa87f-d878-4112-9370-2ae68ac232e5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/bd40dcd2-bd79-4919-806d-c505504e9783 HTTP/1.1" status: 204 len: 168 time: 1.7150209 Nov 24 04:10:45.013870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59092) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.059044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Allocated IP 2001:db8::2 (6b68065f-c06f-472b-9b56-d9c6686f47da/4e5c79e0-1b5b-4ec0-be41-20460756aebc/3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:45.122300 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Network 6b68065f-c06f-472b-9b56-d9c6686f47da is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:45.125090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.126112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.137763 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-78e3b7ba-19b6-4eea-901e-87058cbd01cc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1037252 Nov 24 04:10:45.147631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59096) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.151632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:45.162469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ae6dd59-fc19-418d-80e1-e78446006648 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:45.173729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.176194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.202019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:45.208430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:45.208601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.231926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event updated for resources: {'Port': ['ID=da31c69b-9b69-4a40-90b8-608d5a1b7a2f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:45.239584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] device_id is not set on port 8e1a880f-914c-46a6-8d5f-2ae456e01874 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:45.247202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-140d6157-fb9e-4360-a77c-aa8febeea0a7 None None] Provisioning complete for port 181251df-85cb-461e-bd5d-85bf7bbc7572 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:45.247592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-140d6157-fb9e-4360-a77c-aa8febeea0a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.259235 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-68d0dacb-f060-4265-a7db-c15bc74e27c9 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1150 time: 1.5313096 Nov 24 04:10:45.273538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59098) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.297326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] No DVR routers for this DVR port 830f76ad-7a2f-47ad-becd-81e9ca3f103e on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:45.388113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f08c2188-564b-4886-812d-5d8824ef8f26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:45.392262 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f08c2188-564b-4886-812d-5d8824ef8f26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2425787 Nov 24 04:10:45.397052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59100) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.414758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.426567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.437287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ec1f6c2-69cf-492f-9b2e-e197f9c60baf']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:45.447172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '40e5aef9-04c6-425a-9f18-ed721c14f46c') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:45.447551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '40e5aef9-04c6-425a-9f18-ed721c14f46c') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:45.453769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.460470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.473586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.488328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=6299b5ec-3528-4135-bd7a-fec8d0b93cde,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:45.537992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Pushing event updated for resources: {'Port': ['ID=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:45.550392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Network 6b68065f-c06f-472b-9b56-d9c6686f47da is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:45.552300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.553199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:45.556483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:45.558481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Port': ['ID=830f76ad-7a2f-47ad-becd-81e9ca3f103e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:45.565081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:45.570464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Releasing vlan 170 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:45.571042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:45.574522 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:45.602997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c62aa950-1a15-4c55-9929-d1c312ff1b7d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:45.605100 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c62aa950-1a15-4c55-9929-d1c312ff1b7d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2064705 Nov 24 04:10:45.608277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Allocated IP 172.20.0.10 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/8e1a880f-914c-46a6-8d5f-2ae456e01874) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:45.618621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a706c5da-d31a-4069-a409-fc021003a36d tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:45.625267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a706c5da-d31a-4069-a409-fc021003a36d tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:45.626975 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a706c5da-d31a-4069-a409-fc021003a36d tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1883 time: 0.3518062 Nov 24 04:10:45.627572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59104) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.636371 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59106) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.696946 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dd65dff7-a854-4b19-88d5-bca7e543a92d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0638885 Nov 24 04:10:45.703288 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59108) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:45.711724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f36aa84e-b1a9-48a9-a9bc-a30e5002d5a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:45.800699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.825536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:45.842711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.845883 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] 10.222.0.48 "DELETE /v2.0/networks/6ec1f6c2-69cf-492f-9b2e-e197f9c60baf HTTP/1.1" status: 204 len: 168 time: 3.0649250 Nov 24 04:10:45.868025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cabfbcf9-32cb-4e2a-a006-42541fbf8366 tempest-NetworksIpV6TestAttrs-792777612 tempest-NetworksIpV6TestAttrs-792777612-project] Pushing event deleted for resources: {'Network': ['ID=6ec1f6c2-69cf-492f-9b2e-e197f9c60baf,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:45.871713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:45.903848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:45.945395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Attempting to bind port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:45.945887 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Attempting to bind port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '56664322-5612-41c1-88ba-8ac6b9ba52dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:45.946291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Attempting to bind port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 on network 6b68065f-c06f-472b-9b56-d9c6686f47da {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:45.956404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f36aa84e-b1a9-48a9-a9bc-a30e5002d5a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:45.961409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f36aa84e-b1a9-48a9-a9bc-a30e5002d5a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.966908 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:45.969559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Checking segment: {'id': '56664322-5612-41c1-88ba-8ac6b9ba52dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:45.969732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.970026 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Bound using segment: {'id': '56664322-5612-41c1-88ba-8ac6b9ba52dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:45.971843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Bound port: 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56664322-5612-41c1-88ba-8ac6b9ba52dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6b68065f-c06f-472b-9b56-d9c6686f47da'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:45.972255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:45.976211 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-f36aa84e-b1a9-48a9-a9bc-a30e5002d5a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:10:45.976830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f36aa84e-b1a9-48a9-a9bc-a30e5002d5a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:46.040922 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f36aa84e-b1a9-48a9-a9bc-a30e5002d5a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.3332803 Nov 24 04:10:46.055917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59114) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:46.068850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5c3db9a5-9983-47d6-9e99-4a34dcdc72ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:46.093033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:46.106876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.124024 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:46.146049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] Deleting port 181251df-85cb-461e-bd5d-85bf7bbc7572 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:46.146456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.174509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Deleting port da31c69b-9b69-4a40-90b8-608d5a1b7a2f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:46.174863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.313978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.377586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] For port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:46.382052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] For port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,segment=NetworkSegment(56664322-5612-41c1-88ba-8ac6b9ba52dd),segment_id=56664322-5612-41c1-88ba-8ac6b9ba52dd)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:46.394933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e5d07f5f-eb23-4854-b67a-826db43b2805 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:46.425265 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-76bf7d9d-9590-4800-b4f5-b5c8a4ff5bb9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/floatingips/665928ba-5271-4128-95a1-b5b20f371337 HTTP/1.1" status: 200 len: 978 time: 4.5467989 Nov 24 04:10:46.434120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7336f943-d4cf-45e1-9075-729c7ef875f8 None None] Network 3779787c-a1ad-4c57-b149-36324ecb887c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:46.444756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59120) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:46.445031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59122) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:46.451630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:46.452285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:46.490549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.513127 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:46.571659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router 7018d854-20ab-4a10-9fbe-cf1d554328fe is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:10:46.582569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.597337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f99ab8a-3ff0-4570-8c89-c35211ec1a30 None None] Pushing event updated for resources: {'Port': ['ID=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:46.614829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.621996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:46.622356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Calling delete_port for da31c69b-9b69-4a40-90b8-608d5a1b7a2f owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:46.622693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:46.633361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5ea383a2-453b-46a8-b339-5b15b7abd668 None None] Provisioning complete for port e5d07f5f-eb23-4854-b67a-826db43b2805 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:46.633778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5ea383a2-453b-46a8-b339-5b15b7abd668 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.665674 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0447ca8e-d565-4a99-8303-cc9203a97adb req-6fb596e5-8ec0-4097-a77a-4e355e345589 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:46.671910 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0447ca8e-d565-4a99-8303-cc9203a97adb req-6fb596e5-8ec0-4097-a77a-4e355e345589 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2908072 Nov 24 04:10:46.686545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] For port 181251df-85cb-461e-bd5d-85bf7bbc7572, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=181251df-85cb-461e-bd5d-85bf7bbc7572,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:46.686954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.747467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:46.748134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a52e2d50-4ee8-4a82-950d-52b6fef5e6bc None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:46.775102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:46.778554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-fe3d3463-6753-4e22-908a-dc09ec8d8468 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:46.780067 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-fe3d3463-6753-4e22-908a-dc09ec8d8468 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.4196434 Nov 24 04:10:46.789998 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] Sync routers for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:46.805226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:46.807756 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:46.810811 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:46.811404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c3db9a5-9983-47d6-9e99-4a34dcdc72ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:46.814941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c3db9a5-9983-47d6-9e99-4a34dcdc72ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.816336 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c3db9a5-9983-47d6-9e99-4a34dcdc72ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:10:46.816770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c3db9a5-9983-47d6-9e99-4a34dcdc72ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:46.827190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:46.837399 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-536d1977-d482-4d85-835e-6a59e8eee78b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/7018d854-20ab-4a10-9fbe-cf1d554328fe/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8512619 Nov 24 04:10:46.843331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] Calling delete_port for 181251df-85cb-461e-bd5d-85bf7bbc7572 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:46.843846 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=8e1a880f-914c-46a6-8d5f-2ae456e01874,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:46.857138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59126) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:46.860333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:46.958923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e5d07f5f-eb23-4854-b67a-826db43b2805 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:46.958923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:46.960731 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5c3db9a5-9983-47d6-9e99-4a34dcdc72ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.8998523 Nov 24 04:10:46.965011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59128) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:47.048825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-bec4fa42-b595-4057-bb78-5e8be9f281ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:47.054733 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:47.072909 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:47.073959 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:47.083501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2073bc8d-d99d-4853-bec8-2d1e6671a905 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:47.085345 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2073bc8d-d99d-4853-bec8-2d1e6671a905 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports/6299b5ec-3528-4135-bd7a-fec8d0b93cde HTTP/1.1" status: 200 len: 910 time: 0.2153122 Nov 24 04:10:47.101568 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0447ca8e-d565-4a99-8303-cc9203a97adb req-89610ed7-81c5-40ec-9566-562961c5b6da tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4197843 Nov 24 04:10:47.104620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59130) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:47.122377 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-83d4cf97-35e0-44e9-8420-b70e5df09260 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=b122491e0fb34122afbcabe86bf340c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6657946 Nov 24 04:10:47.136880 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:47.137544 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-168a4eba-3e0d-408d-9aa2-66a283ab4fa3 None None] The sync data for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:47.156847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5ea383a2-453b-46a8-b339-5b15b7abd668 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.158193 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59132) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:47.248798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.307878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5ea383a2-453b-46a8-b339-5b15b7abd668 None None] For port e5d07f5f-eb23-4854-b67a-826db43b2805, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e5d07f5f-eb23-4854-b67a-826db43b2805,segment=NetworkSegment(3e2d0adb-4d09-4c22-ab0c-9c06ac580e68),segment_id=3e2d0adb-4d09-4c22-ab0c-9c06ac580e68)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:47.323569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5ea383a2-453b-46a8-b339-5b15b7abd668 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.327545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] Pushing event deleted for resources: {'Port': ['ID=181251df-85cb-461e-bd5d-85bf7bbc7572,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:47.342410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-793adf86-ff49-4091-be67-c608c236aa33 None None] No DVR routers for this DVR port 181251df-85cb-461e-bd5d-85bf7bbc7572 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:47.388247 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.487917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:10:47.488286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:10:47.499431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea383a2-453b-46a8-b339-5b15b7abd668 None None] Pushing event updated for resources: {'Port': ['ID=e5d07f5f-eb23-4854-b67a-826db43b2805,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:47.503298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-efcd331f-7c56-4819-b3ec-ca789492ffa7 None None] Provisioning complete for port 6299b5ec-3528-4135-bd7a-fec8d0b93cde triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:47.503681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-efcd331f-7c56-4819-b3ec-ca789492ffa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.544098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-efcd331f-7c56-4819-b3ec-ca789492ffa7 None None] Port 6299b5ec-3528-4135-bd7a-fec8d0b93cde cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:47.628424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:47.629017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.637162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.668471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Provisioning complete for port e5d07f5f-eb23-4854-b67a-826db43b2805 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:47.668858 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.713246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event deleted for resources: {'Port': ['ID=da31c69b-9b69-4a40-90b8-608d5a1b7a2f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:47.742574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port d16567e9-41ac-43ab-8236-074b4d22ca76 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:47.742962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.748827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.759084 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2dad3037-9834-4ea2-9cdc-25b6fa533807 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "DELETE /v2.0/ports/da31c69b-9b69-4a40-90b8-608d5a1b7a2f HTTP/1.1" status: 204 len: 168 time: 2.1148596 Nov 24 04:10:47.769480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59134) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:47.772557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-d8e526e7-aecf-42b6-807c-7f818bb69bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:47.774335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-d8e526e7-aecf-42b6-807c-7f818bb69bc4 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.7243013 Nov 24 04:10:47.775222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c92837da-07bc-41f3-9416-e296ef6d7e7d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.837493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Provisioning complete for port 024067c8-2b6a-415b-b179-aae989ba3c89 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:47.837916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.854743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Request body: {'port': {'name': 'tempest-new-port-name-470762292', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:47.855499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.api.validators [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] bootfile-name is not in valid_values {{(pid=103380) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:10:47.856061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.api.validators [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] tftp-server is not in valid_values {{(pid=103380) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:10:47.861796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.api.validators [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] server-ip-address is not in valid_values {{(pid=103380) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:10:47.866819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.903467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Port 024067c8-2b6a-415b-b179-aae989ba3c89 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:47.906230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c92837da-07bc-41f3-9416-e296ef6d7e7d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:47.920917 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e6740fe6-3320-410b-930f-2fcf97a7be77 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 999 time: 3.4601762 Nov 24 04:10:47.924871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59136) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:47.938688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Provisioning complete for port 8e1a880f-914c-46a6-8d5f-2ae456e01874 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:47.939284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.030572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.030928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.045003 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-a29528b7-bd3e-400c-84e0-05fe6b491f02 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1001 time: 0.2560306 Nov 24 04:10:48.056462 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eb2043a8-18f1-4563-b771-c85b01ea40b0 None None] Port 8e1a880f-914c-46a6-8d5f-2ae456e01874 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:48.075965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for d16567e9-41ac-43ab-8236-074b4d22ca76 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:48.098043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bec4fa42-b595-4057-bb78-5e8be9f281ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:48.101590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bec4fa42-b595-4057-bb78-5e8be9f281ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.115799 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-bec4fa42-b595-4057-bb78-5e8be9f281ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:10:48.116548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bec4fa42-b595-4057-bb78-5e8be9f281ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:48.148711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 181251df-85cb-461e-bd5d-85bf7bbc7572 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:48.168448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8bc1f26-5ae5-46c2-9ecc-3186828380e4 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:48.186421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8bc1f26-5ae5-46c2-9ecc-3186828380e4 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:48.200094 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8bc1f26-5ae5-46c2-9ecc-3186828380e4 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:48.203792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 181251df-85cb-461e-bd5d-85bf7bbc7572 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:48.203792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 181251df-85cb-461e-bd5d-85bf7bbc7572 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:48.210236 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e8bc1f26-5ae5-46c2-9ecc-3186828380e4 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2468 time: 0.2796733 Nov 24 04:10:48.224698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.236136 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bec4fa42-b595-4057-bb78-5e8be9f281ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 1.2620840 Nov 24 04:10:48.236858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59140) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:48.240938 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b53d2ad5-74af-4189-90cc-fb341a983b79 None None] Provisioning complete for port 024067c8-2b6a-415b-b179-aae989ba3c89 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:48.241423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b53d2ad5-74af-4189-90cc-fb341a983b79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.284948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59142) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:48.297389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b693534f-2c4c-4680-9608-c826697efaac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:48.348919 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b53d2ad5-74af-4189-90cc-fb341a983b79 None None] Port 024067c8-2b6a-415b-b179-aae989ba3c89 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:48.378708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e8e3cf6-96f9-4c20-9380-1054872124f4 None None] Network 6b68065f-c06f-472b-9b56-d9c6686f47da requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:48.384244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-424d46ad-344f-4706-9fca-8f21d264b726 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:48.386046 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-424d46ad-344f-4706-9fca-8f21d264b726 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.3324199 Nov 24 04:10:48.386688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c92837da-07bc-41f3-9416-e296ef6d7e7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.389565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c92837da-07bc-41f3-9416-e296ef6d7e7d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.390733 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c92837da-07bc-41f3-9416-e296ef6d7e7d admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/82bfd2d0-fdbd-4cea-9229-689316b1d5a7 HTTP/1.1" status: 204 len: 168 time: 1.2307167 Nov 24 04:10:48.472030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92837da-07bc-41f3-9416-e296ef6d7e7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82bfd2d0-fdbd-4cea-9229-689316b1d5a7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:48.524978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-8c5b4076-26fa-45fb-9dd6-41bf8aae3a15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:48.526628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e5d07f5f-eb23-4854-b67a-826db43b2805 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:48.527093 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-8c5b4076-26fa-45fb-9dd6-41bf8aae3a15 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1066413 Nov 24 04:10:48.536754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b80e98-e033-426e-ab7a-42fb55dcdf51 req-2d50a90f-4c7f-46bd-a666-929416a347ff tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:48.545558 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.545753 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-67b80e98-e033-426e-ab7a-42fb55dcdf51 req-2d50a90f-4c7f-46bd-a666-929416a347ff tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2262824 Nov 24 04:10:48.628617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Provisioning complete for port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:48.629708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.646515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b693534f-2c4c-4680-9608-c826697efaac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:48.650408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b693534f-2c4c-4680-9608-c826697efaac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.652631 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-b693534f-2c4c-4680-9608-c826697efaac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:10:48.653182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b693534f-2c4c-4680-9608-c826697efaac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:48.655934 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-67b80e98-e033-426e-ab7a-42fb55dcdf51 req-90b211f7-aa2b-41c5-9924-4dbc53fe0028 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1081083 Nov 24 04:10:48.723292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e5d07f5f-eb23-4854-b67a-826db43b2805 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:48.723792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.760516 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-d0652a20-0bb7-40cb-bdc0-cba05315cb19 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2041206 Nov 24 04:10:48.803254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.803934 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b693534f-2c4c-4680-9608-c826697efaac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.5179141 Nov 24 04:10:48.808020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59154) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:48.815587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-54e8f5d1-aecc-4f84-a3d2-4fd2ad4aebb9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:48.901581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.904221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=d16567e9-41ac-43ab-8236-074b4d22ca76,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:48.906508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port 8e1a880f-914c-46a6-8d5f-2ae456e01874 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:48.906749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:48.969027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Allocated IP 172.20.0.1 (12205fb4-dac3-4af0-b4b6-24882f86dd40/7b52fb93-a07a-4b5c-a3a4-11308879ff75/67403475-1818-4cf3-83e8-03378f662922) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:48.989078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] For port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,segment=NetworkSegment(56664322-5612-41c1-88ba-8ac6b9ba52dd),segment_id=56664322-5612-41c1-88ba-8ac6b9ba52dd)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:49.020004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.071535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54e8f5d1-aecc-4f84-a3d2-4fd2ad4aebb9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:49.075124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-54e8f5d1-aecc-4f84-a3d2-4fd2ad4aebb9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.076595 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-54e8f5d1-aecc-4f84-a3d2-4fd2ad4aebb9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:10:49.077081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-54e8f5d1-aecc-4f84-a3d2-4fd2ad4aebb9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:49.107315 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0c5c6e72-817e-47bc-9185-c7d88d266ad2 req-fc54d288-2ca4-4927-bca8-1e969cca2c19 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3376920 Nov 24 04:10:49.111854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.125422 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 665928ba-5271-4128-95a1-b5b20f371337 disassociated (deleted). External IP: 172.26.5.83, port: 88da4fbf-809e-4c85-ad65-edf54d74f3ff. Nov 24 04:10:49.161716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:49.167590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Pushing event updated for resources: {'Port': ['ID=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:49.172455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.182521 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-54e8f5d1-aecc-4f84-a3d2-4fd2ad4aebb9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.3686063 Nov 24 04:10:49.184954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59164) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.193369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-343faa03-dc34-49c6-be1a-cb9bcb659058 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:49.196848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.302640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Provisioning complete for port e8eafdb9-21f1-4769-b9e4-c08aead03041 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:49.305047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.324740 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.352773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Port e8eafdb9-21f1-4769-b9e4-c08aead03041 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:49.357428 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:49.358105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.411210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] In _notify_port_updated(), no bound segment for port e8eafdb9-21f1-4769-b9e4-c08aead03041 on network 6b68065f-c06f-472b-9b56-d9c6686f47da {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:10:49.417126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:49.418105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.422621 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "PUT /v2.0/ports/e8eafdb9-21f1-4769-b9e4-c08aead03041 HTTP/1.1" status: 200 len: 1129 time: 1.5773277 Nov 24 04:10:49.423539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59168) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.433425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59170) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.442489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for 8e1a880f-914c-46a6-8d5f-2ae456e01874 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:49.450086 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-343faa03-dc34-49c6-be1a-cb9bcb659058 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:49.453591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-343faa03-dc34-49c6-be1a-cb9bcb659058 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.455187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-343faa03-dc34-49c6-be1a-cb9bcb659058 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:10:49.455623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-343faa03-dc34-49c6-be1a-cb9bcb659058 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:10:49.484364 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-343faa03-dc34-49c6-be1a-cb9bcb659058 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2948794 Nov 24 04:10:49.484608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59174) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.558499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8469613f-4f4d-4e46-affa-44c0570024ad tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event updated for resources: {'Port': ['ID=e8eafdb9-21f1-4769-b9e4-c08aead03041,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:49.560975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59176) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.570245 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2704acaa-120d-401e-923d-6852ec442a77 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0666010 Nov 24 04:10:49.625740 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:49.643147 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.21.0.1 (f6a28ac9-8f2a-460e-8287-e5737a0a01fa/79a08516-6cbb-4969-91b9-a4463e92bf0a/898d565d-b5bb-4c62-aadf-9b732f8b6cd9) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:49.651788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaa3206f-aa4a-45a7-9dfa-f26013584846 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:49.658012 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eaa3206f-aa4a-45a7-9dfa-f26013584846 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "GET /v2.0/ports/e8eafdb9-21f1-4769-b9e4-c08aead03041 HTTP/1.1" status: 200 len: 1129 time: 0.2168882 Nov 24 04:10:49.662215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Provisioning complete for port 8e1a880f-914c-46a6-8d5f-2ae456e01874 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:49.662560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.716191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.726323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59178) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.727003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-861fc51e-aefb-4731-9ec9-309770afc772 None None] Port 8e1a880f-914c-46a6-8d5f-2ae456e01874 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:49.846484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--524025263'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:49.862368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-367625c1-a4fb-4e23-904e-cd40c3e94cf5 None None] Provisioning complete for port e8eafdb9-21f1-4769-b9e4-c08aead03041 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:49.863126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-367625c1-a4fb-4e23-904e-cd40c3e94cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.882979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:49.896255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03510da1-4ff3-4b13-8808-73f9f2c6c60b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:49.897724 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-03510da1-4ff3-4b13-8808-73f9f2c6c60b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.3162792 Nov 24 04:10:49.898964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.903408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:49.909366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59182) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.933900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:49.934695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:49.936518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-367625c1-a4fb-4e23-904e-cd40c3e94cf5 None None] Port e8eafdb9-21f1-4769-b9e4-c08aead03041 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:49.943515 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e1b71948-48dc-4cef-8259-4253affcb800 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/floatingips/665928ba-5271-4128-95a1-b5b20f371337 HTTP/1.1" status: 204 len: 168 time: 3.4882267 Nov 24 04:10:49.976779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.979399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59184) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:49.986192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:49.990504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-367625c1-a4fb-4e23-904e-cd40c3e94cf5 None None] Provisioning complete for port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:49.990918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-367625c1-a4fb-4e23-904e-cd40c3e94cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:49.996587 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-94a45406-3670-4a80-9e8d-be63fadf9594 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0878389 Nov 24 04:10:49.997217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59186) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:50.005836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:50.033456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:50.034176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:50.051691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.078441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.080257 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:50.081186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7f35d7d-c21b-4ed6-a2e8-3d5375c7c0cd None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:50.130366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.154187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.231505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:50.234510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:50.245344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:50.257887 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-97d79a8d-ba73-4aa7-b07d-637e71867a5f None None] Could not find standard attr ID for object da31c69b-9b69-4a40-90b8-608d5a1b7a2f. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:10:50.258583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:50.264329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:50.268884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:50.273300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.277845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Port': ['ID=67403475-1818-4cf3-83e8-03378f662922,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:50.299344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.319476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:50.323049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.352995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847048f6-21fc-44d7-9bc7-532fae504bae req-2d08d1be-d828-4078-87b1-2ae338560b41 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:50.355171 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-847048f6-21fc-44d7-9bc7-532fae504bae req-2d08d1be-d828-4078-87b1-2ae338560b41 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.5006921 Nov 24 04:10:50.359864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:50.464467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=46dd12be-b5c6-47c7-8cd7-0c39682fc8ec,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:50.472889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 88da4fbf-809e-4c85-ad65-edf54d74f3ff {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:50.473255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.526856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:50.527457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Deleting port e8eafdb9-21f1-4769-b9e4-c08aead03041 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:50.527665 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.527798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.555556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.557282 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=898d565d-b5bb-4c62-aadf-9b732f8b6cd9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:50.637222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.663720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.675788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.678114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.728257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.770429 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 88da4fbf-809e-4c85-ad65-edf54d74f3ff owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:50.776897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.780615 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.3408840 Nov 24 04:10:50.785942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59188) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:50.797357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-75d3463b-6877-4a1e-94c8-0609367671cc None None] Provisioning complete for port 898d565d-b5bb-4c62-aadf-9b732f8b6cd9 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:50.799485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e3cf76-6d86-4489-bd9b-a04da65887be tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b791d462-6976-48a8-ae76-0a0fcbdb7c7a,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:50.800115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75d3463b-6877-4a1e-94c8-0609367671cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.857392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-75d3463b-6877-4a1e-94c8-0609367671cc None None] Port 898d565d-b5bb-4c62-aadf-9b732f8b6cd9 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:50.873622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-75d3463b-6877-4a1e-94c8-0609367671cc None None] Provisioning complete for port 67403475-1818-4cf3-83e8-03378f662922 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:50.874223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75d3463b-6877-4a1e-94c8-0609367671cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:50.923815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-75d3463b-6877-4a1e-94c8-0609367671cc None None] Port 67403475-1818-4cf3-83e8-03378f662922 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:51.019014 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-09002f4a-b71c-45ce-a9c9-fb4031fa5e29 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.2303882 Nov 24 04:10:51.023803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59190) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.029255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-security--710057076', 'description': 'tempest-security-description-1891746640'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:51.048139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eaec320c-5554-44e4-8e63-43d76209334e None None] Provisioning complete for port e8eafdb9-21f1-4769-b9e4-c08aead03041 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:51.048847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eaec320c-5554-44e4-8e63-43d76209334e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.090524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eaec320c-5554-44e4-8e63-43d76209334e None None] Port e8eafdb9-21f1-4769-b9e4-c08aead03041 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:51.127656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:51.129678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.136294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.149419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=8e1a880f-914c-46a6-8d5f-2ae456e01874,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:51.177060 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-847048f6-21fc-44d7-9bc7-532fae504bae req-3fb1178a-333a-45fc-8499-6743035e0e4a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7630136 Nov 24 04:10:51.219873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.253968 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Calling delete_port for e8eafdb9-21f1-4769-b9e4-c08aead03041 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:51.397613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.401040 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-269da0e7-3149-4526-891e-93f32ef8cb76 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/ports/8e1a880f-914c-46a6-8d5f-2ae456e01874 HTTP/1.1" status: 204 len: 168 time: 3.1576762 Nov 24 04:10:51.403599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59194) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.441048 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-97f2bee2-afea-46f2-97a3-1503e21869ec tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] GET failed (client error): The resource could not be found. Nov 24 04:10:51.442572 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-97f2bee2-afea-46f2-97a3-1503e21869ec tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "GET /v2.0/ports/8e1a880f-914c-46a6-8d5f-2ae456e01874 HTTP/1.1" status: 404 len: 333 time: 0.0379326 Nov 24 04:10:51.446117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59196) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.452153 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'name': 'tempest-AllowedAddressPairTestJSON-517955524'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:51.504822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:51.519537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:51.528859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:51.529316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db9218e8-b5fa-4aea-9b31-3eb4af20d2e3 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:51.529780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.548439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=8a67f037-eaa1-480a-bb39-a99413aa923b,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:51.564708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.570339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.573116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.576850 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "PUT /v2.0/security-groups/b791d462-6976-48a8-ae76-0a0fcbdb7c7a HTTP/1.1" status: 200 len: 1794 time: 0.5497048 Nov 24 04:10:51.585062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59198) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.591025 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-363a68e8-1137-49c9-be2a-65205ff89392 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.5873842 Nov 24 04:10:51.596351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.600938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59200) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.615584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:a1:ba:0e', 'name': 'tempest-NetworksTestDHCPv6-1274093950'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:51.623778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.683770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=88da4fbf-809e-4c85-ad65-edf54d74f3ff,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:51.686001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event deleted for resources: {'Port': ['ID=e8eafdb9-21f1-4769-b9e4-c08aead03041,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:51.695891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c4b5ed2-e63f-499e-a414-56cf69053867 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b791d462-6976-48a8-ae76-0a0fcbdb7c7a,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:51.705430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5480bffa-7454-4a9a-b9cf-4232a57bb1f5 None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:51.730602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '8a67f037-eaa1-480a-bb39-a99413aa923b'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:51.733802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.738387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.741868 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-18f32608-7229-49cb-9c6c-460cd767e24a tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "DELETE /v2.0/ports/e8eafdb9-21f1-4769-b9e4-c08aead03041 HTTP/1.1" status: 204 len: 168 time: 2.0146840 Nov 24 04:10:51.742916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:51.747059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.750893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59202) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.783339 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eaaa9d76-dded-44fa-9664-a01ce395ed7f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups/b791d462-6976-48a8-ae76-0a0fcbdb7c7a HTTP/1.1" status: 200 len: 1794 time: 0.1935339 Nov 24 04:10:51.791768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59204) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.823144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.855637 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.889168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.892414 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-280cc5ef-8d66-4cad-9528-431dec28b56d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/ports/88da4fbf-809e-4c85-ad65-edf54d74f3ff HTTP/1.1" status: 204 len: 168 time: 1.9119332 Nov 24 04:10:51.899454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59206) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:51.907243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:51.929823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] device_id is not set on port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:51.941984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Allocated IP 2001:db8::f816:3eff:fe46:c864 (a2b36c78-43a6-4954-8102-cb5638999bb1/8a67f037-eaa1-480a-bb39-a99413aa923b/016db787-74e0-47c6-96ab-ac6cb27ee1a9) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:51.949682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29148760-943d-4663-8c04-486b7e184926 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:51.970233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:51.997573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29148760-943d-4663-8c04-486b7e184926 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.067474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.119377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.126668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.132632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29148760-943d-4663-8c04-486b7e184926 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.135899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29148760-943d-4663-8c04-486b7e184926 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.136531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Deleting subnet 4e5c79e0-1b5b-4ec0-be41-20460756aebc {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:52.139416 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-29148760-943d-4663-8c04-486b7e184926 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/b791d462-6976-48a8-ae76-0a0fcbdb7c7a HTTP/1.1" status: 204 len: 168 time: 0.3443320 Nov 24 04:10:52.140081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.145124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59208) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:52.159325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.164551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:52.171500 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:52.175139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:52.176971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29148760-943d-4663-8c04-486b7e184926 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b791d462-6976-48a8-ae76-0a0fcbdb7c7a,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:52.180828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Pushing event updated for resources: {'Port': ['ID=016db787-74e0-47c6-96ab-ac6cb27ee1a9,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:52.181625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.238340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 7b1a5734-63c2-45fa-878c-126e0b1f949a yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:52.244004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Attempting to bind port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:52.244292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Attempting to bind port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:52.244742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Attempting to bind port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:52.250368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:52.250986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:52.251219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.252008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:52.252179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Bound port: 016db787-74e0-47c6-96ab-ac6cb27ee1a9, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:52.252638 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.301163 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-646f7552-3c89-4fe1-bef0-e64208b482c6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1549258 Nov 24 04:10:52.307391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59210) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:52.327373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] For port 016db787-74e0-47c6-96ab-ac6cb27ee1a9, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:52.331457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] For port 016db787-74e0-47c6-96ab-ac6cb27ee1a9, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=016db787-74e0-47c6-96ab-ac6cb27ee1a9,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:52.332918 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-4df1fb1b-5b8b-400d-b19b-34b6af8e7c8d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] delete failed (client error): The resource could not be found. Nov 24 04:10:52.333954 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4df1fb1b-5b8b-400d-b19b-34b6af8e7c8d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/b791d462-6976-48a8-ae76-0a0fcbdb7c7a HTTP/1.1" status: 404 len: 347 time: 0.0256288 Nov 24 04:10:52.337386 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.343429 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.350424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59212) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:52.378213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--1172934762'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:52.407645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5833335b-1fa1-4b3d-bc0e-1dc8735b55f2 None None] Pushing event updated for resources: {'Port': ['ID=016db787-74e0-47c6-96ab-ac6cb27ee1a9,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:52.426976 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.442386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Allocated IP 172.20.0.3 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/9b79b8ac-7d99-4d02-aba2-53c96a110e2b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:52.465590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.533272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fea1:ba0e (a2b36c78-43a6-4954-8102-cb5638999bb1/8a67f037-eaa1-480a-bb39-a99413aa923b/7b1a5734-63c2-45fa-878c-126e0b1f949a) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:52.541034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.592717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.628436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.641999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event deleted for resources: {'Subnet': ['ID=4e5c79e0-1b5b-4ec0-be41-20460756aebc,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:52.670190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.676028 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f2495d88-7b06-419b-9dcd-a728b88d223b tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "DELETE /v2.0/subnets/4e5c79e0-1b5b-4ec0-be41-20460756aebc HTTP/1.1" status: 204 len: 168 time: 0.9209182 Nov 24 04:10:52.679120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59214) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:52.692955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1c7d02e-b38d-42cb-9839-d74f945949c2 None None] Network 6b68065f-c06f-472b-9b56-d9c6686f47da requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:52.706106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.709915 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3521721 Nov 24 04:10:52.732362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59216) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:52.732968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64e78fc-72f1-4060-b47b-75ae86581d19 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e127dd16-140f-44ab-8ce6-11cb69eb19a3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:52.739237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': 'e127dd16-140f-44ab-8ce6-11cb69eb19a3', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:52.763520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.171 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/bd98b4f8-d0c4-4c10-ae37-d170ca6d20f0) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:52.874561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.941101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] DHCP port deletion for 6b68065f-c06f-472b-9b56-d9c6686f47da request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:52.944576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:52.995632 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] Deleting port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:52.996264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.013836 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.018445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.029392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.031766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.042929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.061244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.064865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.067033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=576b176a-0468-459f-ac7b-5de931b93e6b,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.076701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.078391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] For port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,segment=NetworkSegment(56664322-5612-41c1-88ba-8ac6b9ba52dd),segment_id=56664322-5612-41c1-88ba-8ac6b9ba52dd)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:53.078978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.094056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] Calling delete_port for 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:53.132202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.135970 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0126d4fa-6eda-46c4-98ed-a1b319b9e93b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3978982 Nov 24 04:10:53.139698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59218) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:53.141401 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:53.158069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:53.167659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.173300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=7b1a5734-63c2-45fa-878c-126e0b1f949a,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.176600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:53.183073 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:53.183724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.192485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.195691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.212718 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.223194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-afd1086b-6dec-4dea-8029-20271225df2b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.250594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] Pushing event deleted for resources: {'Port': ['ID=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.251759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.257753 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b7bf9b5-c354-41ba-bbb7-7bb9f518d166 None None] No DVR routers for this DVR port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:53.259070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.261112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=898d565d-b5bb-4c62-aadf-9b732f8b6cd9,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.269051 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0c5deffc-2b06-4b42-957b-9cac8ac37cd5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.6629970 Nov 24 04:10:53.269051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:53.273544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-afd1086b-6dec-4dea-8029-20271225df2b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.279689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59220) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:53.287416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:53.304033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:53.324121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:53.333484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.335477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:53.360013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=bd98b4f8-d0c4-4c10-ae37-d170ca6d20f0,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.360622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:53.399011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-afd1086b-6dec-4dea-8029-20271225df2b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.409213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-afd1086b-6dec-4dea-8029-20271225df2b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.412776 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-afd1086b-6dec-4dea-8029-20271225df2b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/576b176a-0468-459f-ac7b-5de931b93e6b HTTP/1.1" status: 204 len: 168 time: 0.2666914 Nov 24 04:10:53.421971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59222) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:53.425601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Deleting port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:53.426062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.441047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Port': ['ID=67403475-1818-4cf3-83e8-03378f662922,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.447113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a63bab7-7ceb-4708-978b-992488a70db9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:53.453040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a63bab7-7ceb-4708-978b-992488a70db9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:53.454746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8a63bab7-7ceb-4708-978b-992488a70db9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1738842 Nov 24 04:10:53.458706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd1086b-6dec-4dea-8029-20271225df2b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=576b176a-0468-459f-ac7b-5de931b93e6b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.460077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59224) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:53.569153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.585112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:53.585869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.600811 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a16575b5-b334-472c-946a-ebcae8657689 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1715021 Nov 24 04:10:53.604876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59226) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:53.657030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=9b79b8ac-7d99-4d02-aba2-53c96a110e2b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.678912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] For port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:53.679551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.701663 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8a993630-0713-4afa-8f3d-e05e85f9ba7f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 2.2545295 Nov 24 04:10:53.702382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59228) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:53.704388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:53.716168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.724632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Calling delete_port for 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:53.729754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:80:fc:72'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:53.735655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 was not found and therefore no delete operation was performed {{(pid=103380) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:10:53.739175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:53.746501 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6a41075b-78cc-4c5a-9004-921d50637d23 None None] Provisioning complete for port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:53.746985 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36efae5a-70f7-464f-8ca3-b57e0be5f8e8 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.748447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6a41075b-78cc-4c5a-9004-921d50637d23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.760683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.777528 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36efae5a-70f7-464f-8ca3-b57e0be5f8e8 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.791249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 7b1a5734-63c2-45fa-878c-126e0b1f949a {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:53.791591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.800121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:53.801749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6a41075b-78cc-4c5a-9004-921d50637d23 None None] Port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:53.810494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:53.813223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event deleted for resources: {'Port': ['ID=3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:53.864192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] No DVR routers for this DVR port 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:53.935787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3e79780f-0568-4969-960f-717c4f5e5552 None None] Provisioning complete for port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:53.937042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3e79780f-0568-4969-960f-717c4f5e5552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.957777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36efae5a-70f7-464f-8ca3-b57e0be5f8e8 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.960401 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36efae5a-70f7-464f-8ca3-b57e0be5f8e8 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:53.965075 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-36efae5a-70f7-464f-8ca3-b57e0be5f8e8 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/e127dd16-140f-44ab-8ce6-11cb69eb19a3 HTTP/1.1" status: 204 len: 168 time: 0.3548615 Nov 24 04:10:53.972231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59230) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.078737 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router 7018d854-20ab-4a10-9fbe-cf1d554328fe has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:54.089993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3e79780f-0568-4969-960f-717c4f5e5552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.097109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.130445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36efae5a-70f7-464f-8ca3-b57e0be5f8e8 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e127dd16-140f-44ab-8ce6-11cb69eb19a3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:54.132925 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 7b1a5734-63c2-45fa-878c-126e0b1f949a owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:54.156730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3e79780f-0568-4969-960f-717c4f5e5552 None None] For port 016db787-74e0-47c6-96ab-ac6cb27ee1a9, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=016db787-74e0-47c6-96ab-ac6cb27ee1a9,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:54.165012 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3e79780f-0568-4969-960f-717c4f5e5552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.201291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.245730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e79780f-0568-4969-960f-717c4f5e5552 None None] Pushing event updated for resources: {'Port': ['ID=016db787-74e0-47c6-96ab-ac6cb27ee1a9,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:54.270484 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5a19d95e-afe8-43e9-a9d6-9446e5267c25 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2901607 Nov 24 04:10:54.277960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59232) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.285174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--160968661'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:54.291111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ad553949-9c59-4641-9a64-87c5cb033a97 None None] Provisioning complete for port 898d565d-b5bb-4c62-aadf-9b732f8b6cd9 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:54.296028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad553949-9c59-4641-9a64-87c5cb033a97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.330177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b68065f-c06f-472b-9b56-d9c6686f47da']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:54.347255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ad553949-9c59-4641-9a64-87c5cb033a97 None None] Port 898d565d-b5bb-4c62-aadf-9b732f8b6cd9 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:54.347801 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.359670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.377089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 016db787-74e0-47c6-96ab-ac6cb27ee1a9 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:10:54.383098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.440534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:54.441088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.488748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-44f4720f-3a15-4305-ad14-a895a97c823b None None] Provisioning complete for port 7b1a5734-63c2-45fa-878c-126e0b1f949a triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:54.489274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44f4720f-3a15-4305-ad14-a895a97c823b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.500168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=bd98b4f8-d0c4-4c10-ae37-d170ca6d20f0,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:54.533377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-44f4720f-3a15-4305-ad14-a895a97c823b None None] Port 7b1a5734-63c2-45fa-878c-126e0b1f949a cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:54.540250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.552639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.580634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-44f4720f-3a15-4305-ad14-a895a97c823b None None] Provisioning complete for port 67403475-1818-4cf3-83e8-03378f662922 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:54.581171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44f4720f-3a15-4305-ad14-a895a97c823b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.602192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=7b1a5734-63c2-45fa-878c-126e0b1f949a,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:54.613608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.614892 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3ba12c48-2a0c-4816-aa2a-7e26cf06fee3 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.7130349 Nov 24 04:10:54.624050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-44f4720f-3a15-4305-ad14-a895a97c823b None None] Port 67403475-1818-4cf3-83e8-03378f662922 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:54.625029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59234) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.634847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.638212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'port': {'network_id': 'a47a2785-1e21-4a90-b046-5bf9f26ab1aa', 'name': 'tempest-FloatingIPTestJSON-1450913724'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:54.680128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.700268 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:54.708418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.713858 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-35994c0b-9b18-4bbc-aae0-93c9d5e6f9cb tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/7b1a5734-63c2-45fa-878c-126e0b1f949a HTTP/1.1" status: 204 len: 168 time: 1.2431855 Nov 24 04:10:54.719120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59236) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.726811 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:54.727174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 3e481a4f-47ab-4d5a-a5a3-2fb5342fcb33 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:54.769507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56664322-5612-41c1-88ba-8ac6b9ba52dd') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:54.770089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56664322-5612-41c1-88ba-8ac6b9ba52dd') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:54.799689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.803699 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5245862 Nov 24 04:10:54.810387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59238) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.814176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.816489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:54.827681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed80fe4b-f1d9-44a4-a3ff-56fb7c315b56 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:54.846897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.855509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.866870 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb349546-9d40-4dba-9ba9-a4c5927a0547 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:54.868374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb349546-9d40-4dba-9ba9-a4c5927a0547 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:54.870698 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bb349546-9d40-4dba-9ba9-a4c5927a0547 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.1478419 Nov 24 04:10:54.871207 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Releasing vlan 184 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:10:54.871665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:10:54.874937 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:10:54.876901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59240) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.889700 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Router 5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:54.895076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:54.911936 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d38c0631-15df-4fd4-b6bd-d070b033de25 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/7018d854-20ab-4a10-9fbe-cf1d554328fe/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.7982998 Nov 24 04:10:54.913796 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] Sync routers for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:54.916194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59242) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:54.930866 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:54.932441 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:54.966421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:54.974017 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:54.988046 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:54.989215 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:54.990381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.015107 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 8a67f037-eaa1-480a-bb39-a99413aa923b {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:10:55.024157 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29ba20fc-5c47-4ee4-a5d1-271c0c090cf6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:55.028417 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-29ba20fc-5c47-4ee4-a5d1-271c0c090cf6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports/898d565d-b5bb-4c62-aadf-9b732f8b6cd9 HTTP/1.1" status: 200 len: 910 time: 0.1089621 Nov 24 04:10:55.029918 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:55.030721 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f39c3424-11a2-4889-8151-30957e49d201 None None] The sync data for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:55.032162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59244) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:55.033100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.033822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.040211 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] 10.222.0.48 "DELETE /v2.0/networks/6b68065f-c06f-472b-9b56-d9c6686f47da HTTP/1.1" status: 204 len: 168 time: 2.3561659 Nov 24 04:10:55.068201 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2251d8fa-c06e-45eb-9fcd-a208d3c72884 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401 tempest-ExtraDHCPOptionsIpV6TestJSON-58155401-project] Pushing event deleted for resources: {'Network': ['ID=6b68065f-c06f-472b-9b56-d9c6686f47da,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:55.071190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:55.075503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.191623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] device_id is not set on port 081cd257-0c9d-4dd5-b8f4-ba09199fa112 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:55.195642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:55.200747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.206398 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b242eeea-9e3c-4c18-a425-1d4f6b2692e0 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "PUT /v2.0/routers/5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.3596113 Nov 24 04:10:55.206567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] Sync routers for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:55.210689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59248) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:55.216714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Request body: {'port': {'network_id': '12205fb4-dac3-4af0-b4b6-24882f86dd40', 'name': 'tempest-FloatingIPAdminTestJSON-111341122'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:55.219586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:55.220495 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:55.271146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:55.282620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:55.283896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:55.298331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.322883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.325707 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:55.327981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f31b97b7-d211-43af-ae26-3e8ce501687e None None] The sync data for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:10:55.341091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.355392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.449210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59252) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:55.462103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=9b79b8ac-7d99-4d02-aba2-53c96a110e2b,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:55.479861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] In _notify_port_updated(), no bound segment for port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b on network 3779787c-a1ad-4c57-b149-36324ecb887c {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:10:55.487451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:55.488403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.493421 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e145acd3-d536-47ec-a8c8-56affbd2161e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "PUT /v2.0/ports/9b79b8ac-7d99-4d02-aba2-53c96a110e2b HTTP/1.1" status: 200 len: 993 time: 1.7720912 Nov 24 04:10:55.495134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Made reservation on behalf of 1610a0f31b814395a8b827274e159eaf for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:55.499626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.513190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59256) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:55.553910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] device_id is not set on port 8f427559-22cc-4889-9eed-69d7572e4552 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:55.667946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0a4921e7-06ba-4131-9729-0f5a23eb1be1 None None] Provisioning complete for port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:55.668320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0a4921e7-06ba-4131-9729-0f5a23eb1be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.705452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0a4921e7-06ba-4131-9729-0f5a23eb1be1 None None] Port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:55.761786 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d905c78-173e-42ff-91ca-4f91faaa5038,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:55.764636 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-faa9e23e-8cb8-42a4-b624-3ba17302ee6c admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=e898eec0924243e0bc8201e7ccaa12b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3117039 Nov 24 04:10:55.771203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59258) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:55.776551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.777749 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a1ec5127-c9b8-47f1-91ae-eca75041fc13 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9662232 Nov 24 04:10:55.781191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port 9b79b8ac-7d99-4d02-aba2-53c96a110e2b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:55.781534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.785462 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59260) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:55.789355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Allocated IP 172.20.0.7 (12205fb4-dac3-4af0-b4b6-24882f86dd40/7b52fb93-a07a-4b5c-a3a4-11308879ff75/8f427559-22cc-4889-9eed-69d7572e4552) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:55.793868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:55.805682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.901554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.4 (a47a2785-1e21-4a90-b046-5bf9f26ab1aa/2f7d8ed8-b820-4cb9-a339-78c29b4488cf/081cd257-0c9d-4dd5-b8f4-ba09199fa112) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:55.922708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.933678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6f2fef9-9083-40dd-b365-916b71e32c79 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:55.970560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.005096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6f2fef9-9083-40dd-b365-916b71e32c79 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.028718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.038161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for 9b79b8ac-7d99-4d02-aba2-53c96a110e2b owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:56.088573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=8a67f037-eaa1-480a-bb39-a99413aa923b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:56.096118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.099367 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c102697e-2647-47b1-bc41-51473c2a5ca7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/8a67f037-eaa1-480a-bb39-a99413aa923b HTTP/1.1" status: 204 len: 168 time: 1.2166560 Nov 24 04:10:56.100770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b616b80-6c27-40fa-beac-b707d1b33488 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:56.103974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59262) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:56.116155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.128689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.165694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.168320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6f2fef9-9083-40dd-b365-916b71e32c79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.170865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f6f2fef9-9083-40dd-b365-916b71e32c79 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.174358 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f6f2fef9-9083-40dd-b365-916b71e32c79 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/3dfb5b9f-0a0f-4c74-8aa4-0924a325ed4f HTTP/1.1" status: 204 len: 168 time: 0.4002419 Nov 24 04:10:56.176150 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b766cefe-dcde-4da0-8963-882f624f21bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0657973 Nov 24 04:10:56.183396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59266) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:56.195928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:56.206016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f2fef9-9083-40dd-b365-916b71e32c79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dfb5b9f-0a0f-4c74-8aa4-0924a325ed4f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:56.214417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9380f42b-5ab4-412e-8217-ee15d7080b7f,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:56.229606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.234202 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-292f6982-9a56-44da-bb49-3badedf6896a tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4410355 Nov 24 04:10:56.258414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59268) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:56.277220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:56.363878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:56.380473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.404960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.426656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.431939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:56.449795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:56.451830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.457771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:56.484687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] Deleting port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:56.485389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.495722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.562729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] For port 016db787-74e0-47c6-96ab-ac6cb27ee1a9, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=016db787-74e0-47c6-96ab-ac6cb27ee1a9,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:56.563466 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.566794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.582904 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] Calling delete_port for 016db787-74e0-47c6-96ab-ac6cb27ee1a9 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:56.632035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:56.646525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:56.650063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:56.653810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.657676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:56.658952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event updated for resources: {'Port': ['ID=8f427559-22cc-4889-9eed-69d7572e4552,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:56.693308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bffbad5b-ba47-49c9-b4e8-1b6b461256ef None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:10:56.745422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=081cd257-0c9d-4dd5-b8f4-ba09199fa112,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:56.764906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=9b79b8ac-7d99-4d02-aba2-53c96a110e2b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:56.798383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:56.799086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.869252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:56.871783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.917969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.923057 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-55467b9e-dc59-4044-94c2-f40c49bd1c83 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.2950490 Nov 24 04:10:56.929749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59278) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:56.943280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'port_id': '081cd257-0c9d-4dd5-b8f4-ba09199fa112'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:56.947597 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3891bd97-6dc0-4239-943b-9b2fc5c4628f tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7354212 Nov 24 04:10:56.948473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59280) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:56.964791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:56.989576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.013708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] No DVR routers for this DVR port 016db787-74e0-47c6-96ab-ac6cb27ee1a9 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:10:57.017320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.033141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec24ec3-5eef-462c-b383-c65f910fd1d1 None None] Pushing event deleted for resources: {'Port': ['ID=016db787-74e0-47c6-96ab-ac6cb27ee1a9,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:57.063656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6e603951-8cd7-4b1a-8aeb-0983ae88bf4b None None] Provisioning complete for port 081cd257-0c9d-4dd5-b8f4-ba09199fa112 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:57.064439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e603951-8cd7-4b1a-8aeb-0983ae88bf4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.067275 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c7a5f8b0-5832-4429-8e0f-9c0f5421d824,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:57.086755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.090916 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e454c8fd-0c6f-4461-b58d-c304b5ecac6d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.8292336 Nov 24 04:10:57.096143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59286) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:57.100695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.140554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.151022 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-950cda66-aed7-4bc8-b375-290af287e702 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/ports/9b79b8ac-7d99-4d02-aba2-53c96a110e2b HTTP/1.1" status: 204 len: 168 time: 1.6365747 Nov 24 04:10:57.156095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59288) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:57.182733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6e603951-8cd7-4b1a-8aeb-0983ae88bf4b None None] Port 081cd257-0c9d-4dd5-b8f4-ba09199fa112 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:57.193646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6e603951-8cd7-4b1a-8aeb-0983ae88bf4b None None] Provisioning complete for port 8f427559-22cc-4889-9eed-69d7572e4552 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:57.194082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e603951-8cd7-4b1a-8aeb-0983ae88bf4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.220752 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-4c1cde0f-e489-4f02-b035-57890072f270 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] GET failed (client error): The resource could not be found. Nov 24 04:10:57.222503 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4c1cde0f-e489-4f02-b035-57890072f270 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "GET /v2.0/ports/9b79b8ac-7d99-4d02-aba2-53c96a110e2b HTTP/1.1" status: 404 len: 333 time: 0.0634861 Nov 24 04:10:57.232930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59292) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:57.236895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6e603951-8cd7-4b1a-8aeb-0983ae88bf4b None None] Port 8f427559-22cc-4889-9eed-69d7572e4552 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:10:57.241955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'name': 'tempest-AllowedAddressPairTestJSON-1466767605'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.278418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.315737 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'project_id': '1610a0f31b814395a8b827274e159eaf', 'port_id': '8f427559-22cc-4889-9eed-69d7572e4552'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.326680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 898d565d-b5bb-4c62-aadf-9b732f8b6cd9 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:10:57.327022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.387314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.388441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.403900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.435217 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:10:57.449330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.464532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb278b8d-ab32-40ae-b1f8-311393aa9692,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:57.471967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.476599 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0c0a122-d37b-4ba0-a409-98154af02a0f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3760614 Nov 24 04:10:57.478178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59300) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:57.495696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.510619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:57.511739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59302) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:57.519401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:57.523130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:57.523916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.533834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3765b85b-c91b-4b96-85a2-88faf2ba739b None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:10:57.564937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=41066cd7-91c3-4db6-a76a-fa226cc6234f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:57.569327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.610318 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c7a3c31e-d9a4-49c0-b1c5-ceab3dc38cc0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.4209452 Nov 24 04:10:57.610318 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59306) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:57.615115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:d9:bd:64', 'name': 'tempest-NetworksTestDHCPv6-203672236'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.622796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.632658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 898d565d-b5bb-4c62-aadf-9b732f8b6cd9 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:10:57.655603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.721368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'networks': [{'name': 'tempest-network--642653930'}, {'name': 'tempest-network--1149575574'}]} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.721698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'network': {'name': 'tempest-network--642653930'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.722123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'network': {'name': 'tempest-network--1149575574'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:57.737909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '41066cd7-91c3-4db6-a76a-fa226cc6234f'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:10:57.738809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.757974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:57.761814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.816056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'network': 2} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:57.821394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.828055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] device_id is not set on port a0df3091-8f1a-4c5d-88c0-88e27365de5a yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:57.847185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.873482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Allocated IP 2001:db8::f816:3eff:fe12:bfd5 (a2b36c78-43a6-4954-8102-cb5638999bb1/41066cd7-91c3-4db6-a76a-fa226cc6234f/aa077ed5-4ad7-45fe-a76a-42e120a8af69) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:57.886026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Allocated IP 172.26.5.190 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/a8ea052b-f5d8-4e96-862c-8f4c939d5610) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:57.891408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:57.892051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:10:57.953841 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.004046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.resource_extend [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:10:58.010184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce688835-8025-4c0d-8b2f-717ae4f003d0,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.027829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.033063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.057417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.058643 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eac87d2c-ee31-42ad-a83d-d1f9de26d2af tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.5756128 Nov 24 04:10:58.063919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59308) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:58.068724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:58.073697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:58.079416 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:58.092968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Pushing event updated for resources: {'Port': ['ID=aa077ed5-4ad7-45fe-a76a-42e120a8af69,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.097695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.141023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.145288 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7223ee1-eeee-4e69-9f66-64c230892804 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.149032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Attempting to bind port aa077ed5-4ad7-45fe-a76a-42e120a8af69 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:10:58.149420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Attempting to bind port aa077ed5-4ad7-45fe-a76a-42e120a8af69 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:10:58.150336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Attempting to bind port aa077ed5-4ad7-45fe-a76a-42e120a8af69 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:10:58.151878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.156276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:10:58.157284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:10:58.157634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.158241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:10:58.158895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Bound port: aa077ed5-4ad7-45fe-a76a-42e120a8af69, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:10:58.159461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.172728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 070202f2-67a0-4a47-a21b-4347303667e4 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:10:58.178307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7223ee1-eeee-4e69-9f66-64c230892804 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.186984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.198033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.201046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Allocated IP 172.20.0.5 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/a0df3091-8f1a-4c5d-88c0-88e27365de5a) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:58.221405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.226320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] For port aa077ed5-4ad7-45fe-a76a-42e120a8af69, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:10:58.229570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] For port aa077ed5-4ad7-45fe-a76a-42e120a8af69, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=aa077ed5-4ad7-45fe-a76a-42e120a8af69,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:10:58.237760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.240031 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.240315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.295884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=898d565d-b5bb-4c62-aadf-9b732f8b6cd9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.322214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7223ee1-eeee-4e69-9f66-64c230892804 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.326511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d1d3c396-76cc-4164-a53d-bf15d02f8c9c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.342848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e7223ee1-eeee-4e69-9f66-64c230892804 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.342848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e7223ee1-eeee-4e69-9f66-64c230892804 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/ce688835-8025-4c0d-8b2f-717ae4f003d0 HTTP/1.1" status: 204 len: 168 time: 0.2678752 Nov 24 04:10:58.354529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9877b720-aeca-4fda-aead-f54ae8120268 None None] Pushing event updated for resources: {'Port': ['ID=aa077ed5-4ad7-45fe-a76a-42e120a8af69,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.360810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59310) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:58.378234 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:10:58.401561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 016db787-74e0-47c6-96ab-ac6cb27ee1a9 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:10:58.408856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] vlan segment allocate from pool success with {'vlan_id': 181, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:58.419209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7223ee1-eeee-4e69-9f66-64c230892804 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=ce688835-8025-4c0d-8b2f-717ae4f003d0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.434312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 016db787-74e0-47c6-96ab-ac6cb27ee1a9 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:10:58.434692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 016db787-74e0-47c6-96ab-ac6cb27ee1a9 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:10:58.453103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.453612 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Added segment d7668a74-a7c2-4a70-b595-ec113ce3bce7 of type vlan for network 8be49a59-a7dc-4091-806c-d82ee1fd1deb Nov 24 04:10:58.472671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.482451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fed9:bd64 (a2b36c78-43a6-4954-8102-cb5638999bb1/41066cd7-91c3-4db6-a76a-fa226cc6234f/070202f2-67a0-4a47-a21b-4347303667e4) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:10:58.588328 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-97bb3eae-651e-44f7-9d6e-1b2ac5e0d156 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.2227077 Nov 24 04:10:58.595598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59312) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:58.597383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.603114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:58.659155 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:58.661707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:58.720156 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Pushing event updated for resources: {'Port': ['ID=a8ea052b-f5d8-4e96-862c-8f4c939d5610,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:58.754405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40aa906f-aaa4-48cf-9cd3-23604524b212 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.761510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] vlan segment allocate from pool success with {'vlan_id': 156, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:10:58.776227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40aa906f-aaa4-48cf-9cd3-23604524b212 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.781495 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 8d69958e-0612-4637-9dd9-3b56bb20b84e associated. External IP: 172.26.5.171, port: 081cd257-0c9d-4dd5-b8f4-ba09199fa112. Nov 24 04:10:58.851714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.852304 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Added segment e557fdb1-89a9-42e7-a945-0a3c58e3f216 of type vlan for network 0d3723f3-0c3b-45fa-8ea8-a48b99d9b548 Nov 24 04:10:58.950097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40aa906f-aaa4-48cf-9cd3-23604524b212 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.954664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40aa906f-aaa4-48cf-9cd3-23604524b212 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:58.957312 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-40aa906f-aaa4-48cf-9cd3-23604524b212 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/bb278b8d-ab32-40ae-b1f8-311393aa9692 HTTP/1.1" status: 204 len: 168 time: 0.3529098 Nov 24 04:10:58.972369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59314) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:58.980895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.035316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.038959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.045266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40aa906f-aaa4-48cf-9cd3-23604524b212 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=bb278b8d-ab32-40ae-b1f8-311393aa9692,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:59.093445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.259946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.369766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:59.408415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:59.419458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:59.426261 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:59.430733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=a0df3091-8f1a-4c5d-88c0-88e27365de5a,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:59.494262 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d6610f71-3a9d-476e-9944-cf45a07cdd9b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.5152159 Nov 24 04:10:59.494262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.494262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.498304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:59.503172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:59.503817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.510637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59316) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:59.516755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router 7018d854-20ab-4a10-9fbe-cf1d554328fe has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:10:59.553685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:59.554355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.622198 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1319 time: 2.1068501 Nov 24 04:10:59.623317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Network': ['ID=8be49a59-a7dc-4091-806c-d82ee1fd1deb,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:59.625740 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59318) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:59.636420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 8be49a59-a7dc-4091-806c-d82ee1fd1deb details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:59.652770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.667316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0802cb46-7f35-4099-8629-0507c44ae488 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.727125 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3117dbf9-017d-4212-81cf-3890f1d167f5 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.4931133 Nov 24 04:10:59.744934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5383f7a4-5d1f-4844-b1b8-7b8ffa3cc1c7 None None] Provisioning complete for port aa077ed5-4ad7-45fe-a76a-42e120a8af69 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:10:59.745208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5383f7a4-5d1f-4844-b1b8-7b8ffa3cc1c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.747455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59320) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:59.752421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0802cb46-7f35-4099-8629-0507c44ae488 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.776631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:80:fc:72'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:10:59.813086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:10:59.813892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2337f85b-fdfd-492d-8a62-b7226e878235 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Network': ['ID=0d3723f3-0c3b-45fa-8ea8-a48b99d9b548,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:59.822457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:10:59.832240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:10:59.838490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:10:59.838955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 0d3723f3-0c3b-45fa-8ea8-a48b99d9b548 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:10:59.839120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.847273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=070202f2-67a0-4a47-a21b-4347303667e4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:10:59.857068 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5383f7a4-5d1f-4844-b1b8-7b8ffa3cc1c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.886570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:10:59.910826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.911340 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:10:59.934389 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:10:59.935046 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:10:59.942616 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-08b67027-7bb1-463f-8cb3-549a6c416f39 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.3289189 Nov 24 04:10:59.946018 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5383f7a4-5d1f-4844-b1b8-7b8ffa3cc1c7 None None] For port aa077ed5-4ad7-45fe-a76a-42e120a8af69, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=aa077ed5-4ad7-45fe-a76a-42e120a8af69,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:10:59.955571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5383f7a4-5d1f-4844-b1b8-7b8ffa3cc1c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:10:59.961781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59322) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:10:59.994009 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.016293 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:00.016924 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.025663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.053485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5383f7a4-5d1f-4844-b1b8-7b8ffa3cc1c7 None None] Pushing event updated for resources: {'Port': ['ID=aa077ed5-4ad7-45fe-a76a-42e120a8af69,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:00.085153 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.087048 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2ecc924-ab4f-4ea0-bcc8-e0c9778ce35f None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:00.088862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e2f663f4-fb40-45e4-bcff-acbf813b1f77 None None] Provisioning complete for port a0df3091-8f1a-4c5d-88c0-88e27365de5a triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:00.089427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e2f663f4-fb40-45e4-bcff-acbf813b1f77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.105621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0802cb46-7f35-4099-8629-0507c44ae488 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.108024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4e6d7b9-8d8d-4dd5-b018-af12223aede6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:00.112771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0802cb46-7f35-4099-8629-0507c44ae488 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.114547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4e6d7b9-8d8d-4dd5-b018-af12223aede6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:00.120803 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c4e6d7b9-8d8d-4dd5-b018-af12223aede6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1704 time: 0.1531689 Nov 24 04:11:00.120803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59324) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.121815 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0802cb46-7f35-4099-8629-0507c44ae488 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/c7a5f8b0-5832-4429-8e0f-9c0f5421d824 HTTP/1.1" status: 204 len: 168 time: 0.6070871 Nov 24 04:11:00.123065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:00.133903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59326) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.147056 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-320f947d-45cf-4762-a116-7f841be339c6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/7018d854-20ab-4a10-9fbe-cf1d554328fe/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1087449 Nov 24 04:11:00.154646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59328) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.156080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e2f663f4-fb40-45e4-bcff-acbf813b1f77 None None] Port a0df3091-8f1a-4c5d-88c0-88e27365de5a cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:00.162219 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5a99cb8c-5af2-44f9-b14f-00e995bdfe3a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/floatingips/8d69958e-0612-4637-9dd9-3b56bb20b84e HTTP/1.1" status: 200 len: 978 time: 3.2313881 Nov 24 04:11:00.164080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] Sync routers for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:00.168332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59330) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.176982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:00.177744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.181470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0802cb46-7f35-4099-8629-0507c44ae488 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c7a5f8b0-5832-4429-8e0f-9c0f5421d824,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:00.183449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.216942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.228415 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:00.229050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.258606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae6100c7-8c2f-41c8-be20-8212beb675da tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:00.265072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae6100c7-8c2f-41c8-be20-8212beb675da tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:00.271319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae6100c7-8c2f-41c8-be20-8212beb675da tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:00.275270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:00.275920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245e3a88-2f2e-485b-ae17-9e9b6adb8c28 None None] The sync data for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:00.277886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae6100c7-8c2f-41c8-be20-8212beb675da tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:00.279374 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ae6100c7-8c2f-41c8-be20-8212beb675da tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2406 time: 0.6522393 Nov 24 04:11:00.287674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59332) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.300621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6fe31f0a-8312-4406-9593-5cc20d280257 None None] Provisioning complete for port 070202f2-67a0-4a47-a21b-4347303667e4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:00.301204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6fe31f0a-8312-4406-9593-5cc20d280257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.314715 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5c4b6a2f-c774-4ad8-a74b-c3bc4392a4a7 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.1806695 Nov 24 04:11:00.322533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59334) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.345014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6fe31f0a-8312-4406-9593-5cc20d280257 None None] Port 070202f2-67a0-4a47-a21b-4347303667e4 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:00.385445 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device aa077ed5-4ad7-45fe-a76a-42e120a8af69 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:00.387179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.420883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-295937ab-3aff-4ae4-896a-28141493654b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.435394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-295937ab-3aff-4ae4-896a-28141493654b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.438981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port aa077ed5-4ad7-45fe-a76a-42e120a8af69 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:00.439709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.484070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 070202f2-67a0-4a47-a21b-4347303667e4 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:00.484420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.543767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-295937ab-3aff-4ae4-896a-28141493654b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.548413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-295937ab-3aff-4ae4-896a-28141493654b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.549587 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-295937ab-3aff-4ae4-896a-28141493654b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/9380f42b-5ab4-412e-8217-ee15d7080b7f HTTP/1.1" status: 204 len: 168 time: 0.2203751 Nov 24 04:11:00.563642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59336) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.610921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 081cd257-0c9d-4dd5-b8f4-ba09199fa112 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:00.611300 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.651213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295937ab-3aff-4ae4-896a-28141493654b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9380f42b-5ab4-412e-8217-ee15d7080b7f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:00.765649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.797107 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.805665 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-620a587a-43d1-4053-9d5d-7230145c2088 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.2110434 Nov 24 04:11:00.809919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59338) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:00.812412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 070202f2-67a0-4a47-a21b-4347303667e4 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:00.890631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.913677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.940821 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0ab09865-9518-48fd-8b3e-ab8f4a60b651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.986560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:00.996439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0ab09865-9518-48fd-8b3e-ab8f4a60b651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.037001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.086087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8be49a59-a7dc-4091-806c-d82ee1fd1deb']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:01.112519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7668a74-a7c2-4a70-b595-ec113ce3bce7') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:01.112888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7668a74-a7c2-4a70-b595-ec113ce3bce7') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:01.116347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.127825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.136875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.174018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.176239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Pushing event updated for resources: {'Port': ['ID=a8ea052b-f5d8-4e96-862c-8f4c939d5610,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:01.188984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Releasing vlan 181 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:01.189569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:01.196063 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:01.209579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0ab09865-9518-48fd-8b3e-ab8f4a60b651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.215154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0ab09865-9518-48fd-8b3e-ab8f4a60b651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.218695 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0ab09865-9518-48fd-8b3e-ab8f4a60b651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/1d905c78-173e-42ff-91ca-4f91faaa5038 HTTP/1.1" status: 204 len: 168 time: 0.4019985 Nov 24 04:11:01.223169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59340) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:01.244970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ab09865-9518-48fd-8b3e-ab8f4a60b651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1d905c78-173e-42ff-91ca-4f91faaa5038,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:01.253419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.366968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=a0df3091-8f1a-4c5d-88c0-88e27365de5a,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:01.387258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.388844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] In _notify_port_updated(), no bound segment for port a0df3091-8f1a-4c5d-88c0-88e27365de5a on network 3779787c-a1ad-4c57-b149-36324ecb887c {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:11:01.397346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:01.397798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.402397 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-198b2b62-de56-490f-930b-bb0c4d4ac2a6 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "PUT /v2.0/ports/a0df3091-8f1a-4c5d-88c0-88e27365de5a HTTP/1.1" status: 200 len: 996 time: 1.6315825 Nov 24 04:11:01.425937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.427051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59342) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:01.429164 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/networks/8be49a59-a7dc-4091-806c-d82ee1fd1deb HTTP/1.1" status: 204 len: 168 time: 1.1389682 Nov 24 04:11:01.434962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ecd2e4-05d7-4ecf-a45f-def10e3b50d8 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Network': ['ID=8be49a59-a7dc-4091-806c-d82ee1fd1deb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:01.439483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59344) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:01.465981 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.479244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ac737488-560c-44eb-9c9d-1fe9705ef960 None None] Provisioning complete for port a0df3091-8f1a-4c5d-88c0-88e27365de5a triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:01.480334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ac737488-560c-44eb-9c9d-1fe9705ef960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.498573 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f08f703b-c30e-421a-9ff8-826ca5331d61 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2689190 Nov 24 04:11:01.512285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59346) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:01.517480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ac737488-560c-44eb-9c9d-1fe9705ef960 None None] Port a0df3091-8f1a-4c5d-88c0-88e27365de5a cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:01.519382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.519760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.520111 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 8d69958e-0612-4637-9dd9-3b56bb20b84e disassociated. External IP: 172.26.5.171, port: 081cd257-0c9d-4dd5-b8f4-ba09199fa112. Nov 24 04:11:01.520458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 081cd257-0c9d-4dd5-b8f4-ba09199fa112 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:01.529127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=070202f2-67a0-4a47-a21b-4347303667e4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:01.573455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.578960 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a5d5ec57-e66d-43d0-a750-916728e8860e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/070202f2-67a0-4a47-a21b-4347303667e4 HTTP/1.1" status: 204 len: 168 time: 1.4555874 Nov 24 04:11:01.598797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59348) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:01.660621 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Floating IP 242711dc-9b2a-4e6d-b6a2-e24465324498 associated. External IP: 172.26.5.190, port: 8f427559-22cc-4889-9eed-69d7572e4552. Nov 24 04:11:01.674806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.707015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8ececc3-5157-441d-9295-845e6ac5e508 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.739548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.753289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05ef8014-7c49-4cba-ad09-84f58c9ca720 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:01.754980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05ef8014-7c49-4cba-ad09-84f58c9ca720 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:01.756555 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-05ef8014-7c49-4cba-ad09-84f58c9ca720 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1507096 Nov 24 04:11:01.762273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59350) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:01.789228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8ececc3-5157-441d-9295-845e6ac5e508 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.826789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port a0df3091-8f1a-4c5d-88c0-88e27365de5a {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:01.827049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.875091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 41066cd7-91c3-4db6-a76a-fa226cc6234f {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:01.887491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:01.983418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.012577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8ececc3-5157-441d-9295-845e6ac5e508 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.015185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8ececc3-5157-441d-9295-845e6ac5e508 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.018747 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a8ececc3-5157-441d-9295-845e6ac5e508 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820 HTTP/1.1" status: 204 len: 168 time: 0.4889555 Nov 24 04:11:02.022971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59352) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:02.043155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d3723f3-0c3b-45fa-8ea8-a48b99d9b548']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:02.057526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8ececc3-5157-441d-9295-845e6ac5e508 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=21bbb834-ee6d-4ad2-b8b7-2d55ad9fd820,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:02.064795 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e557fdb1-89a9-42e7-a945-0a3c58e3f216') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:02.065097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e557fdb1-89a9-42e7-a945-0a3c58e3f216') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:02.079613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.080057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.122370 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.135047 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8db0c439-2c88-47db-b639-301b7a1d39ad tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1048076 Nov 24 04:11:02.140598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Releasing vlan 156 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:02.140598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:02.140896 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:02.142841 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59354) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:02.156935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--1283342507'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:02.248267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.254575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.259980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.263254 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/networks/0d3723f3-0c3b-45fa-8ea8-a48b99d9b548 HTTP/1.1" status: 204 len: 168 time: 0.8202639 Nov 24 04:11:02.268542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59356) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:02.320362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ebabbb0-f64f-49f1-bdb2-896f9cede794 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Network': ['ID=0d3723f3-0c3b-45fa-8ea8-a48b99d9b548,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:02.449038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 6299b5ec-3528-4135-bd7a-fec8d0b93cde {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:02.449287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.464474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.464703 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61d486ab-7956-4448-9dca-7fd0f791e4b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:02.470579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61d486ab-7956-4448-9dca-7fd0f791e4b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:02.475620 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-61d486ab-7956-4448-9dca-7fd0f791e4b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.1966038 Nov 24 04:11:02.477427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.479577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59358) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:02.494039 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-2078570164'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:02.507872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for a0df3091-8f1a-4c5d-88c0-88e27365de5a owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:02.547210 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.554832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.570814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=081cd257-0c9d-4dd5-b8f4-ba09199fa112,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:02.591284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Router 5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:02.591497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03806131-5101-4d85-8ffc-081898c5c8cf None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:02.607510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c6623d25-5733-4576-8664-3dd7c8756c4a,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:02.612638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.617361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.621461 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3bbb3041-cee5-426b-8f92-2307104d7ca2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4781122 Nov 24 04:11:02.626885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59360) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:02.631064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': 'c6623d25-5733-4576-8664-3dd7c8756c4a', 'direction': 'ingress', 'protocol': 17}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:02.638347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:02.641791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.644035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 6299b5ec-3528-4135-bd7a-fec8d0b93cde owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:02.691512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.703060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.816743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.822656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.849270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] vlan segment allocate from pool success with {'vlan_id': 156, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:02.872330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a7104276-c40b-49b5-b872-024100eb91bc,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:02.879948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.882602 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2c5eb1a3-3cd3-473a-9ec5-72968b4665a5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.2548635 Nov 24 04:11:02.886475 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59362) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:02.911444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.911802 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Added segment 77b3f3bd-42b2-41b2-8914-c110987d2fed of type vlan for network 6e7065f4-741d-46d1-94e1-3ba8665a6b7b Nov 24 04:11:02.926372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:02.964899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=6299b5ec-3528-4135-bd7a-fec8d0b93cde,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:02.994664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:03.003051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.003862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53e8ff0d-1678-4118-a3c3-da32c4eda65b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.016421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.057454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53e8ff0d-1678-4118-a3c3-da32c4eda65b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.063960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=41066cd7-91c3-4db6-a76a-fa226cc6234f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:03.073632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:03.081435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.089620 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-15cb647e-e614-4a56-8b28-b8d63fdc7154 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/41066cd7-91c3-4db6-a76a-fa226cc6234f HTTP/1.1" status: 204 len: 168 time: 1.3198407 Nov 24 04:11:03.092852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77302d34-f632-417b-b120-75cc53ac284a None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:03.094087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59364) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.098618 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.105903 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] Sync routers for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:03.119043 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:03.120304 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.160887 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.172671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.192755 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:03.193691 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.213471 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-314904ea-1b0d-4c87-8609-9028e311c87d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1133938 Nov 24 04:11:03.237739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59366) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.251225 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.251950 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ec2ba25-f06c-4130-820e-c203aabd2bbd None None] The sync data for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:03.277602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.281059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53e8ff0d-1678-4118-a3c3-da32c4eda65b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.283697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53e8ff0d-1678-4118-a3c3-da32c4eda65b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.284225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:03.284849 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-53e8ff0d-1678-4118-a3c3-da32c4eda65b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/c6623d25-5733-4576-8664-3dd7c8756c4a HTTP/1.1" status: 204 len: 168 time: 0.3973050 Nov 24 04:11:03.285163 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.294111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.303311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=a0df3091-8f1a-4c5d-88c0-88e27365de5a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:03.303582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59368) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.333534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e8ff0d-1678-4118-a3c3-da32c4eda65b tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6623d25-5733-4576-8664-3dd7c8756c4a,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:03.414365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:03.450311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de8ff985-55cb-43df-a2b5-f28a749e218c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:03.451871 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-de8ff985-55cb-43df-a2b5-f28a749e218c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2146873 Nov 24 04:11:03.458608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59370) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.460001 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.9731407 Nov 24 04:11:03.483398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] Deleting port aa077ed5-4ad7-45fe-a76a-42e120a8af69 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:03.483607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.495901 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2b1403c5-2e99-4f10-9174-0eccd4ce9972 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 987 time: 6.5420725 Nov 24 04:11:03.501871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59372) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.502383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59374) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.517186 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1903230092'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:03.520168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-422fecfd-a114-4e59-89f0-4755c766c755 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:03.523979 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-422fecfd-a114-4e59-89f0-4755c766c755 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0595610 Nov 24 04:11:03.530031 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-347a6863-48c1-430e-b3d9-744d6e793d82 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2211952 Nov 24 04:11:03.530031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59378) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.533508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ef92c5-648e-4925-abb3-faa22a822c2f tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Network': ['ID=6e7065f4-741d-46d1-94e1-3ba8665a6b7b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:03.537690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59380) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.543114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--1543156909'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:03.564248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 6e7065f4-741d-46d1-94e1-3ba8665a6b7b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:03.588231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] For port aa077ed5-4ad7-45fe-a76a-42e120a8af69, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=aa077ed5-4ad7-45fe-a76a-42e120a8af69,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:03.588627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.589933 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router 7018d854-20ab-4a10-9fbe-cf1d554328fe has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:03.596562 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7285bd4f-1d4e-4308-a02f-a7569780f7ba tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0616417 Nov 24 04:11:03.601285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59382) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.608880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:03.611535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] Calling delete_port for aa077ed5-4ad7-45fe-a76a-42e120a8af69 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:03.614195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.656947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.662845 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a1cb5704-35dd-48dd-a9a6-7e1891ddc56b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/ports/a0df3091-8f1a-4c5d-88c0-88e27365de5a HTTP/1.1" status: 204 len: 168 time: 2.2324827 Nov 24 04:11:03.669623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59384) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.693145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:03.706066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:03.713785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:03.717534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.729297 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-a32cab25-ec7f-42e7-94f8-c646f6a96b58 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] GET failed (client error): The resource could not be found. Nov 24 04:11:03.734341 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:03.734617 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a32cab25-ec7f-42e7-94f8-c646f6a96b58 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "GET /v2.0/ports/a0df3091-8f1a-4c5d-88c0-88e27365de5a HTTP/1.1" status: 404 len: 333 time: 0.0551417 Nov 24 04:11:03.734712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.736785 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1a661cb8-44f0-4221-ac52-deff9e878920 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] 10.222.0.48 "GET /v2.0/floatingips/242711dc-9b2a-4e6d-b6a2-e24465324498 HTTP/1.1" status: 200 len: 982 time: 0.2300084 Nov 24 04:11:03.738665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59386) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.738665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59388) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.767010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'name': 'tempest-AllowedAddressPairTestJSON-1546579413'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:03.773048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:03.779967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.787629 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7f565287-bfef-4e8c-abe1-fdd03b50f538 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/7018d854-20ab-4a10-9fbe-cf1d554328fe/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6240194 Nov 24 04:11:03.791757 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] Sync routers for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:03.793982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:03.795187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.804191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59390) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.816077 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:03.817010 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.832249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.833258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-882ce777-3a3a-4b17-9114-ea92c63f886d None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:03.835005 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0820c326-8f07-447b-b05b-820905ae1018 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=7018d854-20ab-4a10-9fbe-cf1d554328fe HTTP/1.1" status: 200 len: 205 time: 0.0279987 Nov 24 04:11:03.839161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59392) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:03.845604 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:03.879051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] No DVR routers for this DVR port aa077ed5-4ad7-45fe-a76a-42e120a8af69 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:03.882996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4c862c-998f-4175-9f9f-8dc1a269ff5d None None] Pushing event deleted for resources: {'Port': ['ID=aa077ed5-4ad7-45fe-a76a-42e120a8af69,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:03.894138 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.915015 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] Routers {'7018d854-20ab-4a10-9fbe-cf1d554328fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:03.918207 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:10:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['7018d854-20ab-4a10-9fbe-cf1d554328fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.959285 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:03.960224 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bae3fe1a-1e1c-4072-aa50-0c00d4f6d454 None None] The sync data for ids ['7018d854-20ab-4a10-9fbe-cf1d554328fe'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:03.981926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:03.998882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.002342 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-73142578-0fc9-4b43-b35f-0c1dc909b3a8 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/ports/081cd257-0c9d-4dd5-b8f4-ba09199fa112 HTTP/1.1" status: 204 len: 168 time: 3.8304079 Nov 24 04:11:04.005526 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-45427038-bcc8-4781-81d1-8753f471c9bf tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] 10.222.0.48 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 2730 time: 0.2461538 Nov 24 04:11:04.010203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59394) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:04.010774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59396) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:04.018779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.019130 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Added segment 0bee7ee3-44c8-4ecd-bfa3-1b5f5b639a18 of type vlan for network 4a08c23f-f6fd-42df-8ed7-4456f4d6ca68 Nov 24 04:11:04.233530 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:04.236931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.273432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.288477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.307534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device aa077ed5-4ad7-45fe-a76a-42e120a8af69 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:04.332230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: aa077ed5-4ad7-45fe-a76a-42e120a8af69 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:04.332524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device aa077ed5-4ad7-45fe-a76a-42e120a8af69 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:04.350088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.365884 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-28712ba2-742a-49a5-9772-478f17e4648d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/floatingips/8d69958e-0612-4637-9dd9-3b56bb20b84e HTTP/1.1" status: 200 len: 688 time: 0.3537407 Nov 24 04:11:04.373580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59398) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:04.392630 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.426245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.427494 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.8881299 Nov 24 04:11:04.452848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59400) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:04.462884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--1251969807'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:04.490032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.495861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:04.496441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.498501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:04.501610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.559604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32348b20-8d0b-4d05-93ab-2bfb41acf033 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6b11d372-5d19-43f6-9990-1b60ac29b7f2,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:04.575125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.579014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.587312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.618050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] device_id is not set on port 7a692167-cfc9-4906-8a01-4c5d3a8a236f yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:04.632298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Network': ['ID=4a08c23f-f6fd-42df-8ed7-4456f4d6ca68,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:04.640244 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8d9e1075-cae4-4f58-ad3c-16392c234d33 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.1321547 Nov 24 04:11:04.644305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59402) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:04.647452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 4a08c23f-f6fd-42df-8ed7-4456f4d6ca68 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:04.650603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'ports': [{'network_id': '6e7065f4-741d-46d1-94e1-3ba8665a6b7b', 'name': 'tempest-port--1553259276', 'admin_state_up': True}, {'network_id': '4a08c23f-f6fd-42df-8ed7-4456f4d6ca68', 'admin_state_up': False}]} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:04.650918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'port': {'network_id': '6e7065f4-741d-46d1-94e1-3ba8665a6b7b', 'name': 'tempest-port--1553259276', 'admin_state_up': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:04.651401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'port': {'network_id': '4a08c23f-f6fd-42df-8ed7-4456f4d6ca68', 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:04.688157 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.688900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router 7018d854-20ab-4a10-9fbe-cf1d554328fe {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:11:04.702576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.703868 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c8f804eb-577a-4f7e-856a-ffa9de46edb7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/7018d854-20ab-4a10-9fbe-cf1d554328fe HTTP/1.1" status: 204 len: 168 time: 0.8627927 Nov 24 04:11:04.714452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59404) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:04.761119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port bd98b4f8-d0c4-4c10-ae37-d170ca6d20f0 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:04.761455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.896481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet 79a08516-6cbb-4969-91b9-a4463e92bf0a {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:04.907510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting port a8ea052b-f5d8-4e96-862c-8f4c939d5610 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:04.907848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.907999 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.908193 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.929664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.937723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for bd98b4f8-d0c4-4c10-ae37-d170ca6d20f0 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:04.948348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82bd49eb-e2fc-402f-bd7c-f4b1272ce72c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:04.961403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:11:04.965598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.023188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Allocated IP 172.20.0.6 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/7a692167-cfc9-4906-8a01-4c5d3a8a236f) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:05.052071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:05.061354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:05.068854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:05.069438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.070639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.075467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cdf7f67-451f-448c-9e62-447a81dd1479 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:05.088166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=01827815-09a0-4019-9607-6c2d6fa1680e,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.093273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.097969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.100775 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-669765e7-f1f9-4685-bb49-8e2b209871a7 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.4983680 Nov 24 04:11:05.103328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59406) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.110962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:a7:9b:21', 'name': 'tempest-NetworksTestDHCPv6-94558830'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:05.211437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cb4f7afa-4290-4b88-b27a-a8f7c124ed6b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.216516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.216839 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.252623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.256266 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-01ab005a-c757-44f5-a5e2-4fcfcc5f3651 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7971509 Nov 24 04:11:05.256266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'port': 2} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:05.259090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59408) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.259567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.264982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '6b11d372-5d19-43f6-9990-1b60ac29b7f2', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': 'cb4f7afa-4290-4b88-b27a-a8f7c124ed6b', 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:05.267477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '01827815-09a0-4019-9607-6c2d6fa1680e'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:05.268550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.281974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.307870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Calling delete_port for a8ea052b-f5d8-4e96-862c-8f4c939d5610 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:05.317575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=bd98b4f8-d0c4-4c10-ae37-d170ca6d20f0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.336537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.381059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.397406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:05.412830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Allocated IP 2001:db8::f816:3eff:feed:d8c3 (a2b36c78-43a6-4954-8102-cb5638999bb1/01827815-09a0-4019-9607-6c2d6fa1680e/940bc077-331e-4a49-a119-74bec15c7a4d) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:05.420735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.454052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.458595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.463538 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d2a33d69-b417-444d-91b0-53dec3d9c74c tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/floatingips/8d69958e-0612-4637-9dd9-3b56bb20b84e HTTP/1.1" status: 204 len: 168 time: 1.0582500 Nov 24 04:11:05.479435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59410) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.501108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:05.553207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.556036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.559241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.583384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.589802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d385cd4e-7b23-436e-a4b1-451f83245a50,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.590960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.595780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port bce97896-4b07-4386-9b72-55fb8a8643c6 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:05.619394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.642040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:05.643890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Pushing event updated for resources: {'Port': ['ID=940bc077-331e-4a49-a119-74bec15c7a4d,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.646706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:05.646914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] device_id is not set on port 4c91bbf4-ab40-47b4-b96d-b1b890d5eb59 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:05.653572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:05.656323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.657991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.659853 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c2cda7d0-5baf-45d3-a46c-957e67ba2844 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.3998001 Nov 24 04:11:05.663164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59412) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.700457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.714934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Attempting to bind port 940bc077-331e-4a49-a119-74bec15c7a4d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:05.715669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Attempting to bind port 940bc077-331e-4a49-a119-74bec15c7a4d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:05.716138 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Attempting to bind port 940bc077-331e-4a49-a119-74bec15c7a4d on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:05.719277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e50f985-195d-4408-b342-7941083b744f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.721458 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 10, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:05.721946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:05.722483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.722972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:05.723668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Bound port: 940bc077-331e-4a49-a119-74bec15c7a4d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:05.724160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.733228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e50f985-195d-4408-b342-7941083b744f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.762125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=79a08516-6cbb-4969-91b9-a4463e92bf0a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.772478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fea7:9b21 (a2b36c78-43a6-4954-8102-cb5638999bb1/01827815-09a0-4019-9607-6c2d6fa1680e/bce97896-4b07-4386-9b72-55fb8a8643c6) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:05.779026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.784957 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b8758e77-e1d8-4ade-b51d-d4009f0f14b5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/79a08516-6cbb-4969-91b9-a4463e92bf0a HTTP/1.1" status: 204 len: 168 time: 1.0633433 Nov 24 04:11:05.790289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59414) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.791060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2495d201-63c9-4ef3-991d-a2b4bbd997ce None None] Network f6a28ac9-8f2a-460e-8287-e5737a0a01fa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:05.830865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e50f985-195d-4408-b342-7941083b744f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.832558 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] For port 940bc077-331e-4a49-a119-74bec15c7a4d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:05.846568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e50f985-195d-4408-b342-7941083b744f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.850889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9e50f985-195d-4408-b342-7941083b744f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/d385cd4e-7b23-436e-a4b1-451f83245a50 HTTP/1.1" status: 204 len: 168 time: 0.1834316 Nov 24 04:11:05.853747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59416) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.855154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.875197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e50f985-195d-4408-b342-7941083b744f tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d385cd4e-7b23-436e-a4b1-451f83245a50,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.878824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] For port 940bc077-331e-4a49-a119-74bec15c7a4d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=940bc077-331e-4a49-a119-74bec15c7a4d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:05.907745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.920338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet dfcb001c-d1d5-4a10-90d3-89338c1ce680 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:05.932280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:05.965906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f019fd-6b8f-47ab-81d6-29f8da8fc4d0 None None] Pushing event updated for resources: {'Port': ['ID=940bc077-331e-4a49-a119-74bec15c7a4d,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:05.987053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:05.991450 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-78a57153-c82b-4794-b0a4-fe95c614be79 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.1318431 Nov 24 04:11:05.992175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59418) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:05.997229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:06.006432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=7a692167-cfc9-4906-8a01-4c5d3a8a236f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:06.010432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:06.015844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.019089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.086256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Port': ['ID=a8ea052b-f5d8-4e96-862c-8f4c939d5610,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:06.116018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.140614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] DHCP port deletion for f6a28ac9-8f2a-460e-8287-e5737a0a01fa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:06.232832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] Deleting port f849363c-9a70-47bf-9452-acdb0dd2e4fa {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:06.233454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.246422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f7f2cfa-b90e-4aa8-9e1e-b61c767f3cd2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.282178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.345843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.348735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] For port f849363c-9a70-47bf-9452-acdb0dd2e4fa, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f849363c-9a70-47bf-9452-acdb0dd2e4fa,segment=NetworkSegment(8d841b8d-0511-4bc6-a050-40a630a7a969),segment_id=8d841b8d-0511-4bc6-a050-40a630a7a969)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:06.349285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.370377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f7f2cfa-b90e-4aa8-9e1e-b61c767f3cd2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.412965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f849363c-9a70-47bf-9452-acdb0dd2e4fa no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:06.440566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] Calling delete_port for f849363c-9a70-47bf-9452-acdb0dd2e4fa owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:06.482055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.488815 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:06.489406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.521194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f7f2cfa-b90e-4aa8-9e1e-b61c767f3cd2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.524170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f7f2cfa-b90e-4aa8-9e1e-b61c767f3cd2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.525565 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0f7f2cfa-b90e-4aa8-9e1e-b61c767f3cd2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/cb4f7afa-4290-4b88-b27a-a8f7c124ed6b HTTP/1.1" status: 204 len: 168 time: 0.5327337 Nov 24 04:11:06.538184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59420) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:06.562496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.590951 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-89413f44-ad6c-4de0-8edf-0a43b6b7eb9f tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.8325710 Nov 24 04:11:06.592389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7f2cfa-b90e-4aa8-9e1e-b61c767f3cd2 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb4f7afa-4290-4b88-b27a-a8f7c124ed6b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:06.596129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:06.598339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59422) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:06.616464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] device_id is not set on port 350db653-755d-499d-b1ce-5863698ca20f yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:06.632868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=dfcb001c-d1d5-4a10-90d3-89338c1ce680,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:06.633568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.643036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.643166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'network_id': '3779787c-a1ad-4c57-b149-36324ecb887c', 'name': 'tempest-AllowedAddressPairTestJSON-1734108540'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:06.643565 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Floating IP 242711dc-9b2a-4e6d-b6a2-e24465324498 disassociated (deleted). External IP: 172.26.5.190, port: 8f427559-22cc-4889-9eed-69d7572e4552. Nov 24 04:11:06.659547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.664142 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ad288085-f826-45a0-9ef8-16add0e403fd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/dfcb001c-d1d5-4a10-90d3-89338c1ce680 HTTP/1.1" status: 204 len: 168 time: 0.8723211 Nov 24 04:11:06.675640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:06.678714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=bce97896-4b07-4386-9b72-55fb8a8643c6,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:06.694848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:06.700060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59424) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:06.700659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:06.701335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.752040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2edc6b8-31bd-43bd-89b8-f0c05b637f1d None None] Network da5b46da-0cce-4707-ae4e-c2246ebc0995 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:06.758090 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-06b905b4-c3b9-4b33-a8a1-668c8a56edc6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 1.6518922 Nov 24 04:11:06.766516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59426) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:06.778629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bd8eb1a1-9cde-43b8-8636-a96e259f1b0b None None] Provisioning complete for port 7a692167-cfc9-4906-8a01-4c5d3a8a236f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:06.779307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd8eb1a1-9cde-43b8-8636-a96e259f1b0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.907663 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-17d9395e-e9db-4fad-849d-d37313212f64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.3632064 Nov 24 04:11:06.914850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59428) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:06.941016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bd8eb1a1-9cde-43b8-8636-a96e259f1b0b None None] Port 7a692167-cfc9-4906-8a01-4c5d3a8a236f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:06.942037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.953254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.980933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:06.987947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ef637d5-eeab-4949-bfb3-ba2b43a239b9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:06.995871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ef637d5-eeab-4949-bfb3-ba2b43a239b9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:06.997535 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0ef637d5-eeab-4949-bfb3-ba2b43a239b9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1701 time: 0.2049994 Nov 24 04:11:07.004416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59430) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:07.020676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] Pushing event deleted for resources: {'Port': ['ID=f849363c-9a70-47bf-9452-acdb0dd2e4fa,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.023054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11c0c4d1-0635-4104-95ca-1480b5673cfb None None] No DVR routers for this DVR port f849363c-9a70-47bf-9452-acdb0dd2e4fa on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:07.040789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.168 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/427ef0ea-12b5-4eae-b6b9-313cf75262e1) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:07.044236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-410e81c3-ac14-47fb-b0e0-0d0dccdb0392 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.075692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-410e81c3-ac14-47fb-b0e0-0d0dccdb0392 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.168543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.183849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] DHCP port deletion for da5b46da-0cce-4707-ae4e-c2246ebc0995 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:07.200431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Made reservation on behalf of 7e2a6f6d5f1e47fe8be50180d1a55cf4 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:07.204372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.237580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] device_id is not set on port 6d38e76a-d362-4b95-922d-444cb8bf9f85 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:07.244587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-410e81c3-ac14-47fb-b0e0-0d0dccdb0392 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.246918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-410e81c3-ac14-47fb-b0e0-0d0dccdb0392 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.250522 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-410e81c3-ac14-47fb-b0e0-0d0dccdb0392 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/6b11d372-5d19-43f6-9990-1b60ac29b7f2 HTTP/1.1" status: 204 len: 168 time: 0.3353884 Nov 24 04:11:07.254170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59432) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:07.260733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] Deleting port a7d39ba0-651c-4385-836c-7e01c2f3724c {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:07.261419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.309967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.326080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410e81c3-ac14-47fb-b0e0-0d0dccdb0392 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b11d372-5d19-43f6-9990-1b60ac29b7f2,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.334095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port bce97896-4b07-4386-9b72-55fb8a8643c6 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:07.334468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.347781 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] For port a7d39ba0-651c-4385-836c-7e01c2f3724c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a7d39ba0-651c-4385-836c-7e01c2f3724c,segment=NetworkSegment(5e8be725-013e-4c27-a049-fca6589e6a5e),segment_id=5e8be725-013e-4c27-a049-fca6589e6a5e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:07.348189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.360401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.370651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] Calling delete_port for a7d39ba0-651c-4385-836c-7e01c2f3724c owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:07.449073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f6a28ac9-8f2a-460e-8287-e5737a0a01fa']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:07.451704 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-79601096-1b4d-4761-a1b4-b993609fb57d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1956170 Nov 24 04:11:07.455837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59434) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:07.473623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--122353265'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:07.488633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d841b8d-0511-4bc6-a050-40a630a7a969') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:07.488975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d841b8d-0511-4bc6-a050-40a630a7a969') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:07.503648 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.510436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Allocated IP 172.20.0.9 (3779787c-a1ad-4c57-b149-36324ecb887c/becde755-a9f2-4b15-8f7d-32a2169b347a/6d38e76a-d362-4b95-922d-444cb8bf9f85) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:07.517587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.526843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.533167 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] No DVR routers for this DVR port a7d39ba0-651c-4385-836c-7e01c2f3724c on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:07.534120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.537685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0f9923-121f-4fbd-932d-ec500eeb826f None None] Pushing event deleted for resources: {'Port': ['ID=a7d39ba0-651c-4385-836c-7e01c2f3724c,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.551476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for bce97896-4b07-4386-9b72-55fb8a8643c6 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:07.601307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.607908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.611588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Router 5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:07.631834 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.636062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 182 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:07.636062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:07.649117 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:07.688748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ef8e9eda-77cd-46d8-bd8b-c556cfe70897 None None] Provisioning complete for port 940bc077-331e-4a49-a119-74bec15c7a4d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:07.689299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ef8e9eda-77cd-46d8-bd8b-c556cfe70897 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.727453 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Port': ['ID=4c91bbf4-ab40-47b4-b96d-b1b890d5eb59,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.749854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:07.770593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:07.792945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.815564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:07.819800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.843758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ef8e9eda-77cd-46d8-bd8b-c556cfe70897 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.862260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=bce97896-4b07-4386-9b72-55fb8a8643c6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.872053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.883385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ef8e9eda-77cd-46d8-bd8b-c556cfe70897 None None] For port 940bc077-331e-4a49-a119-74bec15c7a4d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=940bc077-331e-4a49-a119-74bec15c7a4d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:07.888976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ef8e9eda-77cd-46d8-bd8b-c556cfe70897 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.900971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.913394 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-70584b89-7365-44a1-98af-9fdf2b24a9dd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/bce97896-4b07-4386-9b72-55fb8a8643c6 HTTP/1.1" status: 204 len: 168 time: 0.9059403 Nov 24 04:11:07.915932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.926988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59436) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:07.933176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Checking segment: {'id': '77b3f3bd-42b2-41b2-8914-c110987d2fed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '6e7065f4-741d-46d1-94e1-3ba8665a6b7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:07.933176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network hostable DHCP agents. Network: 6e7065f4-741d-46d1-94e1-3ba8665a6b7b, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:07.936324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:07.943880 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/f6a28ac9-8f2a-460e-8287-e5737a0a01fa HTTP/1.1" status: 204 len: 168 time: 1.2425156 Nov 24 04:11:07.964907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59438) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:07.978018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=427ef0ea-12b5-4eae-b6b9-313cf75262e1,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.978381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef8e9eda-77cd-46d8-bd8b-c556cfe70897 None None] Pushing event updated for resources: {'Port': ['ID=940bc077-331e-4a49-a119-74bec15c7a4d,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.987151 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607b715f-b76d-42a1-ad8f-b30aa6566115 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=f6a28ac9-8f2a-460e-8287-e5737a0a01fa,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:07.996722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Network 3779787c-a1ad-4c57-b149-36324ecb887c is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:08.002299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-162b000e-844b-417c-b258-90e4fcc22c8f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.011174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:08.012398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-11fc769e-eb8e-4e93-9839-eb58ed665bc1 None None] Could not find standard attr ID for object bce97896-4b07-4386-9b72-55fb8a8643c6. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:11:08.014087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:08.082630 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.159100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network 6e7065f4-741d-46d1-94e1-3ba8665a6b7b is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:08.165940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.198091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.199785 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.7376649 Nov 24 04:11:08.215280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59440) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:08.215708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 6e7065f4-741d-46d1-94e1-3ba8665a6b7b) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:08.227524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7563f179-e6ec-4ad1-b600-5810349d6ed9 None None] Network 6e7065f4-741d-46d1-94e1-3ba8665a6b7b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:08.236984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': 'a204e44d-80ae-41f4-9857-dc5936eb214b', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:08.336545 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:08.337440 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.360363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:08.371033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] Sync routers for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:08.403738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 940bc077-331e-4a49-a119-74bec15c7a4d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:08.409488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.419203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b82bb63-76ad-483b-ad8e-37e5372a8dfc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a204e44d-80ae-41f4-9857-dc5936eb214b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:08.441723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:08.444041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.444852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:08.445501 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.477793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=6d38e76a-d362-4b95-922d-444cb8bf9f85,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:08.492326 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-660c469e-2ed1-46ef-a9ae-b8af6c8b655e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.8613572 Nov 24 04:11:08.500771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59442) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:08.503129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.508449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:80:fc:72'}, {'ip_address': '172.20.0.6', 'mac_address': 'fa:16:3e:50:00:52'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:08.515366 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-96188a6e-72c2-4613-8568-6a838f3782d3 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "DELETE /v2.0/floatingips/242711dc-9b2a-4e6d-b6a2-e24465324498 HTTP/1.1" status: 204 len: 168 time: 4.4989815 Nov 24 04:11:08.517320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Port': ['ID=350db653-755d-499d-b1ce-5863698ca20f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:08.523514 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59444) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:08.524385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.527257 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-df15b91a-6b58-4127-ac70-5c903ce95122 None None] Provisioning complete for port 6d38e76a-d362-4b95-922d-444cb8bf9f85 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:08.527643 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df15b91a-6b58-4127-ac70-5c903ce95122 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.532487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:08.553944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:08.554605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.587933 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3506115-fc3b-4834-82e0-eeaa6dfa4b90 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:08.589927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3506115-fc3b-4834-82e0-eeaa6dfa4b90 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:08.596618 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3506115-fc3b-4834-82e0-eeaa6dfa4b90 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.6576514 Nov 24 04:11:08.596822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Checking segment: {'id': '0bee7ee3-44c8-4ecd-bfa3-1b5f5b639a18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '4a08c23f-f6fd-42df-8ed7-4456f4d6ca68'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:08.596822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network hostable DHCP agents. Network: 4a08c23f-f6fd-42df-8ed7-4456f4d6ca68, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:08.599522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59446) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:08.599666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.600186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12508ae9-9c08-4283-9295-bc96639ef0b7 None None] The sync data for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:08.609171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-df15b91a-6b58-4127-ac70-5c903ce95122 None None] Port 6d38e76a-d362-4b95-922d-444cb8bf9f85 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:08.610828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 940bc077-331e-4a49-a119-74bec15c7a4d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:08.611266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.624671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.638347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.715594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.744621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.754117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 01827815-09a0-4019-9607-6c2d6fa1680e {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:08.766211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a7d39ba0-651c-4385-836c-7e01c2f3724c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:08.787043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.794274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network 4a08c23f-f6fd-42df-8ed7-4456f4d6ca68 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:08.795863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: a7d39ba0-651c-4385-836c-7e01c2f3724c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:08.796140 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.796568 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a7d39ba0-651c-4385-836c-7e01c2f3724c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:08.827861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.839695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.855716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 4a08c23f-f6fd-42df-8ed7-4456f4d6ca68) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:08.858380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1af75471-6958-4ce5-b5cb-7baa84c1d668,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:08.866422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['da5b46da-0cce-4707-ae4e-c2246ebc0995']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.866622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-189ab80c-c0a0-4614-ae46-1466058dc8a4 None None] Network 4a08c23f-f6fd-42df-8ed7-4456f4d6ca68 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:08.873986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:08.877813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:08.882893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:08.883572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.900844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e8be725-013e-4c27-a049-fca6589e6a5e') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.901151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e8be725-013e-4c27-a049-fca6589e6a5e') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:08.920575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.926835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.931322 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c04a7526-e64a-4264-ae2e-6803b7a50e67 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.7077827 Nov 24 04:11:08.932063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59448) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:08.943323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.952860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.965362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 180 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:08.965757 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:08.971005 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:09.026988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fafd1f18-78d2-4886-ab79-632354698c64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.070473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fafd1f18-78d2-4886-ab79-632354698c64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.129628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.134568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.137913 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/da5b46da-0cce-4707-ae4e-c2246ebc0995 HTTP/1.1" status: 204 len: 168 time: 1.1723902 Nov 24 04:11:09.145982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59450) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.157533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-1036570435'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:09.181967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e5acfe-a76d-4d0d-90d5-24226a1f3c73 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=da5b46da-0cce-4707-ae4e-c2246ebc0995,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:09.200867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fafd1f18-78d2-4886-ab79-632354698c64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.205950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fafd1f18-78d2-4886-ab79-632354698c64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.207242 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fafd1f18-78d2-4886-ab79-632354698c64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/1af75471-6958-4ce5-b5cb-7baa84c1d668 HTTP/1.1" status: 204 len: 168 time: 0.2745473 Nov 24 04:11:09.220128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59452) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.246080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:09.249723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.252285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fafd1f18-78d2-4886-ab79-632354698c64 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1af75471-6958-4ce5-b5cb-7baa84c1d668,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:09.260261 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6bc5867f-f069-4667-8d90-537595d99413 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 4.6146860 Nov 24 04:11:09.264833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59454) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.294075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.304934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.320591 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-53adcd78-0542-49a0-88e3-0b05d17ae42e tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0975654 Nov 24 04:11:09.321621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 176, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:09.326251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59456) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.327304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.401738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.401962 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 336c539e-4407-4940-aae4-bd812e86b3b1 of type vlan for network 6bf78bea-ec14-4403-9a28-47730e098bc4 Nov 24 04:11:09.404607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.430519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event updated for resources: {'Port': ['ID=6d38e76a-d362-4b95-922d-444cb8bf9f85,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:09.475100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] In _notify_port_updated(), no bound segment for port 6d38e76a-d362-4b95-922d-444cb8bf9f85 on network 3779787c-a1ad-4c57-b149-36324ecb887c {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:11:09.478366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dea70f3-6e89-445a-941a-7def0bb7201c tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:09.481007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:09.481648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.485606 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2617d8d7-0d6b-48d1-9156-33f5431f0cfe tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "PUT /v2.0/ports/6d38e76a-d362-4b95-922d-444cb8bf9f85 HTTP/1.1" status: 200 len: 1056 time: 0.9805834 Nov 24 04:11:09.485783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dea70f3-6e89-445a-941a-7def0bb7201c tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:09.485878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.486071 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1dea70f3-6e89-445a-941a-7def0bb7201c tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.2171960 Nov 24 04:11:09.488073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59458) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.490293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59460) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.501651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.574023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.579149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:09.580031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.622424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.627635 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4768238 Nov 24 04:11:09.632956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59462) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.638526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b738d111-6052-4d0b-9f77-711ccef0e1ba tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.652750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ccd3a58b-e36d-4ee3-aff8-f98fc8862e1a None None] Provisioning complete for port 6d38e76a-d362-4b95-922d-444cb8bf9f85 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:09.653317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ccd3a58b-e36d-4ee3-aff8-f98fc8862e1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.664448 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:09.671880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddff9d7a-368f-417a-b42b-a1e55b8f3ea5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=6bf78bea-ec14-4403-9a28-47730e098bc4,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:09.680501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Deleting port 4c91bbf4-ab40-47b4-b96d-b1b890d5eb59 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:09.681424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.698280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:09.725503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.734949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ccd3a58b-e36d-4ee3-aff8-f98fc8862e1a None None] Port 6d38e76a-d362-4b95-922d-444cb8bf9f85 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:09.756284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.774923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Calling delete_port for 4c91bbf4-ab40-47b4-b96d-b1b890d5eb59 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:09.806926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b738d111-6052-4d0b-9f77-711ccef0e1ba tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.851978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=01827815-09a0-4019-9607-6c2d6fa1680e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:09.853670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.872608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b30f991-b23c-497d-9163-d1cc2bbf0127 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:09.889580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Port': ['ID=4c91bbf4-ab40-47b4-b96d-b1b890d5eb59,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:09.889822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.895358 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8769640a-09f2-4a7f-ab16-a296b4c98c56 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/01827815-09a0-4019-9607-6c2d6fa1680e HTTP/1.1" status: 204 len: 168 time: 1.2856574 Nov 24 04:11:09.895539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:09.901771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-73009091-570c-41bb-ad23-ad90265713b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/ports/4c91bbf4-ab40-47b4-b96d-b1b890d5eb59 HTTP/1.1" status: 204 len: 168 time: 0.4066963 Nov 24 04:11:09.901771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59464) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.909885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59466) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.946718 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3c11b5a7-e100-4fbc-8f23-73a005dfb401 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0429740 Nov 24 04:11:09.947343 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59468) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:09.952520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:09.982817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Allocated IP 172.26.5.97 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/33e22ed7-6657-4d2a-9f8f-85c3830eeff6) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:10.038253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.086061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b738d111-6052-4d0b-9f77-711ccef0e1ba tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.089335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b738d111-6052-4d0b-9f77-711ccef0e1ba tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.090512 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b738d111-6052-4d0b-9f77-711ccef0e1ba tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/a204e44d-80ae-41f4-9857-dc5936eb214b HTTP/1.1" status: 204 len: 168 time: 0.7594950 Nov 24 04:11:10.094451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59470) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:10.113915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port 6d38e76a-d362-4b95-922d-444cb8bf9f85 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:10.114204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.117134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:10.120968 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.122302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:10.124307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:10.129100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.167111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b738d111-6052-4d0b-9f77-711ccef0e1ba tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a204e44d-80ae-41f4-9857-dc5936eb214b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:10.186823 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-90ed6994-7ee0-41bb-8d1c-8b0f7f1a5648 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0878303 Nov 24 04:11:10.195225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59472) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:10.195933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] Deleting port 940bc077-331e-4a49-a119-74bec15c7a4d {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:10.197256 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.243043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group': {'name': 'tempest-secgroup--608652275'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:10.271608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] For port 940bc077-331e-4a49-a119-74bec15c7a4d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=940bc077-331e-4a49-a119-74bec15c7a4d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:10.272092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.285791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] Calling delete_port for 940bc077-331e-4a49-a119-74bec15c7a4d owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:10.354367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 940bc077-331e-4a49-a119-74bec15c7a4d no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:10.428425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.438964 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.442516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Deleting port 350db653-755d-499d-b1ce-5863698ca20f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:10.442872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.450357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.474196 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.477714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.478786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] Pushing event deleted for resources: {'Port': ['ID=940bc077-331e-4a49-a119-74bec15c7a4d,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:10.482779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.487864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.493977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-044a4578-2e7c-4d44-9864-f1afe931e622 None None] No DVR routers for this DVR port 940bc077-331e-4a49-a119-74bec15c7a4d on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:10.520007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:11:10.545191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for 6d38e76a-d362-4b95-922d-444cb8bf9f85 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:10.684833 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.services.revisions.revision_plugin [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Could not find related port for resource to bump revision. Nov 24 04:11:10.689416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_pluggable_backend [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Port 940bc077-331e-4a49-a119-74bec15c7a4d was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=103381) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Nov 24 04:11:10.689728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_pluggable_backend [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Reverting IP allocation for 2001:db8::f816:3eff:feed:d8c3 {{(pid=103381) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Nov 24 04:11:10.689861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=427ef0ea-12b5-4eae-b6b9-313cf75262e1,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:10.693335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_pluggable_backend [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Reverting IP allocation failed for 2001:db8::f816:3eff:feed:d8c3 {{(pid=103381) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Nov 24 04:11:10.694605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.698859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.736953 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:10.742530 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:10.747760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:10.748763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.756484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56246dc3-cb42-453a-8831-664aeea08dc9 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:10.761155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=f2940f3b-e03c-4e0b-80ee-f2f95573bc53,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:10.776056 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7400dbc6-bea2-4f31-868f-69799eaa659b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.8274121 Nov 24 04:11:10.777346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Calling delete_port for 350db653-755d-499d-b1ce-5863698ca20f owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:10.778732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59474) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:10.785996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:1d:f4:9d', 'name': 'tempest-NetworksTestDHCPv6-438152727'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:10.813091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.875245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.887261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.929283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:10.940167 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'f2940f3b-e03c-4e0b-80ee-f2f95573bc53'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:10.941227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.968112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:10.978338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.010828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.015765 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:11.035464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.061453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port d4731a66-223d-4e63-aacd-9aa0eecccf6d yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:11.084815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Allocated IP 2001:db8::f816:3eff:fe5a:7e25 (a2b36c78-43a6-4954-8102-cb5638999bb1/f2940f3b-e03c-4e0b-80ee-f2f95573bc53/e7228630-0e91-47a0-aa89-19273727b228) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:11.237364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.244934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.296195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fe1d:f49d (a2b36c78-43a6-4954-8102-cb5638999bb1/f2940f3b-e03c-4e0b-80ee-f2f95573bc53/d4731a66-223d-4e63-aacd-9aa0eecccf6d) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:11.297881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:11.298938 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Pushing event updated for resources: {'Port': ['ID=e7228630-0e91-47a0-aa89-19273727b228,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.302683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:11.305331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:11.347215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:11.363804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Attempting to bind port e7228630-0e91-47a0-aa89-19273727b228 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:11.364174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Attempting to bind port e7228630-0e91-47a0-aa89-19273727b228 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:11.364544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Attempting to bind port e7228630-0e91-47a0-aa89-19273727b228 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:11.370503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:11.370914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:11.371475 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.371903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:11.372427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Bound port: e7228630-0e91-47a0-aa89-19273727b228, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:11.372822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.374441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:11.394795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Pushing event updated for resources: {'Port': ['ID=33e22ed7-6657-4d2a-9f8f-85c3830eeff6,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.432273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.435676 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.1993732 Nov 24 04:11:11.436562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59480) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.444151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '507c4d92-f63c-4390-9299-5e048f5843da', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:11.446119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] For port e7228630-0e91-47a0-aa89-19273727b228, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:11.446301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98783d6b-1e59-40ab-9082-cb75fafe943d tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroup': ['ID=507c4d92-f63c-4390-9299-5e048f5843da,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.449912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] For port e7228630-0e91-47a0-aa89-19273727b228, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7228630-0e91-47a0-aa89-19273727b228,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:11.456814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.495520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.509789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.535372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cf39d7-2f84-472d-8fa6-44b3c9f5bf67 None None] Pushing event updated for resources: {'Port': ['ID=e7228630-0e91-47a0-aa89-19273727b228,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.576552 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.577882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.594615 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 14190efe-a3ee-4a90-abb0-7635162df195 associated. External IP: 172.26.5.168, port: 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8. Nov 24 04:11:11.598230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=ac622e9a-0595-4421-8277-c93244989e08,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.644016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:11.657795 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.659356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:11.661960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:11.666132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Port': ['ID=350db653-755d-499d-b1ce-5863698ca20f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.671764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '336c539e-4407-4940-aae4-bd812e86b3b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:11.672103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: 6bf78bea-ec14-4403-9a28-47730e098bc4, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:11.680712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:11.682114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.685366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.691987 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-416c3956-cd83-469d-b9ff-cf92df1ed03a tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/ports/350db653-755d-499d-b1ce-5863698ca20f HTTP/1.1" status: 204 len: 168 time: 1.7582185 Nov 24 04:11:11.698760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59482) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.699713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=d4731a66-223d-4e63-aacd-9aa0eecccf6d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.725499 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-20d72b40-fc84-4280-b43a-1a60ed00dc32 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 0.9443240 Nov 24 04:11:11.726293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.730758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59484) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.749623 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-46f06941-dabd-4ba2-889f-765d0b891130 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0452108 Nov 24 04:11:11.753089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59486) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.757989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-2075871537'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:11.761012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.775934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=af893f56-864f-4d2c-9356-fc0671f84939,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.795899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:11.799599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.813238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.814605 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-92869ec3-7686-46a4-a850-88ef63117829 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3771844 Nov 24 04:11:11.817224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59488) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.838911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:11.841279 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8acc731f-2a32-48b9-8e6d-8c02d2940ef1 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules/af893f56-864f-4d2c-9356-fc0671f84939 HTTP/1.1" status: 200 len: 763 time: 0.0227745 Nov 24 04:11:11.844087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59490) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.861098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] vlan segment allocate from pool success with {'vlan_id': 170, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:11.880271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=6d38e76a-d362-4b95-922d-444cb8bf9f85,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:11.883291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 6bf78bea-ec14-4403-9a28-47730e098bc4) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:11.884534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.884960 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Added segment 61dbc318-8659-4afc-87f8-16a415a0face of type vlan for network ca5caa7b-94b2-48b9-84dd-86a99428346e Nov 24 04:11:11.887781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:11.888387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.894890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d672fc7a-9679-4f47-90e8-90070b6fd4bf None None] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:11.902392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.922439 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1545a8d4-64b6-4554-94cc-706638878b75 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0763416 Nov 24 04:11:11.926409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59492) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.976859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7673fae9-bff0-43b3-a65f-a2b9275c4a65 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:11.982621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:11.984254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7673fae9-bff0-43b3-a65f-a2b9275c4a65 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:11.986100 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7673fae9-bff0-43b3-a65f-a2b9275c4a65 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.2535889 Nov 24 04:11:11.991421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59494) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:11.997205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-81faac9e-2423-47ca-a1e7-a3a430a07f5a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3595707 Nov 24 04:11:12.002072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5a152c7-7520-44cf-9ec8-f250cfe86ec6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.006190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59496) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.012403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-537507546', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:12.065037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5a152c7-7520-44cf-9ec8-f250cfe86ec6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.101027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.103643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.113126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:12.113980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.139772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.154445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.155989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.184747 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-6bf78bea-ec14-4403-9a28-47730e098bc4', 'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': 'ac622e9a-0595-4421-8277-c93244989e08'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:12.185863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.185993 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.4317846 Nov 24 04:11:12.199303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59498) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.255356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.260819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-550389423'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:12.269486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5a152c7-7520-44cf-9ec8-f250cfe86ec6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.274926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5a152c7-7520-44cf-9ec8-f250cfe86ec6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.275704 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d5a152c7-7520-44cf-9ec8-f250cfe86ec6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/af893f56-864f-4d2c-9356-fc0671f84939 HTTP/1.1" status: 204 len: 168 time: 0.3484297 Nov 24 04:11:12.287460 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59500) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.290859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.330521 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5a152c7-7520-44cf-9ec8-f250cfe86ec6 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=af893f56-864f-4d2c-9356-fc0671f84939,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:12.348008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a926dbad-f49d-4e57-a01c-5dba04eff0b7 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Network': ['ID=ca5caa7b-94b2-48b9-84dd-86a99428346e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:12.375422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:12.379609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network ca5caa7b-94b2-48b9-84dd-86a99428346e details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:12.380000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.399198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port d4731a66-223d-4e63-aacd-9aa0eecccf6d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:12.400310 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.425817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:12.429563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Allocated IP 172.20.0.2 (6bf78bea-ec14-4403-9a28-47730e098bc4/ac622e9a-0595-4421-8277-c93244989e08/56727c75-62a6-4af5-8c8d-421e8094f2e0) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:12.439480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.443144 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c7f2dd90-acbb-4849-b09c-73aff7644936 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.4335492 Nov 24 04:11:12.459269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59502) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.464735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'port': {'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4', 'name': 'tempest-RoutersTest-641262815'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:12.492137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] vlan segment allocate from pool success with {'vlan_id': 167, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:12.523304 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3ab240a5-1afa-4983-b971-7b0d501a2b40 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2321517 Nov 24 04:11:12.526198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59504) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.532532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '507c4d92-f63c-4390-9299-5e048f5843da', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:12.537265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.543958 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8b62cf39-fd40-4d63-b093-9d186995619b tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/ports/6d38e76a-d362-4b95-922d-444cb8bf9f85 HTTP/1.1" status: 204 len: 168 time: 3.0488195 Nov 24 04:11:12.552206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59506) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.627554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7228630-0e91-47a0-aa89-19273727b228 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:12.632036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.633537 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-19abbe34-1a5d-4773-a8ce-ca11cd432687 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] GET failed (client error): The resource could not be found. Nov 24 04:11:12.635124 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-19abbe34-1a5d-4773-a8ce-ca11cd432687 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "GET /v2.0/ports/6d38e76a-d362-4b95-922d-444cb8bf9f85 HTTP/1.1" status: 404 len: 333 time: 0.0811579 Nov 24 04:11:12.642833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59508) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:12.654621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for d4731a66-223d-4e63-aacd-9aa0eecccf6d owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:12.710015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.710586 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Added segment 7119cc55-8fd5-45c8-9928-d4097d1405e0 of type vlan for network 678bcab8-7e1c-4159-be72-7cecc4c12815 Nov 24 04:11:12.779156 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.791747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.802442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.804955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.881184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:12.900428 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:12.912525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c8d2192d-b0ee-4bba-a731-61dc42c0ef01 None None] Provisioning complete for port e7228630-0e91-47a0-aa89-19273727b228 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:12.913662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8d2192d-b0ee-4bba-a731-61dc42c0ef01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.915958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.resource_extend [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:11:12.921486 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:12.921486 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:12.921792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.927042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e7228630-0e91-47a0-aa89-19273727b228 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:12.927417 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.931055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.966551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=d4731a66-223d-4e63-aacd-9aa0eecccf6d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:12.973874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:12.994774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.001126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:13.002287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.043717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Pushing event updated for resources: {'Port': ['ID=33e22ed7-6657-4d2a-9f8f-85c3830eeff6,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:13.046551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:13.054766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:13.057957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:13.065762 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:13.079355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.088835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.089566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.089684 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0a3121b9-defa-4417-a53a-16b2157d946c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/d4731a66-223d-4e63-aacd-9aa0eecccf6d HTTP/1.1" status: 204 len: 168 time: 1.0973263 Nov 24 04:11:13.089771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.091976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.092206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.092605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.096591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59510) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.105464 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:13.107614 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:13.127791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.131788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port 7a692167-cfc9-4906-8a01-4c5d3a8a236f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:13.132128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.132999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Pushing event updated for resources: {'Port': ['ID=56727c75-62a6-4af5-8c8d-421e8094f2e0,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:13.137460 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.166590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.195154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.201352 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.202674 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-57a35d37-5fe1-4f59-8ce6-d864e9b0a33a tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.6735168 Nov 24 04:11:13.211391 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:13.212624 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ada2fce9-ba0f-4780-aeb7-6606b36f1350 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:13.215259 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Attempting to bind port 56727c75-62a6-4af5-8c8d-421e8094f2e0 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:13.215518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Attempting to bind port 56727c75-62a6-4af5-8c8d-421e8094f2e0 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '336c539e-4407-4940-aae4-bd812e86b3b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:13.215921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Attempting to bind port 56727c75-62a6-4af5-8c8d-421e8094f2e0 on network 6bf78bea-ec14-4403-9a28-47730e098bc4 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:13.222354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-558f6a7b-5aac-48d0-8c49-f0946ab3afe8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:13.223822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-558f6a7b-5aac-48d0-8c49-f0946ab3afe8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:13.231761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59512) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.233484 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-558f6a7b-5aac-48d0-8c49-f0946ab3afe8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.1291864 Nov 24 04:11:13.237557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59514) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.245195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:13.245835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Checking segment: {'id': '336c539e-4407-4940-aae4-bd812e86b3b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:13.246270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.246831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Bound using segment: {'id': '336c539e-4407-4940-aae4-bd812e86b3b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:13.247305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Bound port: 56727c75-62a6-4af5-8c8d-421e8094f2e0, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '336c539e-4407-4940-aae4-bd812e86b3b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '6bf78bea-ec14-4403-9a28-47730e098bc4'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:13.247791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.255967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5bd2914-145c-4106-8267-d5116333e634,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:13.271487 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.323798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:13.329943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.339141 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ffc4fe99-e33a-4df1-89bd-bf85fe5ee2bd tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 7.8583875 Nov 24 04:11:13.341898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.345740 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2951e680-829c-4d8d-8249-7695d38af754 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.8165753 Nov 24 04:11:13.346409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59518) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.347173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59520) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.347517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8d2192d-b0ee-4bba-a731-61dc42c0ef01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.353871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-563132213'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:13.380981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet f2940f3b-e03c-4e0b-80ee-f2f95573bc53 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:13.415904 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port e7228630-0e91-47a0-aa89-19273727b228, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7228630-0e91-47a0-aa89-19273727b228,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:13.429572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.435768 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.2343469 Nov 24 04:11:13.436958 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-00f83d56-62f5-4d75-8da2-8b44cf148550 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules/a5bd2914-145c-4106-8267-d5116333e634 HTTP/1.1" status: 200 len: 763 time: 0.0752525 Nov 24 04:11:13.438951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59522) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.443147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.453327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] For port 56727c75-62a6-4af5-8c8d-421e8094f2e0, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:13.474976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:13.488576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.488576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.493341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] device_id is not set on port b78541a2-0f49-4af7-ad65-5fa417c7eb75 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:13.498922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95bec38-c3d5-4427-8011-689aae7f7586 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Network': ['ID=678bcab8-7e1c-4159-be72-7cecc4c12815,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:13.500688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:13.530397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 678bcab8-7e1c-4159-be72-7cecc4c12815 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:13.574623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.590367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] For port 56727c75-62a6-4af5-8c8d-421e8094f2e0, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56727c75-62a6-4af5-8c8d-421e8094f2e0,segment=NetworkSegment(336c539e-4407-4940-aae4-bd812e86b3b1),segment_id=336c539e-4407-4940-aae4-bd812e86b3b1)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:13.600635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59524) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.601654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for 7a692167-cfc9-4906-8a01-4c5d3a8a236f owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:13.618999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'subnets': [{'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--756672645', 'ip_version': 4}, {'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:13.619399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'subnet': {'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--756672645', 'ip_version': 4}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:13.620133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Request body: {'subnet': {'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:13.620593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.627841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-c8d2192d-b0ee-4bba-a731-61dc42c0ef01 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:11:13.628193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-c8d2192d-b0ee-4bba-a731-61dc42c0ef01 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:11:13.668349 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dbdd094d-4e6d-4be4-9bb5-a7c0212e0d31 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.2233639 Nov 24 04:11:13.675413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59526) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:13.688966 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=e7228630-0e91-47a0-aa89-19273727b228,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:13.699298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.699751 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.699993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.700324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.700660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702589 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.702944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:13.746809 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] vlan segment allocate from pool success with {'vlan_id': 174, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:13.758803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b10b015-35f3-4844-b3d8-10616f7d97b5 None None] Pushing event updated for resources: {'Port': ['ID=56727c75-62a6-4af5-8c8d-421e8094f2e0,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:13.815981 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.816573 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Added segment f93a35f0-1446-47aa-a2ad-98a906e6633e of type vlan for network 576cb395-ded1-477d-9995-f33c4a213744 Nov 24 04:11:13.901941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.948268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74bcfbf-de7c-4ca9-8cb3-b712a26f25a9 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.975900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:13.980436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74bcfbf-de7c-4ca9-8cb3-b712a26f25a9 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.053198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.20.0.5 (6bf78bea-ec14-4403-9a28-47730e098bc4/ac622e9a-0595-4421-8277-c93244989e08/b78541a2-0f49-4af7-ad65-5fa417c7eb75) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:14.061637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.178966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.239651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=f2940f3b-e03c-4e0b-80ee-f2f95573bc53,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:14.249881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.253055 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aca47eec-4f30-4905-8eaa-1dcf47ab5bbf tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/f2940f3b-e03c-4e0b-80ee-f2f95573bc53 HTTP/1.1" status: 204 len: 168 time: 1.0142479 Nov 24 04:11:14.255693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59528) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.260949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-347bb3f9-de3e-46c5-bdd5-9d5ac2bbdce9 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:14.299987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] It took 0.31 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:11:14.300187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f368efbb-8572-4f6f-9ca9-4c6c62e48a28 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0410655 Nov 24 04:11:14.300187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59530) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.359366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.376644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74bcfbf-de7c-4ca9-8cb3-b712a26f25a9 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.381197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74bcfbf-de7c-4ca9-8cb3-b712a26f25a9 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.382639 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e74bcfbf-de7c-4ca9-8cb3-b712a26f25a9 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/a5bd2914-145c-4106-8267-d5116333e634 HTTP/1.1" status: 204 len: 168 time: 0.6962972 Nov 24 04:11:14.393179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.398668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:14.399301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.402616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59532) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.409604 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e5bb71b1-f026-4103-aaef-848e10f924cb None None] Could not find standard attr ID for object d4731a66-223d-4e63-aacd-9aa0eecccf6d. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:11:14.428694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b9bb70a-87a1-4e02-9859-20a0d978132a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:14.433442 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b9bb70a-87a1-4e02-9859-20a0d978132a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1322901 Nov 24 04:11:14.435870 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59534) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.471785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74bcfbf-de7c-4ca9-8cb3-b712a26f25a9 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a5bd2914-145c-4106-8267-d5116333e634,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:14.503935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acd8614f-74b5-40d8-970b-ece20effeec6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:14.514515 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-acd8614f-74b5-40d8-970b-ece20effeec6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0775495 Nov 24 04:11:14.515171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59536) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.524543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.542493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Made reservation on behalf of a72d9df6a5264a7faa5f3898f7692406 for: {'subnet': 2} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:14.547927 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.548949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.560468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.561731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:14.564536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56727c75-62a6-4af5-8c8d-421e8094f2e0 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:14.567600 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2152700 Nov 24 04:11:14.567600 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.569565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59538) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.569696 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5f04dc7a-64e9-4eb4-8083-9b139e4fbb9c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0523143 Nov 24 04:11:14.569967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59540) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.588012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'subnet': {'network_id': '576cb395-ded1-477d-9995-f33c4a213744', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:14.598595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:14.602202 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26369a38-ba78-4c70-b152-bd902cfd5b0e tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Network': ['ID=576cb395-ded1-477d-9995-f33c4a213744,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:14.613663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:14.617191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:14.622073 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:14.626312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=b78541a2-0f49-4af7-ad65-5fa417c7eb75,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:14.631207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 576cb395-ded1-477d-9995-f33c4a213744 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:14.690248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:14.691223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.716161 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-88b464b6-c8cb-492d-9a69-f1c79851d2ae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 2.2554595 Nov 24 04:11:14.719309 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59542) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.759402 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-54515f90-35d7-47ae-889d-aae5f71c5b05 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.3444507 Nov 24 04:11:14.783676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59544) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:14.791048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Request body: {'security_group_rule': {'security_group_id': '507c4d92-f63c-4390-9299-5e048f5843da', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:14.819160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 56727c75-62a6-4af5-8c8d-421e8094f2e0 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:14.819512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.847933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] Deleting port e7228630-0e91-47a0-aa89-19273727b228 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:14.848306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:14.867881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=7a692167-cfc9-4906-8a01-4c5d3a8a236f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:14.953625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] For port e7228630-0e91-47a0-aa89-19273727b228, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7228630-0e91-47a0-aa89-19273727b228,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:14.954028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.010953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] Calling delete_port for e7228630-0e91-47a0-aa89-19273727b228 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:15.043471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.132893 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Project 24b2951315c54a5b95ffe2a60d4a2eb8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:11:15.143048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.147079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 56727c75-62a6-4af5-8c8d-421e8094f2e0, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56727c75-62a6-4af5-8c8d-421e8094f2e0,segment=NetworkSegment(336c539e-4407-4940-aae4-bd812e86b3b1),segment_id=336c539e-4407-4940-aae4-bd812e86b3b1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:15.195736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:11:15.195736 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 24 04:11:15.195736 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'project_id_1': '69073a2d6ab34b54a6451825f7590db1', 'expiration_1': datetime.datetime(2021, 11, 24, 4, 10, 55, 147879)}] Nov 24 04:11:15.195736 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:11:15.196679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:11:15.200762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.204813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.209672 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-12b6ec0e-effc-4df4-beec-cd822ec54f42 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/ports/7a692167-cfc9-4906-8a01-4c5d3a8a236f HTTP/1.1" status: 204 len: 168 time: 2.5647306 Nov 24 04:11:15.213974 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.221092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59546) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:15.240954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Allocated IP 172.26.5.25 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/32832dd7-f7fd-4052-ac07-5fcbfd9d7153) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:15.248107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] No DVR routers for this DVR port e7228630-0e91-47a0-aa89-19273727b228 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:15.251380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:15.255135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.288699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=56727c75-62a6-4af5-8c8d-421e8094f2e0,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:15.307677 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-687dbd78-f85a-4e69-a2d3-29341a6ab1db tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] GET failed (client error): The resource could not be found. Nov 24 04:11:15.312778 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-687dbd78-f85a-4e69-a2d3-29341a6ab1db tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "GET /v2.0/ports/7a692167-cfc9-4906-8a01-4c5d3a8a236f HTTP/1.1" status: 404 len: 333 time: 0.0873463 Nov 24 04:11:15.323896 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59548) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:15.325631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.328405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9e4cc4-4a6f-416b-98be-8e47919d1fcf None None] Pushing event deleted for resources: {'Port': ['ID=e7228630-0e91-47a0-aa89-19273727b228,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:15.338083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca0009e5-b989-4324-b096-58bd2e9fc0cc None None] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:15.358083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.382898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.407485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=288d6d18-8f41-40df-a878-dc1fadea12f5,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:15.427360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-30ccf6b5-9c01-46c4-9681-9c1307ccbe69 None None] Provisioning complete for port 56727c75-62a6-4af5-8c8d-421e8094f2e0 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:15.427736 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30ccf6b5-9c01-46c4-9681-9c1307ccbe69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.437048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.437487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.437898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.438588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.438772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.439225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.439642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.440037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.440429 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.440821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.441213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.441601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:11:15.452373 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.453262 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8818a5b5-e2e2-4de0-ae1a-de5a124313b5 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6683877 Nov 24 04:11:15.460374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59550) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:15.510815 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b04dfb55-f145-41a5-b418-b6bae8c4736e tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules/288d6d18-8f41-40df-a878-dc1fadea12f5 HTTP/1.1" status: 200 len: 769 time: 0.0485823 Nov 24 04:11:15.515847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59552) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:15.595286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port 024067c8-2b6a-415b-b179-aae989ba3c89 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:15.595755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.671328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.683396 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f3e71eb6-c26e-4b6d-9350-683d89598aa7 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.1662900 Nov 24 04:11:15.685899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59554) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:15.776533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-93d39b99-0085-4b10-8928-6662020aa322 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.797620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:15.801173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.801535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-93d39b99-0085-4b10-8928-6662020aa322 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.804302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.836521 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for 024067c8-2b6a-415b-b179-aae989ba3c89 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:15.840743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.866970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-93d39b99-0085-4b10-8928-6662020aa322 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.905144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e801d81b-db3e-4bd9-a657-213df3d41fbe None None] Provisioning complete for port b78541a2-0f49-4af7-ad65-5fa417c7eb75 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:15.905522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e801d81b-db3e-4bd9-a657-213df3d41fbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.921715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-93d39b99-0085-4b10-8928-6662020aa322 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.925221 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-93d39b99-0085-4b10-8928-6662020aa322 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/288d6d18-8f41-40df-a878-dc1fadea12f5 HTTP/1.1" status: 204 len: 168 time: 0.2360659 Nov 24 04:11:15.932626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.936451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59556) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:15.948935 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e801d81b-db3e-4bd9-a657-213df3d41fbe None None] Port b78541a2-0f49-4af7-ad65-5fa417c7eb75 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:15.956572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.959033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e801d81b-db3e-4bd9-a657-213df3d41fbe None None] Provisioning complete for port 56727c75-62a6-4af5-8c8d-421e8094f2e0 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:15.959453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e801d81b-db3e-4bd9-a657-213df3d41fbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:15.962187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93d39b99-0085-4b10-8928-6662020aa322 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=288d6d18-8f41-40df-a878-dc1fadea12f5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:15.967795 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.041644 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bbfd1bb4-5bc3-4579-aa48-dcea8b65afbf tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1044731 Nov 24 04:11:16.043135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=eb0bc524-c90e-4c1c-a020-88bfe7695242,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.044271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59558) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:16.085171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:16.095603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:16.098673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:16.099273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.108694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7555e8e-222c-4cee-9e69-3ea232b43793 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:16.143692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=b78541a2-0f49-4af7-ad65-5fa417c7eb75,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.181606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3344745c-c61e-49aa-bfab-dd1408588411 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.205366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:16.207421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.210271 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ee1d20a0-4346-4271-9066-edf2004b1625 None None] Provisioning complete for port b78541a2-0f49-4af7-ad65-5fa417c7eb75 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:16.210655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee1d20a0-4346-4271-9066-edf2004b1625 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.212502 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9dd78f80-19cb-4621-bf61-ed6606912009 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6201143 Nov 24 04:11:16.224466 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59560) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:16.229542 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:16.249288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:b2:ab:fe', 'name': 'tempest-NetworksTestDHCPv6-1561833929'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:16.261180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Pushing event updated for resources: {'Port': ['ID=32832dd7-f7fd-4052-ac07-5fcbfd9d7153,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.264119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:16.265892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ee1d20a0-4346-4271-9066-edf2004b1625 None None] Port b78541a2-0f49-4af7-ad65-5fa417c7eb75 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:16.328711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3344745c-c61e-49aa-bfab-dd1408588411 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.351613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'eb0bc524-c90e-4c1c-a020-88bfe7695242'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:16.353128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.394984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.403687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Subnet': ['ID=f9d3412a-812d-4e31-868b-465c8722aabb,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.420735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.448162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56727c75-62a6-4af5-8c8d-421e8094f2e0 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:16.471847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Checking segment: {'id': 'f93a35f0-1446-47aa-a2ad-98a906e6633e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '576cb395-ded1-477d-9995-f33c4a213744'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:16.472821 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network hostable DHCP agents. Network: 576cb395-ded1-477d-9995-f33c4a213744, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:16.479871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=024067c8-2b6a-415b-b179-aae989ba3c89,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.537702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Subnet': ['ID=2489251e-27ed-4dc2-8cb3-bd7243e27b2d,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.545497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network 576cb395-ded1-477d-9995-f33c4a213744 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:16.558945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Checking segment: {'id': '61dbc318-8659-4afc-87f8-16a415a0face', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:16.559242 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network hostable DHCP agents. Network: ca5caa7b-94b2-48b9-84dd-86a99428346e, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:16.575277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.576876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 576cb395-ded1-477d-9995-f33c4a213744) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:16.589427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:16.590086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.591641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3344745c-c61e-49aa-bfab-dd1408588411 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.594454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3344745c-c61e-49aa-bfab-dd1408588411 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.598061 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3344745c-c61e-49aa-bfab-dd1408588411 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "DELETE /v2.0/security-groups/507c4d92-f63c-4390-9299-5e048f5843da HTTP/1.1" status: 204 len: 168 time: 0.5466635 Nov 24 04:11:16.601282 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59562) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:16.633212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.636838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network ca5caa7b-94b2-48b9-84dd-86a99428346e is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:16.642692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3344745c-c61e-49aa-bfab-dd1408588411 tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=507c4d92-f63c-4390-9299-5e048f5843da,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.655728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, ca5caa7b-94b2-48b9-84dd-86a99428346e) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:16.675428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.679872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.713543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.717640 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2358c333-9eac-43e3-b349-032d586231ea tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/ports/024067c8-2b6a-415b-b179-aae989ba3c89 HTTP/1.1" status: 204 len: 168 time: 1.3906212 Nov 24 04:11:16.738172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59564) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:16.749015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:16.750364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b90b293f-62f8-4185-a49b-f4909aac9eea None None] Network 576cb395-ded1-477d-9995-f33c4a213744 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:16.753999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57186c43-fdcc-46a9-9b2e-aac4590240e5 None None] Network ca5caa7b-94b2-48b9-84dd-86a99428346e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:16.764921 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-57cd2952-f2a9-4102-aaed-769d40187deb tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1813684 Nov 24 04:11:16.772006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59566) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:16.782197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-939386945', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:16.819238 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ab3ab12e-4b59-4bf7-985c-fb850226ed0c tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2145834 Nov 24 04:11:16.831634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59568) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:16.860896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event updated for resources: {'Subnet': ['ID=1af2bc28-bce6-41bf-8c96-2fe2e1e1b4f8,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:16.869656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-396b816b-b6c2-4b1e-9089-7a40645cfc4e None None] Provisioning complete for port b78541a2-0f49-4af7-ad65-5fa417c7eb75 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:16.870186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-396b816b-b6c2-4b1e-9089-7a40645cfc4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.874277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting subnet becde755-a9f2-4b15-8f7d-32a2169b347a {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:16.895299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.898687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.900044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.954636 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Checking segment: {'id': '7119cc55-8fd5-45c8-9928-d4097d1405e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:16.955311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network hostable DHCP agents. Network: 678bcab8-7e1c-4159-be72-7cecc4c12815, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:16.991647 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eafa005e-a2c7-4854-a91f-1a689cb1b4fc tempest-SecGroupIPv6Test-1599962777 tempest-SecGroupIPv6Test-1599962777-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1564972 Nov 24 04:11:16.994594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:16.996938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.001060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.030100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/eb0bc524-c90e-4c1c-a020-88bfe7695242/54859d9a-62e2-4f7f-9a05-2f76d9588a51) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:17.033577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 56727c75-62a6-4af5-8c8d-421e8094f2e0 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:17.033964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.047854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-396b816b-b6c2-4b1e-9089-7a40645cfc4e None None] Port b78541a2-0f49-4af7-ad65-5fa417c7eb75 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:17.058928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.059488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Network 678bcab8-7e1c-4159-be72-7cecc4c12815 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:17.104920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:17.141052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 678bcab8-7e1c-4159-be72-7cecc4c12815) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:17.152786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:17.153265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:17.153901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.184363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.191454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2667e967-fef0-47b2-82f1-5ec25666e6c7 None None] Network 678bcab8-7e1c-4159-be72-7cecc4c12815 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:17.223535 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f0010199-76f7-4290-89a1-5b9a6d246034 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1425 time: 3.6163990 Nov 24 04:11:17.237527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59572) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.251157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.290617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.347709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-576cb395-ded1-477d-9995-f33c4a213744', 'network_id': '576cb395-ded1-477d-9995-f33c4a213744', 'tenant_id': '69073a2d6ab34b54a6451825f7590db1', 'fixed_ips': [{'subnet_id': 'f9d3412a-812d-4e31-868b-465c8722aabb'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:17.348599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.487187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-ca5caa7b-94b2-48b9-84dd-86a99428346e', 'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e', 'tenant_id': 'a72d9df6a5264a7faa5f3898f7692406', 'fixed_ips': [{'subnet_id': '2489251e-27ed-4dc2-8cb3-bd7243e27b2d'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:17.488078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.592147 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7228630-0e91-47a0-aa89-19273727b228 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:17.631448 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59576) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.661231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e7228630-0e91-47a0-aa89-19273727b228 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:17.661231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7228630-0e91-47a0-aa89-19273727b228 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:17.670285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Pushing event updated for resources: {'Port': ['ID=32832dd7-f7fd-4052-ac07-5fcbfd9d7153,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:17.687644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.688126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.697394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.724157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.725758 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-641ca9ae-36b9-46e9-a5e1-d741e25e55cd tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.4675803 Nov 24 04:11:17.729135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59580) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.783727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f774493-d815-4b78-b9da-3ce15dabbbd3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:17.786320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f774493-d815-4b78-b9da-3ce15dabbbd3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:17.788121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f774493-d815-4b78-b9da-3ce15dabbbd3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:17.790277 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1f774493-d815-4b78-b9da-3ce15dabbbd3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2051 time: 0.5213907 Nov 24 04:11:17.799167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59582) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.831498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.872403 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-44007682-9862-4743-b9ce-3204fa06d4f1 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] 10.222.0.48 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3204 time: 0.1393733 Nov 24 04:11:17.875428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59584) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.931863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::89 (a2b36c78-43a6-4954-8102-cb5638999bb1/eb0bc524-c90e-4c1c-a020-88bfe7695242/b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:17.951040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:17.956622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Allocated IP 172.20.0.2 (ca5caa7b-94b2-48b9-84dd-86a99428346e/2489251e-27ed-4dc2-8cb3-bd7243e27b2d/b5779290-e689-45bd-9358-645cd04f2d94) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:17.959899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.968069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:17.970609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:17.972727 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Pushing event updated for resources: {'Port': ['ID=54859d9a-62e2-4f7f-9a05-2f76d9588a51,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:17.973497 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d84fe2b6-b9a8-4fb9-a970-781b9c88596d admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=24b2951315c54a5b95ffe2a60d4a2eb8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3349464 Nov 24 04:11:17.975784 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59586) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.984909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-678bcab8-7e1c-4159-be72-7cecc4c12815', 'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815', 'tenant_id': 'a72d9df6a5264a7faa5f3898f7692406', 'fixed_ips': [{'subnet_id': '1af2bc28-bce6-41bf-8c96-2fe2e1e1b4f8'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:17.988927 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-73704d62-d65c-4ce5-a457-8363491b50ac tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.1090500 Nov 24 04:11:17.989045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:17.989139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59588) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:17.992903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Allocated IP 172.20.0.2 (576cb395-ded1-477d-9995-f33c4a213744/f9d3412a-812d-4e31-868b-465c8722aabb/40d45a41-d786-45df-9c60-5edc8d385bcd) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:18.002472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Subnet': ['ID=becde755-a9f2-4b15-8f7d-32a2169b347a,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:18.007887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Deleting subnet 2489251e-27ed-4dc2-8cb3-bd7243e27b2d {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:18.015522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.018695 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-091cf31b-96b6-4a4f-954e-9f20cfd63d11 tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/subnets/becde755-a9f2-4b15-8f7d-32a2169b347a HTTP/1.1" status: 204 len: 168 time: 1.2792919 Nov 24 04:11:18.027450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c55bf3b3-e341-4c11-8575-4e9d760440de None None] Network 3779787c-a1ad-4c57-b149-36324ecb887c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:18.032858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59590) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:18.175017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.196909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.202085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.229850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.230932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.245202 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24de4c75-e23d-4c34-9d5e-9bd032ee27e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.313412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Attempting to bind port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:18.313791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Attempting to bind port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:18.314176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Attempting to bind port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:18.316838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24de4c75-e23d-4c34-9d5e-9bd032ee27e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.317538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.323657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=b78541a2-0f49-4af7-ad65-5fa417c7eb75,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:18.370600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:18.370985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:18.371396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.371804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:18.372297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Bound port: 54859d9a-62e2-4f7f-9a05-2f76d9588a51, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:18.372685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.383122 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Deleting port 32832dd7-f7fd-4052-ac07-5fcbfd9d7153 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:18.383975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.444851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.467083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.26.5.59 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/7259cabb-83db-4063-84a3-d1c6aa82e64b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:18.481402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24de4c75-e23d-4c34-9d5e-9bd032ee27e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.484100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24de4c75-e23d-4c34-9d5e-9bd032ee27e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.488015 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-24de4c75-e23d-4c34-9d5e-9bd032ee27e8 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/46dd12be-b5c6-47c7-8cd7-0c39682fc8ec HTTP/1.1" status: 204 len: 168 time: 0.5109835 Nov 24 04:11:18.506138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Deleting port e5d07f5f-eb23-4854-b67a-826db43b2805 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:18.506519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.521358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24de4c75-e23d-4c34-9d5e-9bd032ee27e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46dd12be-b5c6-47c7-8cd7-0c39682fc8ec,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:18.527643 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.527988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.543029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:18.558085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Calling delete_port for 32832dd7-f7fd-4052-ac07-5fcbfd9d7153 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:18.577458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:18.585035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.782072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.833566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Allocated IP 172.20.0.18 (678bcab8-7e1c-4159-be72-7cecc4c12815/1af2bc28-bce6-41bf-8c96-2fe2e1e1b4f8/fe3b0cc9-a8a2-4a5c-810c-925ef62de248) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:18.865880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.880591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:18.899939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.906773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] For port e5d07f5f-eb23-4854-b67a-826db43b2805, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e5d07f5f-eb23-4854-b67a-826db43b2805,segment=NetworkSegment(3e2d0adb-4d09-4c22-ab0c-9c06ac580e68),segment_id=3e2d0adb-4d09-4c22-ab0c-9c06ac580e68)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:18.907353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:18.926127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:18.927609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Calling delete_port for e5d07f5f-eb23-4854-b67a-826db43b2805 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:18.933988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:18.942957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:18.959577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=7259cabb-83db-4063-84a3-d1c6aa82e64b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:18.994981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.008310 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:19.014688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:19.020207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:19.022096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Pushing event deleted for resources: {'Port': ['ID=32832dd7-f7fd-4052-ac07-5fcbfd9d7153,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:19.027085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:19.027782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.078435 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-59c0dc4a-1608-48de-9691-949aae914604 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.8498149 Nov 24 04:11:19.082911 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59604) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:19.098318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router c75d89d7-ce43-46a1-b7ab-9bc683d54469 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:11:19.125228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] For port 54859d9a-62e2-4f7f-9a05-2f76d9588a51, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:19.135497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.138233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a3d95fa-ee56-4b69-8b77-7b292be52926 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:19.138974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.141599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.141835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.143024 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-89806e90-5ca2-4b19-a11f-b3bee284da48 tempest-FloatingIPAdminTestJSON-1147458571 tempest-FloatingIPAdminTestJSON-1147458571-project] 10.222.0.48 "DELETE /v2.0/floatingips/75e8d6c7-c533-487d-b625-338e82e80425 HTTP/1.1" status: 204 len: 168 time: 1.1536312 Nov 24 04:11:19.146143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59606) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:19.150893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] For port 54859d9a-62e2-4f7f-9a05-2f76d9588a51, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=54859d9a-62e2-4f7f-9a05-2f76d9588a51,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:19.152840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.155543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-332451de-ceda-41c1-9e8d-a59ae15db86a None None] DHCP port deletion for 3779787c-a1ad-4c57-b149-36324ecb887c request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:19.163982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c7b72afd-5eff-4e9b-9c71-fa94eafa0e70 None None] Provisioning complete for port b78541a2-0f49-4af7-ad65-5fa417c7eb75 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:19.164338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7b72afd-5eff-4e9b-9c71-fa94eafa0e70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.204778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.214008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.219503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c7b72afd-5eff-4e9b-9c71-fa94eafa0e70 None None] Port b78541a2-0f49-4af7-ad65-5fa417c7eb75 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:19.228251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.243759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Network 576cb395-ded1-477d-9995-f33c4a213744 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:19.276119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:19.282544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:19.291277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] No DVR routers for this DVR port e5d07f5f-eb23-4854-b67a-826db43b2805 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:19.311327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.324052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Network ca5caa7b-94b2-48b9-84dd-86a99428346e is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:19.353463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:19.393766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:19.408038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Deleting port 33e22ed7-6657-4d2a-9f8f-85c3830eeff6 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:19.408391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.415018 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Pushing event updated for resources: {'Port': ['ID=40d45a41-d786-45df-9c60-5edc8d385bcd,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:19.457581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Port': ['ID=e5d07f5f-eb23-4854-b67a-826db43b2805,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:19.517056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Attempting to bind port 40d45a41-d786-45df-9c60-5edc8d385bcd on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:19.517438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Attempting to bind port 40d45a41-d786-45df-9c60-5edc8d385bcd by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'f93a35f0-1446-47aa-a2ad-98a906e6633e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '576cb395-ded1-477d-9995-f33c4a213744'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:19.517815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Attempting to bind port 40d45a41-d786-45df-9c60-5edc8d385bcd on network 576cb395-ded1-477d-9995-f33c4a213744 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:19.529860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-88bfd93d-2b76-48b7-9c12-39d6f557fb82 None None] Provisioning complete for port 7259cabb-83db-4063-84a3-d1c6aa82e64b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:19.530236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-88bfd93d-2b76-48b7-9c12-39d6f557fb82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.558639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.605314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:19.605483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Checking segment: {'id': 'f93a35f0-1446-47aa-a2ad-98a906e6633e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '576cb395-ded1-477d-9995-f33c4a213744'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:19.608251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.608251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Bound using segment: {'id': 'f93a35f0-1446-47aa-a2ad-98a906e6633e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '576cb395-ded1-477d-9995-f33c4a213744'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:19.608251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Bound port: 40d45a41-d786-45df-9c60-5edc8d385bcd, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f93a35f0-1446-47aa-a2ad-98a906e6633e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '576cb395-ded1-477d-9995-f33c4a213744'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:19.608251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.616064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.638281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.645405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3779787c-a1ad-4c57-b149-36324ecb887c']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:19.661727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.661988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Pushing event updated for resources: {'Port': ['ID=b5779290-e689-45bd-9358-645cd04f2d94,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:19.662081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.664063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59616) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:19.690567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.692363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Attempting to bind port b5779290-e689-45bd-9358-645cd04f2d94 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:19.692739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Attempting to bind port b5779290-e689-45bd-9358-645cd04f2d94 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '61dbc318-8659-4afc-87f8-16a415a0face', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:19.693111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Attempting to bind port b5779290-e689-45bd-9358-645cd04f2d94 on network ca5caa7b-94b2-48b9-84dd-86a99428346e {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:19.695269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:19.697296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e2d0adb-4d09-4c22-ab0c-9c06ac580e68') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:19.702885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Calling delete_port for 33e22ed7-6657-4d2a-9f8f-85c3830eeff6 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:19.760693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:19.761070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Checking segment: {'id': '61dbc318-8659-4afc-87f8-16a415a0face', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:19.761485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.761889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Bound using segment: {'id': '61dbc318-8659-4afc-87f8-16a415a0face', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:19.763818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Bound port: b5779290-e689-45bd-9358-645cd04f2d94, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61dbc318-8659-4afc-87f8-16a415a0face', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': 'ca5caa7b-94b2-48b9-84dd-86a99428346e'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:19.764229 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.776170 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-88bfd93d-2b76-48b7-9c12-39d6f557fb82 None None] Port 7259cabb-83db-4063-84a3-d1c6aa82e64b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:19.776651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63d83f87-cbfb-4cbd-9d50-09274a12a01c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:19.783591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63d83f87-cbfb-4cbd-9d50-09274a12a01c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:19.793476 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-63d83f87-cbfb-4cbd-9d50-09274a12a01c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1668 time: 0.7025409 Nov 24 04:11:19.793476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.799157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59620) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:19.804393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Network 678bcab8-7e1c-4159-be72-7cecc4c12815 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:19.820721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:19.828588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:19.831726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.833404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:19.844615 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dd3b325b-837e-4574-b49c-487cee04d361 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/c75d89d7-ce43-46a1-b7ab-9bc683d54469/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1238046 Nov 24 04:11:19.852473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59622) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:19.864425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] Sync routers for ids ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:19.866599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e355113-dabe-446d-aee1-1fb0b041b9f6 None None] Pushing event updated for resources: {'Port': ['ID=54859d9a-62e2-4f7f-9a05-2f76d9588a51,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:19.867579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Releasing vlan 163 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:19.869078 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:19.873424 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:19.887857 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] For port 40d45a41-d786-45df-9c60-5edc8d385bcd, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:19.889757 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:19.960959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9ec437d4-e363-4022-bf43-4fe4f128b441 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:19.962227 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-9ec437d4-e363-4022-bf43-4fe4f128b441 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 24 04:11:19.967151 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-9ec437d4-e363-4022-bf43-4fe4f128b441 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 04:11:19.967151 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9ec437d4-e363-4022-bf43-4fe4f128b441 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.2960925 Nov 24 04:11:19.967369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] For port 40d45a41-d786-45df-9c60-5edc8d385bcd, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=40d45a41-d786-45df-9c60-5edc8d385bcd,segment=NetworkSegment(f93a35f0-1446-47aa-a2ad-98a906e6633e),segment_id=f93a35f0-1446-47aa-a2ad-98a906e6633e)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:19.969560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59624) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:19.992471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] Routers {'c75d89d7-ce43-46a1-b7ab-9bc683d54469'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:19.994094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:20.008852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--341562657'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:20.017104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.030710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10ed8417-b06d-4964-bad9-51ad9aef89ab tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:20.032218 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-10ed8417-b06d-4964-bad9-51ad9aef89ab tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports/b78541a2-0f49-4af7-ad65-5fa417c7eb75 HTTP/1.1" status: 200 len: 976 time: 0.1790106 Nov 24 04:11:20.039332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:20.057484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.069317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Attempting to bind port fe3b0cc9-a8a2-4a5c-810c-925ef62de248 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:20.069701 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Attempting to bind port fe3b0cc9-a8a2-4a5c-810c-925ef62de248 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '7119cc55-8fd5-45c8-9928-d4097d1405e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:20.070070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Attempting to bind port fe3b0cc9-a8a2-4a5c-810c-925ef62de248 on network 678bcab8-7e1c-4159-be72-7cecc4c12815 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:20.079336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:20.085603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Pushing event updated for resources: {'Port': ['ID=fe3b0cc9-a8a2-4a5c-810c-925ef62de248,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:20.093986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:20.094969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Checking segment: {'id': '7119cc55-8fd5-45c8-9928-d4097d1405e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:20.095913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.096508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Bound using segment: {'id': '7119cc55-8fd5-45c8-9928-d4097d1405e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:20.096995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Bound port: fe3b0cc9-a8a2-4a5c-810c-925ef62de248, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7119cc55-8fd5-45c8-9928-d4097d1405e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '678bcab8-7e1c-4159-be72-7cecc4c12815'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:20.097581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.146624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.152270 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] 10.222.0.48 "DELETE /v2.0/networks/3779787c-a1ad-4c57-b149-36324ecb887c HTTP/1.1" status: 204 len: 168 time: 2.1152277 Nov 24 04:11:20.154054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6bb67d-b246-40af-83ca-9406b41a7c4e tempest-AllowedAddressPairTestJSON-1538208947 tempest-AllowedAddressPairTestJSON-1538208947-project] Pushing event deleted for resources: {'Network': ['ID=3779787c-a1ad-4c57-b149-36324ecb887c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:20.172352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] Routers {'c75d89d7-ce43-46a1-b7ab-9bc683d54469'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:20.173082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:20.179431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.186771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.224128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:20.225048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65f17739-1f44-4e78-b9c9-ced081b38383 None None] The sync data for ids ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:20.237811 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] For port b5779290-e689-45bd-9358-645cd04f2d94, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:20.245983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Subnet': ['ID=2489251e-27ed-4dc2-8cb3-bd7243e27b2d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:20.250829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.262405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.265703 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b34b3071-9b9b-4043-89b7-f0f5f61178a0 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/subnets/2489251e-27ed-4dc2-8cb3-bd7243e27b2d HTTP/1.1" status: 204 len: 168 time: 2.4619699 Nov 24 04:11:20.273811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59630) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:20.303962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] For port b5779290-e689-45bd-9358-645cd04f2d94, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b5779290-e689-45bd-9358-645cd04f2d94,segment=NetworkSegment(61dbc318-8659-4afc-87f8-16a415a0face),segment_id=61dbc318-8659-4afc-87f8-16a415a0face)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:20.343384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.348249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] For port fe3b0cc9-a8a2-4a5c-810c-925ef62de248, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:20.358084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa396d2-a40b-48f3-b40c-1b967a2efb60 None None] Pushing event updated for resources: {'Port': ['ID=40d45a41-d786-45df-9c60-5edc8d385bcd,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:20.368540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] For port fe3b0cc9-a8a2-4a5c-810c-925ef62de248, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe3b0cc9-a8a2-4a5c-810c-925ef62de248,segment=NetworkSegment(7119cc55-8fd5-45c8-9928-d4097d1405e0),segment_id=7119cc55-8fd5-45c8-9928-d4097d1405e0)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:20.438026 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.474387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 54859d9a-62e2-4f7f-9a05-2f76d9588a51 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:20.508332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:20.508957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.610913 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Deleting subnet 1af2bc28-bce6-41bf-8c96-2fe2e1e1b4f8 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:20.617245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.631045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa54e39-cd3a-4b9f-8a83-b8ca182b90cb None None] Pushing event updated for resources: {'Port': ['ID=b5779290-e689-45bd-9358-645cd04f2d94,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:20.707982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.737798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.797502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59634) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:20.821559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38e4833-0fc0-425f-8fda-10714cf2ad9d None None] Pushing event updated for resources: {'Port': ['ID=fe3b0cc9-a8a2-4a5c-810c-925ef62de248,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:20.847682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:20.848327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.923396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.961463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:20.982986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:21.057185 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.124362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.168141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 54859d9a-62e2-4f7f-9a05-2f76d9588a51, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=54859d9a-62e2-4f7f-9a05-2f76d9588a51,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:21.176886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.236116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.252413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.255613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.296433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-308d3c48-0630-4036-9f31-aa3750774f06 None None] Provisioning complete for port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:21.297027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-308d3c48-0630-4036-9f31-aa3750774f06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.312450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Pushing event deleted for resources: {'Port': ['ID=33e22ed7-6657-4d2a-9f8f-85c3830eeff6,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:21.355821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Subnet': ['ID=1af2bc28-bce6-41bf-8c96-2fe2e1e1b4f8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:21.371322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.376949 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6e13eee0-1c09-4dcc-9509-b92642e2df40 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/subnets/1af2bc28-bce6-41bf-8c96-2fe2e1e1b4f8 HTTP/1.1" status: 204 len: 168 time: 1.0967896 Nov 24 04:11:21.380686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e5d07f5f-eb23-4854-b67a-826db43b2805 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:21.386871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59638) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.419532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e5d07f5f-eb23-4854-b67a-826db43b2805 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:21.419792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=28c45979-da3c-421e-92e8-051a6aadb8b8,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:21.420403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e5d07f5f-eb23-4854-b67a-826db43b2805 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:21.454836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=54859d9a-62e2-4f7f-9a05-2f76d9588a51,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:21.496218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.499305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.501882 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-600f925d-0f2b-4db2-9e95-a273d59328c6 tempest-FloatingIPAdminTestJSON-1595792817 tempest-FloatingIPAdminTestJSON-1595792817-project-admin] 10.222.0.48 "DELETE /v2.0/floatingips/c67eefc5-f1a7-43bc-9f1e-22a6b1f773d6 HTTP/1.1" status: 204 len: 168 time: 2.3547540 Nov 24 04:11:21.510466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59640) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.521974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.538768 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-815143b1-bf25-4824-93e8-77c1b6c7ef1b admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=7e2a6f6d5f1e47fe8be50180d1a55cf4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7337036 Nov 24 04:11:21.549508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59642) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.576774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e736d2a-d521-4b24-ba39-d2249aaa75d9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:21.579197 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7e736d2a-d521-4b24-ba39-d2249aaa75d9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1891351 Nov 24 04:11:21.585555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59644) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.606520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.622548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.655141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3e022b41-7df3-4749-aba0-cffea848a2b8,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:21.660146 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.678275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1909a612-15f7-4dcc-ab88-71c77b5645eb None None] Could not find standard attr ID for object b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:11:21.698749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:21.706546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.712846 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c72b4a6c-2edc-42eb-ae9a-e2dcc3bc0e89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31 HTTP/1.1" status: 204 len: 168 time: 1.9077113 Nov 24 04:11:21.712998 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.715603 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-002246e8-c4f6-4747-bc97-63f4f48e7ee3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.7414906 Nov 24 04:11:21.716327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59646) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.716761 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59648) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.759347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '3e022b41-7df3-4749-aba0-cffea848a2b8', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:21.823983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.844908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:21.847931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router 77998923-4d69-4ee7-8022-cc3100950059 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:11:21.877036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee27263c-77e1-479d-99bc-d2423082a975 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:21.879285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee27263c-77e1-479d-99bc-d2423082a975 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:21.884128 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ee27263c-77e1-479d-99bc-d2423082a975 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.1367991 Nov 24 04:11:21.888684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59650) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:21.917949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-630416d0-ac1e-4292-ada2-af53a9d1c2ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.001068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-630416d0-ac1e-4292-ada2-af53a9d1c2ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.004874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting port 8f427559-22cc-4889-9eed-69d7572e4552 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:22.005141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.029268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet eb0bc524-c90e-4c1c-a020-88bfe7695242 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:22.105705 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5948db41-1917-4f62-abef-47af2574ae20 None None] Network 576cb395-ded1-477d-9995-f33c4a213744 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:22.154955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Deleting port fe3b0cc9-a8a2-4a5c-810c-925ef62de248 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:22.155322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.185172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:22.201223 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] Sync routers for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:22.239754 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:22.240659 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:22.270162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.275507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f0636630-5729-4bc7-ab3c-94e85ec3bcef None None] Provisioning complete for port 40d45a41-d786-45df-9c60-5edc8d385bcd triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:22.276016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f0636630-5729-4bc7-ab3c-94e85ec3bcef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.299678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-630416d0-ac1e-4292-ada2-af53a9d1c2ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.302426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-630416d0-ac1e-4292-ada2-af53a9d1c2ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.306029 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-630416d0-ac1e-4292-ada2-af53a9d1c2ef admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/43b9b4a5-2fd5-4ff7-946e-52606e2fe7ea HTTP/1.1" status: 204 len: 168 time: 0.7191238 Nov 24 04:11:22.339519 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:22.356964 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:22.358124 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:22.366597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] For port fe3b0cc9-a8a2-4a5c-810c-925ef62de248, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe3b0cc9-a8a2-4a5c-810c-925ef62de248,segment=NetworkSegment(7119cc55-8fd5-45c8-9928-d4097d1405e0),segment_id=7119cc55-8fd5-45c8-9928-d4097d1405e0)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:22.366931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.372969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-630416d0-ac1e-4292-ada2-af53a9d1c2ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43b9b4a5-2fd5-4ff7-946e-52606e2fe7ea,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:22.393319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Calling delete_port for 8f427559-22cc-4889-9eed-69d7572e4552 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:22.403367 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.408092 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ffc7eb30-9ee9-4490-824b-801923c7c05a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 5.6270421 Nov 24 04:11:22.413193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59654) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:22.421178 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:22.422402 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a65f6225-3b59-4ea0-a9fa-77eb65dc0386 None None] The sync data for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:22.448072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54dd0971-7f50-4b52-ad4c-99675515f1de None None] Network ca5caa7b-94b2-48b9-84dd-86a99428346e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:22.454455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Calling delete_port for fe3b0cc9-a8a2-4a5c-810c-925ef62de248 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:22.521226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.586998 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.599784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.633181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.693171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.694061 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9486129 Nov 24 04:11:22.725549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59660) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:22.749766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5779290-e689-45bd-9358-645cd04f2d94 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:22.750621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.759171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f0636630-5729-4bc7-ab3c-94e85ec3bcef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.780644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-398ae00d-11ec-403d-a253-2952ac28c9c1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '3e022b41-7df3-4749-aba0-cffea848a2b8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:22.863457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f10e06-5229-44b3-9677-08be244a97c2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d071f7c-c116-4018-94aa-52db68f52a31,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:22.903149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f0636630-5729-4bc7-ab3c-94e85ec3bcef None None] For port 40d45a41-d786-45df-9c60-5edc8d385bcd, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=40d45a41-d786-45df-9c60-5edc8d385bcd,segment=NetworkSegment(f93a35f0-1446-47aa-a2ad-98a906e6633e),segment_id=f93a35f0-1446-47aa-a2ad-98a906e6633e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:22.917574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Port': ['ID=fe3b0cc9-a8a2-4a5c-810c-925ef62de248,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:22.920534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f0636630-5729-4bc7-ab3c-94e85ec3bcef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.928172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b5779290-e689-45bd-9358-645cd04f2d94 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:22.928556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:22.936251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-398ae00d-11ec-403d-a253-2952ac28c9c1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.009189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.060903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] DHCP port deletion for ca5caa7b-94b2-48b9-84dd-86a99428346e request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:23.113965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port b78541a2-0f49-4af7-ad65-5fa417c7eb75 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:23.114200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.114665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] No DVR routers for this DVR port fe3b0cc9-a8a2-4a5c-810c-925ef62de248 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:23.151250 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-398ae00d-11ec-403d-a253-2952ac28c9c1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 04:11:23.155577 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-398ae00d-11ec-403d-a253-2952ac28c9c1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.4287930 Nov 24 04:11:23.156200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59670) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.249780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.270211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfc3b646-76c2-4def-920c-416abf84cfc8 None None] Network 678bcab8-7e1c-4159-be72-7cecc4c12815 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:23.325294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=eb0bc524-c90e-4c1c-a020-88bfe7695242,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:23.351526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.357627 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9d32b841-c002-48a5-af10-095d83d571a3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/eb0bc524-c90e-4c1c-a020-88bfe7695242 HTTP/1.1" status: 204 len: 168 time: 1.4637816 Nov 24 04:11:23.359653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59676) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.380040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0636630-5729-4bc7-ab3c-94e85ec3bcef None None] Pushing event updated for resources: {'Port': ['ID=40d45a41-d786-45df-9c60-5edc8d385bcd,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:23.382739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ee37f69-db45-4ee3-80ab-fda354331c08 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:23.386597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.389797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-be180061-2c1d-4fe9-9b8a-34d15895001f None None] Provisioning complete for port b5779290-e689-45bd-9358-645cd04f2d94 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:23.390191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be180061-2c1d-4fe9-9b8a-34d15895001f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.434252 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b3ab58e9-6e56-4c96-871c-88e162102432 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0701232 Nov 24 04:11:23.440857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59680) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.442118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for b78541a2-0f49-4af7-ad65-5fa417c7eb75 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:23.468013 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.493289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d4ddf513-88e9-415e-a44a-5a3fe1817b76 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.544364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e663b6f-f706-4161-a9c1-8143dde707bc req-75604bff-21d2-4974-9bd5-4c87f46483ab tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:23.553071 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7e663b6f-f706-4161-a9c1-8143dde707bc req-75604bff-21d2-4974-9bd5-4c87f46483ab tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2732270 Nov 24 04:11:23.613380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d4ddf513-88e9-415e-a44a-5a3fe1817b76 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.619549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] Deleting port b5779290-e689-45bd-9358-645cd04f2d94 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:23.619954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.635279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.644379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59684) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.685033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1ea7e0a-9557-4167-a48b-27571f63bfd9 None None] DHCP port deletion for 678bcab8-7e1c-4159-be72-7cecc4c12815 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:23.690775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f96b053c-cc4f-4164-9bc0-764d4aaf08ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:23.694670 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f96b053c-cc4f-4164-9bc0-764d4aaf08ff tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2485240 Nov 24 04:11:23.707980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59688) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.787625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be180061-2c1d-4fe9-9b8a-34d15895001f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.817708 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7e663b6f-f706-4161-a9c1-8143dde707bc req-9f42f936-c6d1-4beb-99d4-ce4fda6def8e tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2605348 Nov 24 04:11:23.824874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port b5779290-e689-45bd-9358-645cd04f2d94, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b5779290-e689-45bd-9358-645cd04f2d94,segment=NetworkSegment(61dbc318-8659-4afc-87f8-16a415a0face),segment_id=61dbc318-8659-4afc-87f8-16a415a0face)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:23.832171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] For port b5779290-e689-45bd-9358-645cd04f2d94, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b5779290-e689-45bd-9358-645cd04f2d94,segment=NetworkSegment(61dbc318-8659-4afc-87f8-16a415a0face),segment_id=61dbc318-8659-4afc-87f8-16a415a0face)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:23.832579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.850991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.851786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 54859d9a-62e2-4f7f-9a05-2f76d9588a51 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:23.858566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['678bcab8-7e1c-4159-be72-7cecc4c12815']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:23.880806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d4ddf513-88e9-415e-a44a-5a3fe1817b76 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.885441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7119cc55-8fd5-45c8-9928-d4097d1405e0') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:23.885698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7119cc55-8fd5-45c8-9928-d4097d1405e0') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:23.892152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d4ddf513-88e9-415e-a44a-5a3fe1817b76 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.896661 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d4ddf513-88e9-415e-a44a-5a3fe1817b76 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/3e022b41-7df3-4749-aba0-cffea848a2b8 HTTP/1.1" status: 204 len: 168 time: 0.7329271 Nov 24 04:11:23.902372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.903314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59692) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.912524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1c9becd-7132-44d2-959f-5a16e717340b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:23.913741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:23.920432 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b1c9becd-7132-44d2-959f-5a16e717340b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2049675 Nov 24 04:11:23.925859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] Calling delete_port for b5779290-e689-45bd-9358-645cd04f2d94 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:23.928583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59694) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:23.932930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-1029470360'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:23.951801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:23.987519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ddf513-88e9-415e-a44a-5a3fe1817b76 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e022b41-7df3-4749-aba0-cffea848a2b8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.039458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Made reservation on behalf of 8db89885a5504d4e9a252230afb74a38 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:24.043457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.057577 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-39659b78-885e-4c66-a4f5-fe3c89f30d0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1173997 Nov 24 04:11:24.057577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Port': ['ID=8f427559-22cc-4889-9eed-69d7572e4552,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.058715 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59696) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:24.061915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.069826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:24.074235 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-32074b10-91d8-4b5f-9509-45e40051c506 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1547401 Nov 24 04:11:24.075626 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59698) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:24.076281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=b5779290-e689-45bd-9358-645cd04f2d94,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.077249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.090265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--980990879'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:24.093243 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-be180061-2c1d-4fe9-9b8a-34d15895001f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:11:24.093608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-be180061-2c1d-4fe9-9b8a-34d15895001f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:11:24.113470 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Releasing vlan 167 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:24.113878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.114099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:24.124183 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:24.130020 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:24.130887 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.165843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=b78541a2-0f49-4af7-ad65-5fa417c7eb75,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.200292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] Deleting port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:24.200768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.205621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.230749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.274102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] Pushing event deleted for resources: {'Port': ['ID=b5779290-e689-45bd-9358-645cd04f2d94,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.276859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-799ec4b1-ee02-4ebf-b672-8c58fdcf2fc3 None None] No DVR routers for this DVR port b5779290-e689-45bd-9358-645cd04f2d94 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:24.369611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.379846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] For port 54859d9a-62e2-4f7f-9a05-2f76d9588a51, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=54859d9a-62e2-4f7f-9a05-2f76d9588a51,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:24.380996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.407841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] Calling delete_port for 54859d9a-62e2-4f7f-9a05-2f76d9588a51 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:24.415322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b0b150b-6d67-40c4-93f8-7b77a55dbd19 req-af84dbc1-36c2-43fa-83fc-6430fd1b1b96 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:24.417089 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1b0b150b-6d67-40c4-93f8-7b77a55dbd19 req-af84dbc1-36c2-43fa-83fc-6430fd1b1b96 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.4663336 Nov 24 04:11:24.419528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 40d45a41-d786-45df-9c60-5edc8d385bcd up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:24.484310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.493929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.538608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.542896 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-57e51782-11c0-4bb9-ba31-0d9d32bd55ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "DELETE /v2.0/ports/8f427559-22cc-4889-9eed-69d7572e4552 HTTP/1.1" status: 204 len: 168 time: 3.0313580 Nov 24 04:11:24.543998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.547432 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/networks/678bcab8-7e1c-4159-be72-7cecc4c12815 HTTP/1.1" status: 204 len: 168 time: 2.9258313 Nov 24 04:11:24.561230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59700) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:24.561574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59702) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:24.578173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 40d45a41-d786-45df-9c60-5edc8d385bcd triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:24.578352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.606124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.607467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.617391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e268a5d5-4cb5-4ab3-98ae-e4e94bc0f93b tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Network': ['ID=678bcab8-7e1c-4159-be72-7cecc4c12815,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.624751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] vlan segment allocate from pool success with {'vlan_id': 173, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:24.654553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.655265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-be180061-2c1d-4fe9-9b8a-34d15895001f None None] Port b5779290-e689-45bd-9358-645cd04f2d94 update to ACTIVE by agent not found {{(pid=103382) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 24 04:11:24.655377 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:24.655896 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Added segment 8f75a18a-e078-41aa-a4c8-a74d69187b2b of type vlan for network f6ea1335-20cd-45da-89a1-ce46f850403e Nov 24 04:11:24.658929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.661783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.662199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] Pushing event deleted for resources: {'Port': ['ID=54859d9a-62e2-4f7f-9a05-2f76d9588a51,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.671631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-167f9897-cddd-4e79-ad46-cb7d31ad9e45 None None] No DVR routers for this DVR port 54859d9a-62e2-4f7f-9a05-2f76d9588a51 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:24.676256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.708723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.715633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1b0b150b-6d67-40c4-93f8-7b77a55dbd19 req-86658f63-caf3-4878-bced-943e9b35d1f7 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2687416 Nov 24 04:11:24.722913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe3b0cc9-a8a2-4a5c-810c-925ef62de248 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:24.748116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fe3b0cc9-a8a2-4a5c-810c-925ef62de248 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:24.748609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe3b0cc9-a8a2-4a5c-810c-925ef62de248 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:11:24.775815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port fe3b0cc9-a8a2-4a5c-810c-925ef62de248 not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:11:24.786781 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-711ab664-89a5-4801-b2c7-c17738b86b80 None None] Provisioning complete for port 40d45a41-d786-45df-9c60-5edc8d385bcd triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:24.787172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-711ab664-89a5-4801-b2c7-c17738b86b80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.903937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-711ab664-89a5-4801-b2c7-c17738b86b80 None None] Could not find standard attr ID for object fe3b0cc9-a8a2-4a5c-810c-925ef62de248. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:11:24.908802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d15877f7-8590-4191-b04b-bf0f7388df80,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:24.920418 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 40d45a41-d786-45df-9c60-5edc8d385bcd up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:24.935753 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.950339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.954724 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.8684492 Nov 24 04:11:24.960137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59708) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:24.970187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2d75c941-1991-4633-99c9-4192c49cc29b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '2cc77490-f651-4cd4-9a41-cbc1d8e9f7c8', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:24.971202 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-2d75c941-1991-4633-99c9-4192c49cc29b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Nov 24 04:11:24.971874 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-2d75c941-1991-4633-99c9-4192c49cc29b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:24.974607 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2d75c941-1991-4633-99c9-4192c49cc29b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0132411 Nov 24 04:11:24.979176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59710) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:24.980966 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 40d45a41-d786-45df-9c60-5edc8d385bcd triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:24.981336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:24.983628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router c75d89d7-ce43-46a1-b7ab-9bc683d54469 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:25.024500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c89a5f-9150-4c6e-967b-e5aadba96f48 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2cc77490-f651-4cd4-9a41-cbc1d8e9f7c8,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:25.046544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.052140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:25.052815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.083016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f83963-a719-44d8-8bce-d54cc5c45833 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:25.087560 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e3f83963-a719-44d8-8bce-d54cc5c45833 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "GET /v2.0/ports?device_id=5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 HTTP/1.1" status: 200 len: 913 time: 0.5179961 Nov 24 04:11:25.095966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59712) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.135590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.139875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe3b0cc9-a8a2-4a5c-810c-925ef62de248 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:25.163099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fe3b0cc9-a8a2-4a5c-810c-925ef62de248 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:25.163444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe3b0cc9-a8a2-4a5c-810c-925ef62de248 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:25.164150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5779290-e689-45bd-9358-645cd04f2d94 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:25.165589 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 1.5180318 Nov 24 04:11:25.173434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59714) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.191347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b5779290-e689-45bd-9358-645cd04f2d94 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:25.191983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5779290-e689-45bd-9358-645cd04f2d94 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:25.192583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 54859d9a-62e2-4f7f-9a05-2f76d9588a51 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:25.215748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Request body: {'subnet': {'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:25.217338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 54859d9a-62e2-4f7f-9a05-2f76d9588a51 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:25.217772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 54859d9a-62e2-4f7f-9a05-2f76d9588a51 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:25.219254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:25.234201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] Sync routers for ids ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:25.243102 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-62097328-27f3-4e4b-b1ba-215728254679 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/c75d89d7-ce43-46a1-b7ab-9bc683d54469/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1989429 Nov 24 04:11:25.244269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-318ab39f-6752-4715-9cff-de2d79bc3881 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event updated for resources: {'Network': ['ID=f6ea1335-20cd-45da-89a1-ce46f850403e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:25.244602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] Routers {'c75d89d7-ce43-46a1-b7ab-9bc683d54469'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:25.245414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.247024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59716) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.261519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4e351ab-c850-4d0a-b5a3-c68b29644b2a req-5f591006-f20b-4903-80fa-35adaa625256 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:25.271825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e0ff930-6460-403e-a0f1-b774211cded9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.275204 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e4e351ab-c850-4d0a-b5a3-c68b29644b2a req-5f591006-f20b-4903-80fa-35adaa625256 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2798312 Nov 24 04:11:25.292910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network f6ea1335-20cd-45da-89a1-ce46f850403e details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:25.295844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.355048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] Routers {'c75d89d7-ce43-46a1-b7ab-9bc683d54469'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:25.355919 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.403787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.404694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab7d60d4-9fec-426c-a90a-616299d1cc42 None None] The sync data for ids ['c75d89d7-ce43-46a1-b7ab-9bc683d54469'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:25.429068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e0ff930-6460-403e-a0f1-b774211cded9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.486097 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e4e351ab-c850-4d0a-b5a3-c68b29644b2a req-43a09161-0ad5-4a57-a75a-4f083f4b95ad tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2100036 Nov 24 04:11:25.527229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.1 (576cb395-ded1-477d-9995-f33c4a213744/f9d3412a-812d-4e31-868b-465c8722aabb/684738f9-c16f-4f7d-bb3b-f152072ccfde) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:25.530436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.541526 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-c18f3c08-5ffc-4d3c-a52a-3da91c7493f9 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] remove_router_interface failed (client error): The resource could not be found. Nov 24 04:11:25.542610 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c18f3c08-5ffc-4d3c-a52a-3da91c7493f9 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/c75d89d7-ce43-46a1-b7ab-9bc683d54469/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.2890768 Nov 24 04:11:25.545177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Made reservation on behalf of 8db89885a5504d4e9a252230afb74a38 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:25.547655 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.551871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59718) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.603550 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f0a32072-c319-4704-970e-6d18932dbb1d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=c75d89d7-ce43-46a1-b7ab-9bc683d54469 HTTP/1.1" status: 200 len: 205 time: 0.0479832 Nov 24 04:11:25.604128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e0ff930-6460-403e-a0f1-b774211cded9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.606579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e0ff930-6460-403e-a0f1-b774211cded9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.610171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca5caa7b-94b2-48b9-84dd-86a99428346e']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.610328 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9e0ff930-6460-403e-a0f1-b774211cded9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/2cc77490-f651-4cd4-9a41-cbc1d8e9f7c8 HTTP/1.1" status: 204 len: 168 time: 0.6228020 Nov 24 04:11:25.610414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59720) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.610514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59722) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.659424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0ff930-6460-403e-a0f1-b774211cded9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cc77490-f651-4cd4-9a41-cbc1d8e9f7c8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:25.711043 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-734d63fb-64f6-4ce8-964b-ed2b5395652b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0970595 Nov 24 04:11:25.714614 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59724) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:25.718895 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--1000429478'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:25.724057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '61dbc318-8659-4afc-87f8-16a415a0face') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.724361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '61dbc318-8659-4afc-87f8-16a415a0face') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:25.776560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.785297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.837986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.922317 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event updated for resources: {'Subnet': ['ID=3447438c-c0b6-443e-9b6b-d1bb16b1ec98,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:25.945997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Checking segment: {'id': '8f75a18a-e078-41aa-a4c8-a74d69187b2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:25.946301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Network hostable DHCP agents. Network: f6ea1335-20cd-45da-89a1-ce46f850403e, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:25.960051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.965195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:25.989677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Network f6ea1335-20cd-45da-89a1-ce46f850403e is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:26.007201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.008493 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.2929523 Nov 24 04:11:26.011646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6abf25af-4b5d-4907-a332-d07b5e5ad764 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=00bfcbe7-7aac-4ecf-8989-08f2453d9a71,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:26.013635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59726) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.018784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-bdea04a0-0364-4d4c-8e00-5132eb848163 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '00bfcbe7-7aac-4ecf-8989-08f2453d9a71', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.019669 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-bdea04a0-0364-4d4c-8e00-5132eb848163 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Nov 24 04:11:26.020221 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-bdea04a0-0364-4d4c-8e00-5132eb848163 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:26.021153 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bdea04a0-0364-4d4c-8e00-5132eb848163 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0065229 Nov 24 04:11:26.022018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, f6ea1335-20cd-45da-89a1-ce46f850403e) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:26.024038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59728) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.032019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d694cc07-26bd-4d59-9eda-3d981192ec6d None None] Network f6ea1335-20cd-45da-89a1-ce46f850403e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:26.035569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:26.036395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.067774 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1b23cb34-c6ed-4c5d-ad29-905eb5d309a7 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8612571 Nov 24 04:11:26.070415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59730) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.079243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Request body: {'port': {'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e', 'name': 'tempest-ExtraDHCPOptionsTestJSON-239070458'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.102586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.105354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.157129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6eb4dc7a-3a84-48f4-bc28-0ba4bf33badc tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.181012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Releasing vlan 170 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:26.181821 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:26.190366 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:26.194544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6eb4dc7a-3a84-48f4-bc28-0ba4bf33badc tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.212005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31152839-2194-40b0-905b-520676b8c760 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-f6ea1335-20cd-45da-89a1-ce46f850403e', 'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e', 'tenant_id': '8db89885a5504d4e9a252230afb74a38', 'fixed_ips': [{'subnet_id': '3447438c-c0b6-443e-9b6b-d1bb16b1ec98'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:26.213015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31152839-2194-40b0-905b-520676b8c760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.269013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Made reservation on behalf of 8db89885a5504d4e9a252230afb74a38 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:26.272642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.285796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6eb4dc7a-3a84-48f4-bc28-0ba4bf33badc tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.290471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6eb4dc7a-3a84-48f4-bc28-0ba4bf33badc tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.291765 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6eb4dc7a-3a84-48f4-bc28-0ba4bf33badc tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/00bfcbe7-7aac-4ecf-8989-08f2453d9a71 HTTP/1.1" status: 204 len: 168 time: 0.2665510 Nov 24 04:11:26.298904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59732) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.316900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eb4dc7a-3a84-48f4-bc28-0ba4bf33badc tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=00bfcbe7-7aac-4ecf-8989-08f2453d9a71,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:26.319805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] device_id is not set on port efbdcd7a-33b7-4d00-8a27-7664c90cec5b yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:26.412172 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ddff5f32-1935-4197-b3e0-f801d3be37e9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1079171 Nov 24 04:11:26.413633 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59734) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.418816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--739965442'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.436048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.443458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.445621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.457882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.466741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.470561 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/networks/ca5caa7b-94b2-48b9-84dd-86a99428346e HTTP/1.1" status: 204 len: 168 time: 1.8768132 Nov 24 04:11:26.471957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.473233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59736) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.491105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:11:26.523576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.533953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac72cc5b-5a47-4ed8-9257-156ba6747e37 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Network': ['ID=ca5caa7b-94b2-48b9-84dd-86a99428346e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:26.553498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-31152839-2194-40b0-905b-520676b8c760 None None] Allocated IP 172.20.0.2 (f6ea1335-20cd-45da-89a1-ce46f850403e/3447438c-c0b6-443e-9b6b-d1bb16b1ec98/ad6b595f-d532-4631-a472-9bac2d6635e5) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:26.592097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.647010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.658340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.667319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:26.671595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.672018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router c75d89d7-ce43-46a1-b7ab-9bc683d54469 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:11:26.682615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.683845 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-434483fd-7777-4d47-9de6-de35a31afb03 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/c75d89d7-ce43-46a1-b7ab-9bc683d54469 HTTP/1.1" status: 204 len: 168 time: 1.0734215 Nov 24 04:11:26.684696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:26.694492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59740) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.696412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:26.697006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.701960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2af3f24b-ccae-46b7-9427-069c7a8056c9 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:26.702680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa5488b-204a-4d94-93d6-21a7d45ebdf8 req-a58d71e6-0f50-4e1c-828d-c6a02ce5cb59 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:26.704210 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8fa5488b-204a-4d94-93d6-21a7d45ebdf8 req-a58d71e6-0f50-4e1c-828d-c6a02ce5cb59 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1086264 Nov 24 04:11:26.748417 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=291d6211-bfb7-45e5-a876-477d327b329f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:26.749511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3a00bae9-47f3-445a-a5b8-f510d01e5044,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:26.751046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.753594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.759122 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-99755a7b-b5c2-492e-9e81-dd7e36a47b5b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.3424585 Nov 24 04:11:26.761417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59742) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.773649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-bee41e79-3b15-4e97-b5b8-2d6b3911bd50 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '3a00bae9-47f3-445a-a5b8-f510d01e5044', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.777011 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b3f02ed2-4671-4d07-9135-3b2daa5592e6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.7119946 Nov 24 04:11:26.785443 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-bee41e79-3b15-4e97-b5b8-2d6b3911bd50 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Nov 24 04:11:26.786034 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-bee41e79-3b15-4e97-b5b8-2d6b3911bd50 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:26.790013 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bee41e79-3b15-4e97-b5b8-2d6b3911bd50 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0265460 Nov 24 04:11:26.794962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59744) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.795301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59746) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.828091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network 576cb395-ded1-477d-9995-f33c4a213744 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:26.830322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1cf02737-5714-462a-91c7-8b0a9dff61da tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '3a00bae9-47f3-445a-a5b8-f510d01e5044', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.830993 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-1cf02737-5714-462a-91c7-8b0a9dff61da tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Nov 24 04:11:26.831849 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-1cf02737-5714-462a-91c7-8b0a9dff61da tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:26.832309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31152839-2194-40b0-905b-520676b8c760 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.835400 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1cf02737-5714-462a-91c7-8b0a9dff61da tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0380340 Nov 24 04:11:26.839648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.839876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet ac622e9a-0595-4421-8277-c93244989e08 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:26.848302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.848534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31152839-2194-40b0-905b-520676b8c760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.849002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59748) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.849911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:26.855441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.862424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b2b5f925-99c6-45c6-bc94-ae1784a778f3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '3a00bae9-47f3-445a-a5b8-f510d01e5044', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.864332 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-b2b5f925-99c6-45c6-bc94-ae1784a778f3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Nov 24 04:11:26.864836 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-b2b5f925-99c6-45c6-bc94-ae1784a778f3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:26.866102 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b2b5f925-99c6-45c6-bc94-ae1784a778f3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0137997 Nov 24 04:11:26.867006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:26.869549 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59750) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.895454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4cd68371-a54a-4b3e-9fbb-72a92ba94b49 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '3a00bae9-47f3-445a-a5b8-f510d01e5044', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:26.896320 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-4cd68371-a54a-4b3e-9fbb-72a92ba94b49 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Nov 24 04:11:26.896998 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-4cd68371-a54a-4b3e-9fbb-72a92ba94b49 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:26.898183 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4cd68371-a54a-4b3e-9fbb-72a92ba94b49 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0061784 Nov 24 04:11:26.913692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59752) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:26.955555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31152839-2194-40b0-905b-520676b8c760 None None] Network f6ea1335-20cd-45da-89a1-ce46f850403e is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:26.957806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:26.963217 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-31152839-2194-40b0-905b-520676b8c760 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:26.966050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31152839-2194-40b0-905b-520676b8c760 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:26.978570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31152839-2194-40b0-905b-520676b8c760 None None] Pushing event updated for resources: {'Port': ['ID=ad6b595f-d532-4631-a472-9bac2d6635e5,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:26.986862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.079429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-31152839-2194-40b0-905b-520676b8c760 None None] Attempting to bind port ad6b595f-d532-4631-a472-9bac2d6635e5 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:27.080176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-31152839-2194-40b0-905b-520676b8c760 None None] Attempting to bind port ad6b595f-d532-4631-a472-9bac2d6635e5 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8f75a18a-e078-41aa-a4c8-a74d69187b2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:27.080640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31152839-2194-40b0-905b-520676b8c760 None None] Attempting to bind port ad6b595f-d532-4631-a472-9bac2d6635e5 on network f6ea1335-20cd-45da-89a1-ce46f850403e {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:27.086416 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '291d6211-bfb7-45e5-a876-477d327b329f'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:27.087522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.089358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=684738f9-c16f-4f7d-bb3b-f152072ccfde,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:27.109087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31152839-2194-40b0-905b-520676b8c760 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:27.109809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31152839-2194-40b0-905b-520676b8c760 None None] Checking segment: {'id': '8f75a18a-e078-41aa-a4c8-a74d69187b2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:27.110443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31152839-2194-40b0-905b-520676b8c760 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.111303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31152839-2194-40b0-905b-520676b8c760 None None] Bound using segment: {'id': '8f75a18a-e078-41aa-a4c8-a74d69187b2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:27.112381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-31152839-2194-40b0-905b-520676b8c760 None None] Bound port: ad6b595f-d532-4631-a472-9bac2d6635e5, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8f75a18a-e078-41aa-a4c8-a74d69187b2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:27.113312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31152839-2194-40b0-905b-520676b8c760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.194544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.241773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6f0d72f4-b005-46e1-9ab5-12c6b1a85e8e None None] Provisioning complete for port 684738f9-c16f-4f7d-bb3b-f152072ccfde triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:27.242214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6f0d72f4-b005-46e1-9ab5-12c6b1a85e8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.291894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-31152839-2194-40b0-905b-520676b8c760 None None] For port ad6b595f-d532-4631-a472-9bac2d6635e5, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:27.301394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-31152839-2194-40b0-905b-520676b8c760 None None] For port ad6b595f-d532-4631-a472-9bac2d6635e5, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ad6b595f-d532-4631-a472-9bac2d6635e5,segment=NetworkSegment(8f75a18a-e078-41aa-a4c8-a74d69187b2b),segment_id=8f75a18a-e078-41aa-a4c8-a74d69187b2b)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:27.329794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.332059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31152839-2194-40b0-905b-520676b8c760 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.340929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4a08c23f-f6fd-42df-8ed7-4456f4d6ca68']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:27.346423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6f0d72f4-b005-46e1-9ab5-12c6b1a85e8e None None] Port 684738f9-c16f-4f7d-bb3b-f152072ccfde cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:27.369328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0bee7ee3-44c8-4ecd-bfa3-1b5f5b639a18') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:27.369926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0bee7ee3-44c8-4ecd-bfa3-1b5f5b639a18') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:27.374346 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8fa5488b-204a-4d94-93d6-21a7d45ebdf8 req-719f5993-5fbf-4b16-b298-4db977a234fa tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6456678 Nov 24 04:11:27.412230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.416258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31152839-2194-40b0-905b-520676b8c760 None None] Pushing event updated for resources: {'Port': ['ID=ad6b595f-d532-4631-a472-9bac2d6635e5,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:27.420676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Allocated IP 2001:db8::f816:3eff:febd:8116 (a2b36c78-43a6-4954-8102-cb5638999bb1/291d6211-bfb7-45e5-a876-477d327b329f/74c5ac2e-7712-43e1-8999-d01a40fbc568) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:27.428963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Allocated IP 172.20.0.8 (f6ea1335-20cd-45da-89a1-ce46f850403e/3447438c-c0b6-443e-9b6b-d1bb16b1ec98/efbdcd7a-33b7-4d00-8a27-7664c90cec5b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:27.436085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.450967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff36873f-4dfa-493d-a2ea-fad11b21cf65 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.458262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.478713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Releasing vlan 199 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:27.483603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:27.487804 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:27.509006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.510997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=ac622e9a-0595-4421-8277-c93244989e08,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:27.524970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff36873f-4dfa-493d-a2ea-fad11b21cf65 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.532163 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.541283 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ee5c4b6f-13aa-4c4a-9d58-6c4d2c0f3549 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/ac622e9a-0595-4421-8277-c93244989e08 HTTP/1.1" status: 204 len: 168 time: 0.8373616 Nov 24 04:11:27.544808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59754) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:27.551083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a9bed8f-47e3-46ae-9d05-89b478c085a8 None None] Network 6bf78bea-ec14-4403-9a28-47730e098bc4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:27.642607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:27.646091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.657452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.714547 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.715079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.720164 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/networks/4a08c23f-f6fd-42df-8ed7-4456f4d6ca68 HTTP/1.1" status: 204 len: 168 time: 1.2398417 Nov 24 04:11:27.722505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4744821e-0a27-4413-b290-9c5bc1e746b3 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Network': ['ID=4a08c23f-f6fd-42df-8ed7-4456f4d6ca68,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:27.724504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59756) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:27.770097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff36873f-4dfa-493d-a2ea-fad11b21cf65 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.772674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.773179 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff36873f-4dfa-493d-a2ea-fad11b21cf65 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.777772 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ff36873f-4dfa-493d-a2ea-fad11b21cf65 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/3a00bae9-47f3-445a-a5b8-f510d01e5044 HTTP/1.1" status: 204 len: 168 time: 0.8458250 Nov 24 04:11:27.780797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59758) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:27.838107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Pushing event updated for resources: {'Port': ['ID=74c5ac2e-7712-43e1-8999-d01a40fbc568,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:27.854234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:27.854234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:27.877034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.877806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:27.957311 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.ipam_backend_mixin [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 291d6211-bfb7-45e5-a876-477d327b329f (CIDR: 2001:db8::/64) Nov 24 04:11:27.960700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff36873f-4dfa-493d-a2ea-fad11b21cf65 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a00bae9-47f3-445a-a5b8-f510d01e5044,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:27.971260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Attempting to bind port 74c5ac2e-7712-43e1-8999-d01a40fbc568 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:27.971826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Attempting to bind port 74c5ac2e-7712-43e1-8999-d01a40fbc568 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:27.972413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Attempting to bind port 74c5ac2e-7712-43e1-8999-d01a40fbc568 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:27.995462 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:27.996054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:11:27.996508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:27.997101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:27.997676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:27.998267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:27.999208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Bound port: 74c5ac2e-7712-43e1-8999-d01a40fbc568, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:27.999763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.027295 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8292abc6-a84e-42af-9848-3e97df675048 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.2309258 Nov 24 04:11:28.031666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59760) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:28.040685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:28.095609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] For port 74c5ac2e-7712-43e1-8999-d01a40fbc568, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:28.099851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] For port 74c5ac2e-7712-43e1-8999-d01a40fbc568, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=74c5ac2e-7712-43e1-8999-d01a40fbc568,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:28.109387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] DHCP port deletion for 6bf78bea-ec14-4403-9a28-47730e098bc4 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:28.119885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.125901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.168707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.233666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8c8bde0-0175-416f-8ff9-6f43dafb89f7 None None] Pushing event updated for resources: {'Port': ['ID=74c5ac2e-7712-43e1-8999-d01a40fbc568,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:28.264469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] Deleting port 56727c75-62a6-4af5-8c8d-421e8094f2e0 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:28.265258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.300435 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7234f48f-aefa-4046-9ea9-6d18f1e97e3d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.5112219 Nov 24 04:11:28.302734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59762) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:28.310045 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--20144399'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:28.371588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.372191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] For port 56727c75-62a6-4af5-8c8d-421e8094f2e0, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56727c75-62a6-4af5-8c8d-421e8094f2e0,segment=NetworkSegment(336c539e-4407-4940-aae4-bd812e86b3b1),segment_id=336c539e-4407-4940-aae4-bd812e86b3b1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:28.372717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.390598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.398803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] Calling delete_port for 56727c75-62a6-4af5-8c8d-421e8094f2e0 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:28.427970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6e7065f4-741d-46d1-94e1-3ba8665a6b7b']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:28.441836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '77b3f3bd-42b2-41b2-8914-c110987d2fed') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:28.443012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '77b3f3bd-42b2-41b2-8914-c110987d2fed') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:28.460203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.471647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 56727c75-62a6-4af5-8c8d-421e8094f2e0 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:28.475596 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.489466 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.506777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Releasing vlan 156 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:28.507324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.568216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:28.606675 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:28.609104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] Pushing event deleted for resources: {'Port': ['ID=56727c75-62a6-4af5-8c8d-421e8094f2e0,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:28.616849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5c282b3-3491-438c-8795-1e42375fa934 None None] No DVR routers for this DVR port 56727c75-62a6-4af5-8c8d-421e8094f2e0 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:28.639333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:28.643216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.675432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Network f6ea1335-20cd-45da-89a1-ce46f850403e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:28.678065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 56727c75-62a6-4af5-8c8d-421e8094f2e0, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=56727c75-62a6-4af5-8c8d-421e8094f2e0,segment=NetworkSegment(336c539e-4407-4940-aae4-bd812e86b3b1),segment_id=336c539e-4407-4940-aae4-bd812e86b3b1)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:28.678665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.700587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.704436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.713630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.715765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:28.720849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 56727c75-62a6-4af5-8c8d-421e8094f2e0 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:28.729109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.755001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:28.762385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.765731 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] 10.222.0.48 "DELETE /v2.0/networks/6e7065f4-741d-46d1-94e1-3ba8665a6b7b HTTP/1.1" status: 204 len: 168 time: 1.0198779 Nov 24 04:11:28.767137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f14b1b-fe1f-4d0c-9462-dea3c84733e9 tempest-BulkNetworkOpsTest-201083865 tempest-BulkNetworkOpsTest-201083865-project] Pushing event deleted for resources: {'Network': ['ID=6e7065f4-741d-46d1-94e1-3ba8665a6b7b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:28.833253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701b315e-4f2a-41f3-90ee-2590fd50d412 req-b0e72586-305f-4c55-86bd-7909f0abbf68 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:28.834926 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-701b315e-4f2a-41f3-90ee-2590fd50d412 req-b0e72586-305f-4c55-86bd-7909f0abbf68 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2868774 Nov 24 04:11:28.858007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event updated for resources: {'Port': ['ID=efbdcd7a-33b7-4d00-8a27-7664c90cec5b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:28.890558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:28.893218 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.914232 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f176a17-6ff5-4d32-bf6e-589ea5a4c783 None None] Network f6ea1335-20cd-45da-89a1-ce46f850403e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:28.940516 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-02b859dc-f62a-415d-aed8-70f7b89dc251 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.8690009 Nov 24 04:11:28.941214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59768) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:28.945976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.949220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=684738f9-c16f-4f7d-bb3b-f152072ccfde,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:28.949643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Request body: {'port': {'network_id': 'f6ea1335-20cd-45da-89a1-ce46f850403e', 'name': 'tempest-ExtraDHCPOptionsTestJSON-239839986', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:28.950437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.api.validators [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] bootfile-name is not in valid_values {{(pid=103381) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:11:28.950941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.api.validators [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] tftp-server is not in valid_values {{(pid=103381) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:11:28.952138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.api.validators [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] server-ip-address is not in valid_values {{(pid=103381) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:11:28.968226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:28.995656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f9fe8b58-6890-4cbd-b493-7ecce40e5803 None None] Provisioning complete for port ad6b595f-d532-4631-a472-9bac2d6635e5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:28.996018 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f9fe8b58-6890-4cbd-b493-7ecce40e5803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.033717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting port 67403475-1818-4cf3-83e8-03378f662922 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:29.034066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.068339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.068962 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.7624671 Nov 24 04:11:29.085026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59770) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:29.090970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0c5d5986-1560-4179-97e5-bbed266f5b3d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:29.094786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 74c5ac2e-7712-43e1-8999-d01a40fbc568 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:29.096609 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-0c5d5986-1560-4179-97e5-bbed266f5b3d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 24 04:11:29.097226 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-0c5d5986-1560-4179-97e5-bbed266f5b3d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:29.098689 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0c5d5986-1560-4179-97e5-bbed266f5b3d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0119247 Nov 24 04:11:29.126456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59772) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:29.139172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-93895fc8-e0fd-45f9-8cd0-a8e9790ea31a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:29.145532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.207430 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-701b315e-4f2a-41f3-90ee-2590fd50d412 req-e0e05a7d-d247-4ce9-9815-91d94f5f627f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2404287 Nov 24 04:11:29.217778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebdcfe1f-f503-4e86-b5dc-57d8bcdc0bd6 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e986b044-a5bb-4ac4-b696-afdc41f291ea,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:29.310459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Made reservation on behalf of 8db89885a5504d4e9a252230afb74a38 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:29.315502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.324396 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-93895fc8-e0fd-45f9-8cd0-a8e9790ea31a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:29.326377 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-93895fc8-e0fd-45f9-8cd0-a8e9790ea31a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1976507 Nov 24 04:11:29.335946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 74c5ac2e-7712-43e1-8999-d01a40fbc568 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:29.336365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.337430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59776) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:29.337908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59778) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:29.341666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f9fe8b58-6890-4cbd-b493-7ecce40e5803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.342294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5b540ea1-c101-4571-b48e-f61980caeb11 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:29.342789 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-5b540ea1-c101-4571-b48e-f61980caeb11 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Nov 24 04:11:29.343287 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-5b540ea1-c101-4571-b48e-f61980caeb11 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:29.346995 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5b540ea1-c101-4571-b48e-f61980caeb11 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0055466 Nov 24 04:11:29.349647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59780) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:29.366418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4e3da609-f46b-4c1c-875a-caf950557741 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:29.376318 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network 576cb395-ded1-477d-9995-f33c4a213744 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:29.378242 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.384529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] device_id is not set on port 97a37c40-c0f9-4cea-9c6e-cff16e760024 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:29.397604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:29.412003 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Calling delete_port for 67403475-1818-4cf3-83e8-03378f662922 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:29.415847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.437687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.503219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:29.511257 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f9fe8b58-6890-4cbd-b493-7ecce40e5803 None None] For port ad6b595f-d532-4631-a472-9bac2d6635e5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ad6b595f-d532-4631-a472-9bac2d6635e5,segment=NetworkSegment(8f75a18a-e078-41aa-a4c8-a74d69187b2b),segment_id=8f75a18a-e078-41aa-a4c8-a74d69187b2b)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:29.526727 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f9fe8b58-6890-4cbd-b493-7ecce40e5803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.553692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=56727c75-62a6-4af5-8c8d-421e8094f2e0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:29.568170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port 56727c75-62a6-4af5-8c8d-421e8094f2e0 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:29.620584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:29.623685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.629629 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:29.633684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.686870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9fe8b58-6890-4cbd-b493-7ecce40e5803 None None] Pushing event updated for resources: {'Port': ['ID=ad6b595f-d532-4631-a472-9bac2d6635e5,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:29.695034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 74c5ac2e-7712-43e1-8999-d01a40fbc568, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=74c5ac2e-7712-43e1-8999-d01a40fbc568,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:29.700450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.702397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ad6b595f-d532-4631-a472-9bac2d6635e5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:29.709877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Allocated IP 172.20.0.4 (f6ea1335-20cd-45da-89a1-ce46f850403e/3447438c-c0b6-443e-9b6b-d1bb16b1ec98/97a37c40-c0f9-4cea-9c6e-cff16e760024) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:29.729540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=791109fa-23b9-47ce-8d9a-b7c6c90d0dcc,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:29.748801 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-382e9933-85c6-4e23-9d08-67e30414e82f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7103438 Nov 24 04:11:29.750669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59784) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:29.757170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:29:48:fd', 'name': 'tempest-NetworksTestDHCPv6-140198144'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:29.845662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=74c5ac2e-7712-43e1-8999-d01a40fbc568,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:29.858554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ad6b595f-d532-4631-a472-9bac2d6635e5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:29.859715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.907887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.951858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6bf78bea-ec14-4403-9a28-47730e098bc4']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:29.986116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '336c539e-4407-4940-aae4-bd812e86b3b1') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:29.986417 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Provisioning complete for port efbdcd7a-33b7-4d00-8a27-7664c90cec5b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:29.986884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:29.987628 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '336c539e-4407-4940-aae4-bd812e86b3b1') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:29.993828 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-4e3da609-f46b-4c1c-875a-caf950557741 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:29.995036 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4e3da609-f46b-4c1c-875a-caf950557741 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.6327639 Nov 24 04:11:30.004573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59786) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.015435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.017695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ee6f9005-765f-44ea-b4f3-45463d0dfa24 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.019002 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-ee6f9005-765f-44ea-b4f3-45463d0dfa24 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 24 04:11:30.019649 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-ee6f9005-765f-44ea-b4f3-45463d0dfa24 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:30.026668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bcf184b-13a2-4bef-8f50-1aaf9834fb7d None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:30.027222 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ee6f9005-765f-44ea-b4f3-45463d0dfa24 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0179882 Nov 24 04:11:30.033552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59788) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.045250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5e52a011-d037-4261-872e-10c3c9fffe9e tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.075850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Port efbdcd7a-33b7-4d00-8a27-7664c90cec5b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:30.122656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56727c75-62a6-4af5-8c8d-421e8094f2e0 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:30.124055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.141849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.148257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 176 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:30.148702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.164569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 56727c75-62a6-4af5-8c8d-421e8094f2e0 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:30.164926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 56727c75-62a6-4af5-8c8d-421e8094f2e0 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:30.176272 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Provisioning complete for port ad6b595f-d532-4631-a472-9bac2d6635e5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:30.176653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.181705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:30.189678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:30.223280 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:30.243890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router 77998923-4d69-4ee7-8022-cc3100950059 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:30.290844 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8496bbbb-ef58-4a49-baf9-41c245a5c522 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=a72d9df6a5264a7faa5f3898f7692406&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9431672 Nov 24 04:11:30.296188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59792) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.332418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.337503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event updated for resources: {'Port': ['ID=97a37c40-c0f9-4cea-9c6e-cff16e760024,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:30.343040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Network f6ea1335-20cd-45da-89a1-ce46f850403e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:30.359316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Provisioning complete for port 684738f9-c16f-4f7d-bb3b-f152072ccfde triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:30.359836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.363853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:30.383948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.387199 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/6bf78bea-ec14-4403-9a28-47730e098bc4 HTTP/1.1" status: 204 len: 168 time: 2.8401716 Nov 24 04:11:30.395282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:30.401716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59794) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.411498 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-292521194'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.418465 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3f4723-4f5a-4eff-9846-b28e5c058fc5 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=6bf78bea-ec14-4403-9a28-47730e098bc4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:30.425164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.471383 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:30.472067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.502951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.507301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Port': ['ID=67403475-1818-4cf3-83e8-03378f662922,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:30.522061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5776d591-e8d4-43f0-80d8-5f7eb58552d7 req-57c31b10-8cab-442e-a6c3-b7b29223296f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:30.523871 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5776d591-e8d4-43f0-80d8-5f7eb58552d7 req-57c31b10-8cab-442e-a6c3-b7b29223296f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1832466 Nov 24 04:11:30.528505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ccf2c707-6556-4458-931f-3f40b40c351d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.559341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:30.563177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.564404 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1d7dd5a4-074e-42a4-9062-78b651d0dd29 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1151 time: 1.6205385 Nov 24 04:11:30.577646 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-5e52a011-d037-4261-872e-10c3c9fffe9e tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:30.581353 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5e52a011-d037-4261-872e-10c3c9fffe9e tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.5441241 Nov 24 04:11:30.581353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59796) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.581945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 7449cddc-7e25-440d-973c-876468db5e92 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:30.595021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59798) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.603046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-67cf84dc-3db7-4b8b-bdad-e731b4234411 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.603529 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-67cf84dc-3db7-4b8b-bdad-e731b4234411 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Nov 24 04:11:30.604011 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-67cf84dc-3db7-4b8b-bdad-e731b4234411 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:30.607980 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-67cf84dc-3db7-4b8b-bdad-e731b4234411 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0062470 Nov 24 04:11:30.608884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59800) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.615326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f5e9f478-a1bb-480b-8b21-2079836bc031 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.621499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c8cd32ae-9276-442d-9c81-89be2aec0177 None None] Port 684738f9-c16f-4f7d-bb3b-f152072ccfde cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:30.635530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '291d6211-bfb7-45e5-a876-477d327b329f', 'ip_address': '2001:db8::f816:3eff:febd:8116'}, {'subnet_id': '791109fa-23b9-47ce-8d9a-b7c6c90d0dcc'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '74c5ac2e-7712-43e1-8999-d01a40fbc568'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:11:30.655375 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:30.664958 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ecf7ff77-bc5a-40bd-91df-0d265c5aa2b5 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/routers/77998923-4d69-4ee7-8022-cc3100950059/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2452888 Nov 24 04:11:30.669812 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] Sync routers for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:30.676354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.679182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ccf2c707-6556-4458-931f-3f40b40c351d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.685605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59802) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.686880 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:30.687676 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:30.712830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'port': {'network_id': '576cb395-ded1-477d-9995-f33c4a213744', 'name': 'tempest-FloatingIPTestJSON-1183103622'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.753771 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:30.766356 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:30.768183 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:30.799677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 192, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:30.844102 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-f5e9f478-a1bb-480b-8b21-2079836bc031 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:30.847771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f5e9f478-a1bb-480b-8b21-2079836bc031 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.2337029 Nov 24 04:11:30.850638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59804) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.866789 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5776d591-e8d4-43f0-80d8-5f7eb58552d7 req-8fcc8867-4e20-448c-8439-aa4cbcef9321 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3326664 Nov 24 04:11:30.872875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9dd5f0e5-3683-4640-9e82-80d66a0fcd73 None None] Provisioning complete for port 74c5ac2e-7712-43e1-8999-d01a40fbc568 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:30.873276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9dd5f0e5-3683-4640-9e82-80d66a0fcd73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:30.890931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e767e418-b506-4556-99c3-603ffdcdd7cd tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:30.894869 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:30.896314 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-718b5786-4e8f-45a0-aca4-a0ccb9aecc3a None None] The sync data for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:30.909379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e767e418-b506-4556-99c3-603ffdcdd7cd tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:30.916817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e767e418-b506-4556-99c3-603ffdcdd7cd tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:30.918876 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e767e418-b506-4556-99c3-603ffdcdd7cd tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2616 time: 0.3319340 Nov 24 04:11:30.925927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0835eaba-2147-4e3d-876f-c6522b4d3a59 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e986b044-a5bb-4ac4-b696-afdc41f291ea', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:30.934551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59806) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:30.952943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 74c5ac2e-7712-43e1-8999-d01a40fbc568 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:31.001896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.002315 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 8d21e374-3dbb-4722-b35d-9a17d222359d of type vlan for network 34bef754-aa38-4d28-ad64-185579b03242 Nov 24 04:11:31.059164 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 74c5ac2e-7712-43e1-8999-d01a40fbc568 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:31.059749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.083808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9dd5f0e5-3683-4640-9e82-80d66a0fcd73 None None] Provisioning complete for port efbdcd7a-33b7-4d00-8a27-7664c90cec5b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:31.084196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9dd5f0e5-3683-4640-9e82-80d66a0fcd73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.116377 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-0835eaba-2147-4e3d-876f-c6522b4d3a59 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:31.120104 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0835eaba-2147-4e3d-876f-c6522b4d3a59 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2655950 Nov 24 04:11:31.121887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59808) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:31.125867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.129930 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ccf2c707-6556-4458-931f-3f40b40c351d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.132599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ccf2c707-6556-4458-931f-3f40b40c351d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.135983 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ccf2c707-6556-4458-931f-3f40b40c351d admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/d1d3c396-76cc-4164-a53d-bf15d02f8c9c HTTP/1.1" status: 204 len: 168 time: 0.8376908 Nov 24 04:11:31.137560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9dd5f0e5-3683-4640-9e82-80d66a0fcd73 None None] Port efbdcd7a-33b7-4d00-8a27-7664c90cec5b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:31.151061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8:0:1::262 (a2b36c78-43a6-4954-8102-cb5638999bb1/791109fa-23b9-47ce-8d9a-b7c6c90d0dcc/7449cddc-7e25-440d-973c-876468db5e92) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:31.160119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf2c707-6556-4458-931f-3f40b40c351d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1d3c396-76cc-4164-a53d-bf15d02f8c9c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:31.167548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fe29:48fd (a2b36c78-43a6-4954-8102-cb5638999bb1/291d6211-bfb7-45e5-a876-477d327b329f/7449cddc-7e25-440d-973c-876468db5e92) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:31.192793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.195197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ad6b595f-d532-4631-a472-9bac2d6635e5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:31.195723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Deleting port 97a37c40-c0f9-4cea-9c6e-cff16e760024 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:31.196061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.271535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2ea9ed7a-8be1-4dd9-b5d9-51185e44909b None None] Provisioning complete for port 97a37c40-c0f9-4cea-9c6e-cff16e760024 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:31.272210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2ea9ed7a-8be1-4dd9-b5d9-51185e44909b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.289575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Made reservation on behalf of 69073a2d6ab34b54a6451825f7590db1 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:31.297480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.300648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99694013-4f2c-4c2a-8e24-729a6585a720 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.314423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ad6b595f-d532-4631-a472-9bac2d6635e5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:31.314804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.316992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.320147 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2ea9ed7a-8be1-4dd9-b5d9-51185e44909b None None] Port 97a37c40-c0f9-4cea-9c6e-cff16e760024 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:31.330660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:31.331951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.395392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99694013-4f2c-4c2a-8e24-729a6585a720 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.423853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.456591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Calling delete_port for 97a37c40-c0f9-4cea-9c6e-cff16e760024 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:31.525454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99694013-4f2c-4c2a-8e24-729a6585a720 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.526601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99694013-4f2c-4c2a-8e24-729a6585a720 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.527783 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-99694013-4f2c-4c2a-8e24-729a6585a720 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/e986b044-a5bb-4ac4-b696-afdc41f291ea HTTP/1.1" status: 204 len: 168 time: 0.4049330 Nov 24 04:11:31.538641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59818) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:31.552181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.564305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99694013-4f2c-4c2a-8e24-729a6585a720 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e986b044-a5bb-4ac4-b696-afdc41f291ea,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:31.644825 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a04534ca-e470-4f9b-8952-07e716455d4a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1018786 Nov 24 04:11:31.652926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59824) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:31.658171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--1199786218'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:31.666448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.690183 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] device_id is not set on port fd98637c-e3c8-4575-be66-b303e573d462 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:31.704810 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.2945035 Nov 24 04:11:31.708389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59826) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:31.715278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': '34bef754-aa38-4d28-ad64-185579b03242', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:31.765783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] Allocated IP 2001:db8:0:1::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/791109fa-23b9-47ce-8d9a-b7c6c90d0dcc/74c5ac2e-7712-43e1-8999-d01a40fbc568) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:31.777325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:31.778085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=7449cddc-7e25-440d-973c-876468db5e92,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:31.782317 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:31.784592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.787739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:31.795035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:31.795869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.808238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:31.816556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c925dd1-e971-4fcf-ace6-4d2ed386fac2 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=34bef754-aa38-4d28-ad64-185579b03242,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:31.853455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event deleted for resources: {'Port': ['ID=97a37c40-c0f9-4cea-9c6e-cff16e760024,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:31.858628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 34bef754-aa38-4d28-ad64-185579b03242 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:31.874719 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8afbfbc9-a3d0-4961-8737-a9a344b8e000 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 2.1225989 Nov 24 04:11:31.878652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59832) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.006388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:32.010856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.042087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.079812 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d767f29a-4ec7-4356-bdab-25d8e0dbd017 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "DELETE /v2.0/ports/97a37c40-c0f9-4cea-9c6e-cff16e760024 HTTP/1.1" status: 204 len: 168 time: 1.1320477 Nov 24 04:11:32.112664 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59840) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.119833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Request body: {'port': {'name': 'tempest-new-port-name-1185741956', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:32.120217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.api.validators [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] bootfile-name is not in valid_values {{(pid=103381) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:11:32.120580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.api.validators [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] tftp-server is not in valid_values {{(pid=103381) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:11:32.120880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.api.validators [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] server-ip-address is not in valid_values {{(pid=103381) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 24 04:11:32.145137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Allocated IP 172.20.0.11 (576cb395-ded1-477d-9995-f33c4a213744/f9d3412a-812d-4e31-868b-465c8722aabb/fd98637c-e3c8-4575-be66-b303e573d462) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:32.153918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] For port 74c5ac2e-7712-43e1-8999-d01a40fbc568, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=74c5ac2e-7712-43e1-8999-d01a40fbc568,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:32.166970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.178287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.213069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.220125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.247766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59842) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.248006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8c1b179d-d1e8-48b6-9b37-ab4a3dcf3aee,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:32.272757 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.277458 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a4e3301f-dcc6-4b7c-afeb-fab60aadef35 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6239712 Nov 24 04:11:32.277714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277c682a-42dc-4f0a-a178-4ef356fbabf1 req-0250bc9f-9c17-4d29-978d-12fb01da9a0d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:32.278141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.279787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-277c682a-42dc-4f0a-a178-4ef356fbabf1 req-0250bc9f-9c17-4d29-978d-12fb01da9a0d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2588446 Nov 24 04:11:32.289013 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59846) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.311864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8cd9a17c-ca89-42f1-bc9b-58fd497beda8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '8c1b179d-d1e8-48b6-9b37-ab4a3dcf3aee', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:32.318662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af0f7196-f953-4060-a9d4-107e86edfe35 None None] Pushing event updated for resources: {'Port': ['ID=74c5ac2e-7712-43e1-8999-d01a40fbc568,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:32.321180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 7449cddc-7e25-440d-973c-876468db5e92 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:32.321693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.338756 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Router 5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:32.455459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--146811478'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:32.513029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.531938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 7449cddc-7e25-440d-973c-876468db5e92 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:32.552866 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-277c682a-42dc-4f0a-a178-4ef356fbabf1 req-879a6b73-cdb8-45a5-8e65-9d955b0d0c51 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2598426 Nov 24 04:11:32.620641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.642816 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-8cd9a17c-ca89-42f1-bc9b-58fd497beda8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The resource could not be found. Nov 24 04:11:32.646430 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8cd9a17c-ca89-42f1-bc9b-58fd497beda8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.3538141 Nov 24 04:11:32.650359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59848) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.654714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ebe419e9-d5e3-4d4b-af98-8182d5054f44 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '8c1b179d-d1e8-48b6-9b37-ab4a3dcf3aee', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': '7c0ec3dd-0875-4d74-b984-ab212cf91585'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:32.672991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.684639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.687339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.705731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.729892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.818069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event updated for resources: {'Port': ['ID=efbdcd7a-33b7-4d00-8a27-7664c90cec5b,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:32.861011 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-ebe419e9-d5e3-4d4b-af98-8182d5054f44 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The resource could not be found. Nov 24 04:11:32.862117 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ebe419e9-d5e3-4d4b-af98-8182d5054f44 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2109275 Nov 24 04:11:32.864781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] In _notify_port_updated(), no bound segment for port efbdcd7a-33b7-4d00-8a27-7664c90cec5b on network f6ea1335-20cd-45da-89a1-ce46f850403e {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:11:32.879545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:32.880255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.884331 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9462577b-cff2-4155-a831-10fec614b606 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "PUT /v2.0/ports/efbdcd7a-33b7-4d00-8a27-7664c90cec5b HTTP/1.1" status: 200 len: 1136 time: 0.7674153 Nov 24 04:11:32.884331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59850) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.886513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59852) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.889138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:32.902501 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] Sync routers for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:32.913636 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-53fe99f1-b24c-416e-8b2a-14683d02da3d tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "PUT /v2.0/routers/5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.7761486 Nov 24 04:11:32.921015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:32.921015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:32.933166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59854) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:32.946724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:32.970758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 74c5ac2e-7712-43e1-8999-d01a40fbc568 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:32.973451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:32.999997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.020757 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] Routers {'5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:33.021410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:33.049136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=7449cddc-7e25-440d-973c-876468db5e92,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:33.053707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-238c95ae-67b8-4e4c-8998-e506a0c9f8f9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.070102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:33.070854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8924cbdc-7851-4e9c-9f37-6369712a9bf9 None None] The sync data for ids ['5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:33.087040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 74c5ac2e-7712-43e1-8999-d01a40fbc568 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:33.087417 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.116068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=86b66dec-73bb-497a-a092-63fdb23e66a0,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:33.126649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.132679 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-814fc035-0cb4-49cf-bc36-bbcb84137282 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/7449cddc-7e25-440d-973c-876468db5e92 HTTP/1.1" status: 204 len: 168 time: 1.2528861 Nov 24 04:11:33.133366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59856) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.135712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-238c95ae-67b8-4e4c-8998-e506a0c9f8f9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.153088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.155669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.181552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2fdd857d-02d6-49c5-bf1d-145c9b272856 None None] Provisioning complete for port 74c5ac2e-7712-43e1-8999-d01a40fbc568 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:33.182099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2fdd857d-02d6-49c5-bf1d-145c9b272856 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.219434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e854d8a7-9e56-4b50-ac47-fa098965f07b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.225107 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e854d8a7-9e56-4b50-ac47-fa098965f07b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0865390 Nov 24 04:11:33.241420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de8ce4a9-9298-49bb-83f2-926e13a6ab5b tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.242172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59858) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.246884 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-de8ce4a9-9298-49bb-83f2-926e13a6ab5b tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "GET /v2.0/ports/efbdcd7a-33b7-4d00-8a27-7664c90cec5b HTTP/1.1" status: 200 len: 1136 time: 0.3275166 Nov 24 04:11:33.254671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '8d21e374-3dbb-4722-b35d-9a17d222359d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': '34bef754-aa38-4d28-ad64-185579b03242'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:33.255042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: 34bef754-aa38-4d28-ad64-185579b03242, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:33.264562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59860) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.285696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-238c95ae-67b8-4e4c-8998-e506a0c9f8f9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.289060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-238c95ae-67b8-4e4c-8998-e506a0c9f8f9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.290941 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-238c95ae-67b8-4e4c-8998-e506a0c9f8f9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/8c1b179d-d1e8-48b6-9b37-ab4a3dcf3aee HTTP/1.1" status: 204 len: 168 time: 0.4058635 Nov 24 04:11:33.295510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59862) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.297072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Network 576cb395-ded1-477d-9995-f33c4a213744 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:33.304482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ef7bbc38-fc4e-48de-8cb1-4bcb5e7586fc,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:33.331032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.342365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:33.350289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2fdd857d-02d6-49c5-bf1d-145c9b272856 None None] Provisioning complete for port efbdcd7a-33b7-4d00-8a27-7664c90cec5b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:33.351022 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2fdd857d-02d6-49c5-bf1d-145c9b272856 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.385641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:33.390471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event updated for resources: {'Port': ['ID=fd98637c-e3c8-4575-be66-b303e573d462,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:33.427922 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2fdd857d-02d6-49c5-bf1d-145c9b272856 None None] Port efbdcd7a-33b7-4d00-8a27-7664c90cec5b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:33.489209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.520557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.523195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 34bef754-aa38-4d28-ad64-185579b03242 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:33.606770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.607442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.628914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.634334 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.3837740 Nov 24 04:11:33.634334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 34bef754-aa38-4d28-ad64-185579b03242) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:33.642892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59866) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.645163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d1e6e6f9-d4ac-4ad2-88f7-e9bffa7b614f None None] Could not find standard attr ID for object 7449cddc-7e25-440d-973c-876468db5e92. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:11:33.660299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66611634-956b-48c5-a12a-6c554bbb8c9d None None] Network 34bef754-aa38-4d28-ad64-185579b03242 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:33.661713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.662379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.670758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622699bd-2a2e-48eb-a0d4-417cfb5e12e9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=61738458-6d63-428e-a09a-8d72f290aa55,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:33.707959 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-be01545b-4170-4d7a-a52a-51b6f52cda87 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.0116827 Nov 24 04:11:33.717978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59868) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.721493 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-db78e95f-f173-404b-b199-b4911197bd42 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0106778 Nov 24 04:11:33.729816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Request body: {'floatingip': {'port_id': 'fd98637c-e3c8-4575-be66-b303e573d462'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:33.732177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59870) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.738116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-723513271', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:33.743889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-238c95ae-67b8-4e4c-8998-e506a0c9f8f9 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c1b179d-d1e8-48b6-9b37-ab4a3dcf3aee,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:33.828250 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-55812583-2e45-4847-b929-a3fc0b321e6e tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.5257854 Nov 24 04:11:33.828456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a4cac5cf-5702-4faf-bdb9-8db789e70b6c None None] Provisioning complete for port fd98637c-e3c8-4575-be66-b303e573d462 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:33.828456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4cac5cf-5702-4faf-bdb9-8db789e70b6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.829034 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59872) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.837926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86343618-37d9-4f62-b2b6-3243af67cf9e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.844797 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-86343618-37d9-4f62-b2b6-3243af67cf9e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.5959475 Nov 24 04:11:33.844977 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-42b53a86-0ba4-4c45-af21-d36090cec17a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.1971242 Nov 24 04:11:33.845083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-96e88c9b-3d43-4f8e-81a7-7ceda680f356 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': '9438a2ff-3ec4-4be5-b004-dc6e9eae2069', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:33.848716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59874) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.849050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59876) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:33.856002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Deleting port efbdcd7a-33b7-4d00-8a27-7664c90cec5b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:33.856349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.859712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.869204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-security--1644238730', 'description': 'tempest-security-description-286880868'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:33.895877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a4cac5cf-5702-4faf-bdb9-8db789e70b6c None None] Port fd98637c-e3c8-4575-be66-b303e573d462 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:33.937053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.937497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f42982-4e41-43d4-a70d-f653823ff84d req-0169a52c-498f-43d0-b1f7-8fc9972e598f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.938097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-34bef754-aa38-4d28-ad64-185579b03242', 'network_id': '34bef754-aa38-4d28-ad64-185579b03242', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': '86b66dec-73bb-497a-a092-63fdb23e66a0'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:33.939213 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-97f42982-4e41-43d4-a70d-f653823ff84d req-0169a52c-498f-43d0-b1f7-8fc9972e598f tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1771035 Nov 24 04:11:33.939354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:33.960358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.api [None req-96e88c9b-3d43-4f8e-81a7-7ceda680f356 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:11:33.960358 dv-neutron-819049-1-hyperv neutron-server[103381]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 24 04:11:33.960358 dv-neutron-819049-1-hyperv neutron-server[103381]: [parameters: {'project_id': '8b32b866b8024332a00edf86419c8deb', 'id': '5ec714b8-b99c-493b-8979-51beab5888da', 'expiration': datetime.datetime(2021, 11, 24, 4, 13, 33, 904446)}] Nov 24 04:11:33.960358 dv-neutron-819049-1-hyperv neutron-server[103381]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103381) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:11:33.960917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG oslo_db.api [None req-96e88c9b-3d43-4f8e-81a7-7ceda680f356 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:11:33.997003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb3f2dc4-8ad7-490e-9b65-de15a069bcca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:33.998929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb3f2dc4-8ad7-490e-9b65-de15a069bcca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:34.000486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb3f2dc4-8ad7-490e-9b65-de15a069bcca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:34.004617 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cb3f2dc4-8ad7-490e-9b65-de15a069bcca tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.1519964 Nov 24 04:11:34.005108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59878) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.017035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.092267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Allocated IP 172.20.0.2 (34bef754-aa38-4d28-ad64-185579b03242/86b66dec-73bb-497a-a092-63fdb23e66a0/f462307c-16f4-4297-9ce6-7e609b1b1172) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:34.109876 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-97f42982-4e41-43d4-a70d-f653823ff84d req-1a7b8959-4724-4579-a296-f77099776c70 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1600115 Nov 24 04:11:34.113962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 291d6211-bfb7-45e5-a876-477d327b329f {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:34.118493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.164643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.170561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.173160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.174446 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "PUT /v2.0/security-groups/61738458-6d63-428e-a09a-8d72f290aa55 HTTP/1.1" status: 200 len: 1794 time: 0.3152008 Nov 24 04:11:34.181790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59880) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.221256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.257034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.261770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf71a65-f86f-49fc-87e5-c62e7a43be5e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=61738458-6d63-428e-a09a-8d72f290aa55,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:34.266992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.273268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.274117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.286538 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-80fab2f9-3cf1-4788-82bc-7e577e0e0ceb tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups/61738458-6d63-428e-a09a-8d72f290aa55 HTTP/1.1" status: 200 len: 1794 time: 0.1013415 Nov 24 04:11:34.290308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59882) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.312350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Network 34bef754-aa38-4d28-ad64-185579b03242 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:34.318864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:34.321566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:34.330892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Pushing event updated for resources: {'Port': ['ID=f462307c-16f4-4297-9ce6-7e609b1b1172,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:34.370122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.382968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Attempting to bind port f462307c-16f4-4297-9ce6-7e609b1b1172 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:34.383353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Attempting to bind port f462307c-16f4-4297-9ce6-7e609b1b1172 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8d21e374-3dbb-4722-b35d-9a17d222359d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': '34bef754-aa38-4d28-ad64-185579b03242'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:34.383939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Attempting to bind port f462307c-16f4-4297-9ce6-7e609b1b1172 on network 34bef754-aa38-4d28-ad64-185579b03242 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:34.388982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.389241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:34.389851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Checking segment: {'id': '8d21e374-3dbb-4722-b35d-9a17d222359d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': '34bef754-aa38-4d28-ad64-185579b03242'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:34.390284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.390688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Bound using segment: {'id': '8d21e374-3dbb-4722-b35d-9a17d222359d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': '34bef754-aa38-4d28-ad64-185579b03242'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:34.391156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Bound port: f462307c-16f4-4297-9ce6-7e609b1b1172, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8d21e374-3dbb-4722-b35d-9a17d222359d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': '34bef754-aa38-4d28-ad64-185579b03242'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:34.391722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.407012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.421663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-80007421-89b2-452b-8218-b1849e093f26 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.442173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.447285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Calling delete_port for efbdcd7a-33b7-4d00-8a27-7664c90cec5b owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:34.456095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-80007421-89b2-452b-8218-b1849e093f26 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.458295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting port 2244a5e7-ebab-4a50-8813-dd14b70f9510 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:34.458643 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.464100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-be75e956-2e23-4586-86af-d99132805a78 None None] For port f462307c-16f4-4297-9ce6-7e609b1b1172, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:34.467816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-be75e956-2e23-4586-86af-d99132805a78 None None] For port f462307c-16f4-4297-9ce6-7e609b1b1172, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f462307c-16f4-4297-9ce6-7e609b1b1172,segment=NetworkSegment(8d21e374-3dbb-4722-b35d-9a17d222359d),segment_id=8d21e374-3dbb-4722-b35d-9a17d222359d)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:34.472888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.513134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.546137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be75e956-2e23-4586-86af-d99132805a78 None None] Pushing event updated for resources: {'Port': ['ID=f462307c-16f4-4297-9ce6-7e609b1b1172,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:34.561277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.564810 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/291d6211-bfb7-45e5-a876-477d327b329f HTTP/1.1" status: 204 len: 168 time: 0.5590124 Nov 24 04:11:34.570697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59884) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.570901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7fbd6e8-c629-4293-a3b8-75902b6140af None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:34.571390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c8bc6e-f956-4f63-955b-48a07e316fec tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=291d6211-bfb7-45e5-a876-477d327b329f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:34.617392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.618645 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7a7548d4-a809-4994-8020-4a1ab5b0d1b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.8852301 Nov 24 04:11:34.623402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59886) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.634710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-80007421-89b2-452b-8218-b1849e093f26 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.637150 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-80007421-89b2-452b-8218-b1849e093f26 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.641383 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-80007421-89b2-452b-8218-b1849e093f26 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/61738458-6d63-428e-a09a-8d72f290aa55 HTTP/1.1" status: 204 len: 168 time: 0.3500206 Nov 24 04:11:34.645623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59888) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.707002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.712477 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-96e88c9b-3d43-4f8e-81a7-7ceda680f356 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The resource could not be found. Nov 24 04:11:34.718494 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-96e88c9b-3d43-4f8e-81a7-7ceda680f356 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.8728888 Nov 24 04:11:34.720281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59890) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.727992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--583291476'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:34.746328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80007421-89b2-452b-8218-b1849e093f26 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=61738458-6d63-428e-a09a-8d72f290aa55,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:34.753166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Calling delete_port for 2244a5e7-ebab-4a50-8813-dd14b70f9510 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:34.762883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 791109fa-23b9-47ce-8d9a-b7c6c90d0dcc {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:34.777501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.884854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.911242 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c8ba086d-8d25-4bbc-bb36-16fb3f64ffe5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2607214 Nov 24 04:11:34.914831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59892) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:34.933738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.956439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2f58b8c6-f0f5-4f1b-9039-c6ab2d05f66c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:34.982099 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-c31516c9-c0f2-4cdf-84b1-70cd8ff3cd34 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] delete failed (client error): The resource could not be found. Nov 24 04:11:34.983123 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c31516c9-c0f2-4cdf-84b1-70cd8ff3cd34 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/61738458-6d63-428e-a09a-8d72f290aa55 HTTP/1.1" status: 404 len: 347 time: 0.0655780 Nov 24 04:11:34.994588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59894) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:35.042863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--1828232370'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:35.092599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.135128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.169126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.199456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.212510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.231709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.365225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.366518 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.6437039 Nov 24 04:11:35.378557 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:11:35.379156 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59898) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:35.383828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--98705736'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:35.384566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event deleted for resources: {'Port': ['ID=efbdcd7a-33b7-4d00-8a27-7664c90cec5b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:35.394871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0fe50c-e52b-42f8-807f-222966e0a1a2 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e89d147a-1c46-4082-8896-467ecef3333b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:35.426611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.483797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.552211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.556891 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/791109fa-23b9-47ce-8d9a-b7c6c90d0dcc HTTP/1.1" status: 204 len: 168 time: 0.9828365 Nov 24 04:11:35.557779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f557a615-b9a8-4851-b7b3-0a41b5a8fdee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=791109fa-23b9-47ce-8d9a-b7c6c90d0dcc,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:35.573249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59900) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:35.595558 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8c3cd8-08c9-4f52-833e-e6495504f51c req-2178fd4e-2d71-46cd-b338-1fd12d537ded tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:35.604035 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bd8c3cd8-08c9-4f52-833e-e6495504f51c req-2178fd4e-2d71-46cd-b338-1fd12d537ded tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3573873 Nov 24 04:11:35.637895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.642216 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e4ee9dde-78e4-4bda-9bd5-48a15a19eeda tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "DELETE /v2.0/ports/efbdcd7a-33b7-4d00-8a27-7664c90cec5b HTTP/1.1" status: 204 len: 168 time: 2.3742554 Nov 24 04:11:35.657265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59902) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:35.659545 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c644fd6b-f1af-4455-87ae-d5afd2b50fbe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0858335 Nov 24 04:11:35.667397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59904) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:35.678454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:35.744903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.20.0.1 (34bef754-aa38-4d28-ad64-185579b03242/86b66dec-73bb-497a-a092-63fdb23e66a0/22bf6dde-91fe-4662-b38a-890e3bc47244) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:35.782245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.787189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.790473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:11:35.812930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.827129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.827438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80ae3a80-dd46-41c7-a329-5aeffd6860e4 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:35.867362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.921720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Port': ['ID=2244a5e7-ebab-4a50-8813-dd14b70f9510,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:35.926829 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bd8c3cd8-08c9-4f52-833e-e6495504f51c req-397fe1ce-c2fc-4a24-9c34-c238192da4c6 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3222156 Nov 24 04:11:35.937708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Deleting subnet 3447438c-c0b6-443e-9b6b-d1bb16b1ec98 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:35.959982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.965181 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.9390440 Nov 24 04:11:35.968458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:35.971338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59906) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:35.985918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68816f1e-a04b-45e6-99ab-18bd164332f8 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:36.001482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8dc9828b-e25a-4330-a7d7-42bbe6704144 None None] Provisioning complete for port 74c5ac2e-7712-43e1-8999-d01a40fbc568 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:36.001923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8dc9828b-e25a-4330-a7d7-42bbe6704144 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.010491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:36.014596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.056250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '36717cb0-4be8-4c0a-b181-0515bcbdc698', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:36.064615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.078323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a66c6e17-e8d5-4b0a-bf20-b493130640c5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=36717cb0-4be8-4c0a-b181-0515bcbdc698,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:36.099901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.104332 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.7236791 Nov 24 04:11:36.117771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59910) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:36.128338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1929db8a-49be-4555-a10f-80ad14654b0a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group_rule': {'security_group_id': 'e89d147a-1c46-4082-8896-467ecef3333b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': 'a3e01506-f8fa-44ba-bd3c-5fa07316bf06'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:36.132098 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.192012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c19b696-1105-49ae-95a1-4719c7f63d2b tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a3e01506-f8fa-44ba-bd3c-5fa07316bf06,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:36.199878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.263966 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18b99fe1-0675-43c4-a5bd-7dc17d5e3376 None None] Network 34bef754-aa38-4d28-ad64-185579b03242 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:36.272329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.301128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:36.374807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.412890 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-1929db8a-49be-4555-a10f-80ad14654b0a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:36.417696 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1929db8a-49be-4555-a10f-80ad14654b0a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.2913139 Nov 24 04:11:36.425172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59914) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:36.448305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-af3e6acb-9ef3-4517-8881-c3fc3a5d8100 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:36.450246 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-af3e6acb-9ef3-4517-8881-c3fc3a5d8100 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.1420765 Nov 24 04:11:36.578884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-412800e5-4060-4c82-8cf3-8ed6fc535bf6 None None] Provisioning complete for port f462307c-16f4-4297-9ce6-7e609b1b1172 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:36.579531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-412800e5-4060-4c82-8cf3-8ed6fc535bf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.620080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] Deleting port 74c5ac2e-7712-43e1-8999-d01a40fbc568 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:36.620845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.632209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.672263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-40102606-b161-41bd-a16f-15cc077f3da1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.690843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.710232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.720080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 34bef754-aa38-4d28-ad64-185579b03242 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:36.720796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.734870 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-40102606-b161-41bd-a16f-15cc077f3da1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.767467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:36.769904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:36.777798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-dcbdabf6-2963-457d-9494-5fea62ca0599 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:36.779579 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-dcbdabf6-2963-457d-9494-5fea62ca0599 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.3125498 Nov 24 04:11:36.780212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=22bf6dde-91fe-4662-b38a-890e3bc47244,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:36.800073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] For port 74c5ac2e-7712-43e1-8999-d01a40fbc568, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=74c5ac2e-7712-43e1-8999-d01a40fbc568,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:36.800471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.821929 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-412800e5-4060-4c82-8cf3-8ed6fc535bf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.824917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] Calling delete_port for 74c5ac2e-7712-43e1-8999-d01a40fbc568 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:36.828989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fdd1415-07a7-42e0-b340-6a94914cafec req-f456dd5b-7849-45b1-9f9a-5e474f54a003 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:36.830308 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6fdd1415-07a7-42e0-b340-6a94914cafec req-f456dd5b-7849-45b1-9f9a-5e474f54a003 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.5849349 Nov 24 04:11:36.839370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.839800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Fanout notify agent at l3_agent the message router_deleted on router 5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:11:36.841772 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 14190efe-a3ee-4a90-abb0-7635162df195 associated. External IP: 172.26.5.168, port: 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8. Nov 24 04:11:36.853256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.857499 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-af5ee0bc-a65e-4d70-b1e1-3f679b920bd9 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "DELETE /v2.0/routers/5a8b5606-cc7c-49ec-b0c0-fc4d9fa98a25 HTTP/1.1" status: 204 len: 168 time: 3.8710489 Nov 24 04:11:36.877544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59916) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:36.901815 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.928699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-412800e5-4060-4c82-8cf3-8ed6fc535bf6 None None] For port f462307c-16f4-4297-9ce6-7e609b1b1172, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f462307c-16f4-4297-9ce6-7e609b1b1172,segment=NetworkSegment(8d21e374-3dbb-4722-b35d-9a17d222359d),segment_id=8d21e374-3dbb-4722-b35d-9a17d222359d)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:36.938682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-412800e5-4060-4c82-8cf3-8ed6fc535bf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:36.953706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:11:36.974356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.038316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.043445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.058114 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412800e5-4060-4c82-8cf3-8ed6fc535bf6 None None] Pushing event updated for resources: {'Port': ['ID=f462307c-16f4-4297-9ce6-7e609b1b1172,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.069842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting subnet 7b52fb93-a07a-4b5c-a3a4-11308879ff75 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:37.071899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.073899 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-f8c885af-23c6-4434-bd13-3ecf58d77bde service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1001 time: 0.2791002 Nov 24 04:11:37.109056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] Pushing event deleted for resources: {'Port': ['ID=74c5ac2e-7712-43e1-8999-d01a40fbc568,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.116531 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.119329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cd1734b-7371-45a4-b99a-0b41a252a179 None None] No DVR routers for this DVR port 74c5ac2e-7712-43e1-8999-d01a40fbc568 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:37.130090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-40102606-b161-41bd-a16f-15cc077f3da1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.130944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e07fc40-fdc3-425f-8331-ef590db4d5fa,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.131926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-40102606-b161-41bd-a16f-15cc077f3da1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.136989 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-40102606-b161-41bd-a16f-15cc077f3da1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/a3e01506-f8fa-44ba-bd3c-5fa07316bf06 HTTP/1.1" status: 204 len: 168 time: 0.7057481 Nov 24 04:11:37.137837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59918) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:37.138255 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6fdd1415-07a7-42e0-b340-6a94914cafec req-56b5dac4-1ca8-4c30-9f56-7ec62f8d3cdb tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2929342 Nov 24 04:11:37.165150 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.173186 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1b6c03b2-b498-44d9-a67c-5de7cb97b2a5 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1709745 Nov 24 04:11:37.177838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59920) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:37.200532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.205595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f462307c-16f4-4297-9ce6-7e609b1b1172 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:37.280061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2cbbea0a-c932-4766-87c2-fcb07e18a981 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.280349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a2d18bde-8c87-4779-9c0c-8c9e6c8d4964 None None] Provisioning complete for port f462307c-16f4-4297-9ce6-7e609b1b1172 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:37.280461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.280546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a2d18bde-8c87-4779-9c0c-8c9e6c8d4964 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.283664 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "DELETE /v2.0/subnets/3447438c-c0b6-443e-9b6b-d1bb16b1ec98 HTTP/1.1" status: 204 len: 168 time: 1.6253760 Nov 24 04:11:37.290344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2f0b2d-c45d-41e6-8ce0-990a899598fa tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event deleted for resources: {'Subnet': ['ID=3447438c-c0b6-443e-9b6b-d1bb16b1ec98,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.293147 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2cbbea0a-c932-4766-87c2-fcb07e18a981 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.295525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59922) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:37.299312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bef4e94-a478-40ae-b166-15be916a77f8 None None] Network f6ea1335-20cd-45da-89a1-ce46f850403e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:37.435647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f462307c-16f4-4297-9ce6-7e609b1b1172 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:37.435943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.469537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.482054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2cbbea0a-c932-4766-87c2-fcb07e18a981 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.493561 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2cbbea0a-c932-4766-87c2-fcb07e18a981 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.495035 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2cbbea0a-c932-4766-87c2-fcb07e18a981 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/9e07fc40-fdc3-425f-8331-ef590db4d5fa HTTP/1.1" status: 204 len: 168 time: 0.3162854 Nov 24 04:11:37.503829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59924) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:37.511937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbbea0a-c932-4766-87c2-fcb07e18a981 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9e07fc40-fdc3-425f-8331-ef590db4d5fa,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.536191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:37.584180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a2d18bde-8c87-4779-9c0c-8c9e6c8d4964 None None] Provisioning complete for port 22bf6dde-91fe-4662-b38a-890e3bc47244 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:37.584614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a2d18bde-8c87-4779-9c0c-8c9e6c8d4964 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.610820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40102606-b161-41bd-a16f-15cc077f3da1 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3e01506-f8fa-44ba-bd3c-5fa07316bf06,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.661670 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.services.revisions.revision_plugin [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Could not find related port for resource to bump revision. Nov 24 04:11:37.661839 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a7ba505-3a4f-4e4e-bc44-c1d638ce8c18 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1564815 Nov 24 04:11:37.667185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59926) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:37.675570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a2d18bde-8c87-4779-9c0c-8c9e6c8d4964 None None] Port 22bf6dde-91fe-4662-b38a-890e3bc47244 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:37.688519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_pluggable_backend [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Port 74c5ac2e-7712-43e1-8999-d01a40fbc568 was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=103381) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Nov 24 04:11:37.688672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] DHCP port deletion for f6ea1335-20cd-45da-89a1-ce46f850403e request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:37.688830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_pluggable_backend [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Reverting IP allocation for 2001:db8::f816:3eff:febd:8116 {{(pid=103381) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Nov 24 04:11:37.696081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Deleting port ad6b595f-d532-4631-a472-9bac2d6635e5 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:37.697385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.711220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.714046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_pluggable_backend [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Reverting IP allocation failed for 2001:db8::f816:3eff:febd:8116 {{(pid=103381) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Nov 24 04:11:37.752787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.755512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-e963f45b-7f1f-4ec2-9e83-f4d3eef95f30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:37.755984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] Deleting port ad6b595f-d532-4631-a472-9bac2d6635e5 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:37.756549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.757217 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-e963f45b-7f1f-4ec2-9e83-f4d3eef95f30 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.6373444 Nov 24 04:11:37.783689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 74c5ac2e-7712-43e1-8999-d01a40fbc568 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:37.831772 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] For port ad6b595f-d532-4631-a472-9bac2d6635e5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ad6b595f-d532-4631-a472-9bac2d6635e5,segment=NetworkSegment(8f75a18a-e078-41aa-a4c8-a74d69187b2b),segment_id=8f75a18a-e078-41aa-a4c8-a74d69187b2b)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:37.832391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.841539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 74c5ac2e-7712-43e1-8999-d01a40fbc568 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:37.841973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 74c5ac2e-7712-43e1-8999-d01a40fbc568 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:37.860940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Calling delete_port for ad6b595f-d532-4631-a472-9bac2d6635e5 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:37.862916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b34e5afa-8d33-4803-81d8-dc3c7fbb26ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.864154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-01faa8e1-2463-420d-8113-ec1918f36079 None None] Provisioning complete for port 22bf6dde-91fe-4662-b38a-890e3bc47244 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:37.864593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-01faa8e1-2463-420d-8113-ec1918f36079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.876470 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:37.893946 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:37.897502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:37.907826 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:37.908001 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-09bc420b-ae6c-4d29-95fa-d866aab187f3 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.3607137 Nov 24 04:11:37.908121 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:37.912977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b34e5afa-8d33-4803-81d8-dc3c7fbb26ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.914822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59928) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:37.920282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:37.926191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-01faa8e1-2463-420d-8113-ec1918f36079 None None] Port 22bf6dde-91fe-4662-b38a-890e3bc47244 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:37.933722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:37.934418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.940324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=5f976dae-965d-47b3-a563-55c7d34c38e9,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:37.941152 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:37.942926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] For port ad6b595f-d532-4631-a472-9bac2d6635e5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ad6b595f-d532-4631-a472-9bac2d6635e5,segment=NetworkSegment(8f75a18a-e078-41aa-a4c8-a74d69187b2b),segment_id=8f75a18a-e078-41aa-a4c8-a74d69187b2b)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:37.943430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.951152 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:37.952189 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:37.958482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6795687-6f5d-4452-af2b-533e7ebae056 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:37.972463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:37.974861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] Calling delete_port for ad6b595f-d532-4631-a472-9bac2d6635e5 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:37.988520 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:37.989587 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99b0a047-92e1-4c6a-9fe7-c0bb94fd30dd None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:37.989798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-146b2ca5-b5cf-4633-8173-8a41398606ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.015752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-44e83b8f-1d5e-4788-adf8-95c22997ebee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:38.017573 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-44e83b8f-1d5e-4788-adf8-95c22997ebee service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2444911 Nov 24 04:11:38.023700 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-66aef8f8-edca-4ea3-a6f5-c3c78e567d64 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.3521826 Nov 24 04:11:38.027274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59930) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:38.035997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:38.056340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.169394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b34e5afa-8d33-4803-81d8-dc3c7fbb26ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.176128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b34e5afa-8d33-4803-81d8-dc3c7fbb26ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.184111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.184388 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b34e5afa-8d33-4803-81d8-dc3c7fbb26ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/36717cb0-4be8-4c0a-b181-0515bcbdc698 HTTP/1.1" status: 204 len: 168 time: 0.5146034 Nov 24 04:11:38.195730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59934) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:38.224911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '5f976dae-965d-47b3-a563-55c7d34c38e9'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:38.225484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34e5afa-8d33-4803-81d8-dc3c7fbb26ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=36717cb0-4be8-4c0a-b181-0515bcbdc698,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.226986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.229421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] No DVR routers for this DVR port ad6b595f-d532-4631-a472-9bac2d6635e5 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:38.231620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a77ea0-a7f5-4414-9f01-9adab75c561e None None] Pushing event deleted for resources: {'Port': ['ID=ad6b595f-d532-4631-a472-9bac2d6635e5,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.286546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.346255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event deleted for resources: {'Port': ['ID=ad6b595f-d532-4631-a472-9bac2d6635e5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.353450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] No DVR routers for this DVR port ad6b595f-d532-4631-a472-9bac2d6635e5 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:38.370750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-42a6882b-5b04-4d9e-8fbf-1133b49bb059 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.401986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Allocated IP 2001:db8::f816:3eff:fef1:bb1a (a2b36c78-43a6-4954-8102-cb5638999bb1/5f976dae-965d-47b3-a563-55c7d34c38e9/b581771e-6eb9-46f2-9ad8-a3b0160007c2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:38.457178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router 77998923-4d69-4ee7-8022-cc3100950059 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:38.458586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.483149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-42a6882b-5b04-4d9e-8fbf-1133b49bb059 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.484408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f6ea1335-20cd-45da-89a1-ce46f850403e']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:38.486273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.496814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f75a18a-e078-41aa-a4c8-a74d69187b2b') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:38.497009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f75a18a-e078-41aa-a4c8-a74d69187b2b') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:38.531487 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-fb9d10df-e4b9-4e98-8b02-4ba92c7f5440 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5030327 Nov 24 04:11:38.542315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.560433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.573149 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f8e88aa1-88a5-4bb9-84f4-6c7931ae440e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3583248 Nov 24 04:11:38.575821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.577496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.580773 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "DELETE /v2.0/subnets/7b52fb93-a07a-4b5c-a3a4-11308879ff75 HTTP/1.1" status: 204 len: 168 time: 1.6952510 Nov 24 04:11:38.588713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9569afc1-a737-44f1-920c-e9d99577f45e None None] Network 12205fb4-dac3-4af0-b4b6-24882f86dd40 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:38.591200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e98e5ac0-6358-4a52-bcb5-e448ef5e3705 tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Subnet': ['ID=7b52fb93-a07a-4b5c-a3a4-11308879ff75,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.595595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.596622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59936) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:38.597037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59938) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:38.603101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--1921384366'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:38.611723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511efd5f-f834-4c69-9fad-85548a8df95e req-a7fd92d4-6cb7-483f-a306-df1287aada83 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:38.613932 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-511efd5f-f834-4c69-9fad-85548a8df95e req-a7fd92d4-6cb7-483f-a306-df1287aada83 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3554659 Nov 24 04:11:38.628814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Releasing vlan 173 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:38.629286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:38.632739 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:38.645056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:38.651440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:38.660225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:38.705075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Pushing event updated for resources: {'Port': ['ID=b581771e-6eb9-46f2-9ad8-a3b0160007c2,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.718986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:38.722442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.779116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-42a6882b-5b04-4d9e-8fbf-1133b49bb059 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.779670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:38.781495 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-42a6882b-5b04-4d9e-8fbf-1133b49bb059 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.784832 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-42a6882b-5b04-4d9e-8fbf-1133b49bb059 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/e89d147a-1c46-4082-8896-467ecef3333b HTTP/1.1" status: 204 len: 168 time: 0.8632903 Nov 24 04:11:38.784982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.787202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59940) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:38.787605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.812726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.812968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] Sync routers for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:38.818934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.827737 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Attempting to bind port b581771e-6eb9-46f2-9ad8-a3b0160007c2 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:38.832380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Attempting to bind port b581771e-6eb9-46f2-9ad8-a3b0160007c2 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:38.841785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.843860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Attempting to bind port b581771e-6eb9-46f2-9ad8-a3b0160007c2 on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:38.845361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a6882b-5b04-4d9e-8fbf-1133b49bb059 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e89d147a-1c46-4082-8896-467ecef3333b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.845547 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] 10.222.0.48 "DELETE /v2.0/networks/f6ea1335-20cd-45da-89a1-ce46f850403e HTTP/1.1" status: 204 len: 168 time: 1.5473406 Nov 24 04:11:38.853441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.861343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:38.861724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:38.862365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.862769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:38.864616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Bound port: b581771e-6eb9-46f2-9ad8-a3b0160007c2, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:38.866052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:38.879297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e92685d-2edc-4667-b67b-ded2ec0c4b33 tempest-ExtraDHCPOptionsTestJSON-359752199 tempest-ExtraDHCPOptionsTestJSON-359752199-project] Pushing event deleted for resources: {'Network': ['ID=f6ea1335-20cd-45da-89a1-ce46f850403e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:38.943079 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c4ec7c93-38d7-441b-a760-79b4e21c1f66 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/floatingips/14190efe-a3ee-4a90-abb0-7635162df195 HTTP/1.1" status: 200 len: 979 time: 5.2203703 Nov 24 04:11:38.946001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59944) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:38.962762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:38.963888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:38.968171 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-511efd5f-f834-4c69-9fad-85548a8df95e req-a03ed9fd-ff84-4ae2-b506-570d76d75a72 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3229089 Nov 24 04:11:38.975483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f462307c-16f4-4297-9ce6-7e609b1b1172 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:38.979764 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bb28052a-07cd-4732-99c7-4df7b73eb923 req-65663a90-c87d-4642-919f-0d4670deb22d service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4165175 Nov 24 04:11:39.038234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:39.043539 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.ipam_backend_mixin [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 5f976dae-965d-47b3-a563-55c7d34c38e9 (CIDR: 2001:db8::/64) Nov 24 04:11:39.051896 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b151d934-7292-4506-aea7-baa2f20d31d4 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2522833 Nov 24 04:11:39.061981 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59946) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:39.066831 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:39.067855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:11:39.068392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.073689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'tempest-secgroup--798037539'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:39.086395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.095698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.096872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.129890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] For port b581771e-6eb9-46f2-9ad8-a3b0160007c2, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:39.140179 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-36c82d02-c1f5-4bed-8ae9-86fef7ee5efe tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.1096034 Nov 24 04:11:39.150722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59948) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:39.156070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] For port b581771e-6eb9-46f2-9ad8-a3b0160007c2, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b581771e-6eb9-46f2-9ad8-a3b0160007c2,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:39.157897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:39.164894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] DHCP port deletion for 12205fb4-dac3-4af0-b4b6-24882f86dd40 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:39.173666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.178548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:39.179136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:39.181584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting port 4402b7af-2a15-48cb-bda5-b588d82f61ab {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:39.181810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.183787 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9456356d-2213-4a45-9f3b-e8dcdd456c77,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:39.206420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.218331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=22bf6dde-91fe-4662-b38a-890e3bc47244,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:39.222730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.249235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.253205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c61e6c6e-d725-4ba2-8b08-573d34148d41 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6527445 Nov 24 04:11:39.258867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59950) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:39.272474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9456356d-2213-4a45-9f3b-e8dcdd456c77', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:39.277923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:39.278575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be07f7e1-36c7-4b3b-bcb0-054f5a310d15 None None] The sync data for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:39.296745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f462307c-16f4-4297-9ce6-7e609b1b1172 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:39.297127 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.339016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 34bef754-aa38-4d28-ad64-185579b03242 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:39.340721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:39.354355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a516013-fc1b-4982-99ae-163817cfd778 None None] Pushing event updated for resources: {'Port': ['ID=b581771e-6eb9-46f2-9ad8-a3b0160007c2,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:39.390796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] Deleting port 4402b7af-2a15-48cb-bda5-b588d82f61ab {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:39.391186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.417121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port fd98637c-e3c8-4575-be66-b303e573d462 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:39.417676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.476134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59954) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:39.546640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] For port 4402b7af-2a15-48cb-bda5-b588d82f61ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4402b7af-2a15-48cb-bda5-b588d82f61ab,segment=NetworkSegment(bb2286bf-7127-4b8f-ac65-aa5b73d7d00c),segment_id=bb2286bf-7127-4b8f-ac65-aa5b73d7d00c)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:39.547032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.566445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] For port 4402b7af-2a15-48cb-bda5-b588d82f61ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4402b7af-2a15-48cb-bda5-b588d82f61ab,segment=NetworkSegment(bb2286bf-7127-4b8f-ac65-aa5b73d7d00c),segment_id=bb2286bf-7127-4b8f-ac65-aa5b73d7d00c)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:39.567176 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.604517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] Calling delete_port for 4402b7af-2a15-48cb-bda5-b588d82f61ab owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:39.637488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router e69bb93d-78fa-499d-a7af-dfa32819151e is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:11:39.671964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ad6b595f-d532-4631-a472-9bac2d6635e5 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:39.676105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:39.684246 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Calling delete_port for 4402b7af-2a15-48cb-bda5-b588d82f61ab owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:39.821885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:39.828280 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-67a48196-bee4-4be6-83e8-148b8f464112 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/e69bb93d-78fa-499d-a7af-dfa32819151e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2019327 Nov 24 04:11:39.837843 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] Sync routers for ids ['e69bb93d-78fa-499d-a7af-dfa32819151e'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:39.839252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59958) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:39.855639 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] Routers {'e69bb93d-78fa-499d-a7af-dfa32819151e'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:39.856270 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e69bb93d-78fa-499d-a7af-dfa32819151e'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:39.925736 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ad6b595f-d532-4631-a472-9bac2d6635e5 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:39.926090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ad6b595f-d532-4631-a472-9bac2d6635e5 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:39.927926 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:39.946743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da44dd5d-f792-4574-aa8c-28d8b5d9bbeb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:39.952823 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-da44dd5d-f792-4574-aa8c-28d8b5d9bbeb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports/22bf6dde-91fe-4662-b38a-890e3bc47244 HTTP/1.1" status: 200 len: 910 time: 0.1095228 Nov 24 04:11:39.953898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59960) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:39.954342 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] Routers {'e69bb93d-78fa-499d-a7af-dfa32819151e'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:39.955646 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e69bb93d-78fa-499d-a7af-dfa32819151e'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:39.985599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d04d726a-7cfd-4c5a-8b5e-0647c014823d None None] Provisioning complete for port 22bf6dde-91fe-4662-b38a-890e3bc47244 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:39.986334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d04d726a-7cfd-4c5a-8b5e-0647c014823d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.047930 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:40.048859 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21e7221-d11c-41a6-9908-e06e2656d848 None None] The sync data for ids ['e69bb93d-78fa-499d-a7af-dfa32819151e'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:40.060373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d04d726a-7cfd-4c5a-8b5e-0647c014823d None None] Port 22bf6dde-91fe-4662-b38a-890e3bc47244 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:40.068157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.071421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.106497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] Pushing event deleted for resources: {'Port': ['ID=4402b7af-2a15-48cb-bda5-b588d82f61ab,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:40.108647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd7d0907-bfc4-42bb-b0db-f775dd04ec59 None None] No DVR routers for this DVR port 4402b7af-2a15-48cb-bda5-b588d82f61ab on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:40.209413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.231851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.274913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.293463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:40.297293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.355393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.426775 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.433538 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.3635294 Nov 24 04:11:40.433538 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a4375e2f-9fd3-4db5-8e7a-e37ed5be444b admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=8db89885a5504d4e9a252230afb74a38&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9535813 Nov 24 04:11:40.433538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59964) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:40.476632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-49f54674-465f-42cf-821b-5ce032a875a8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:40.477300 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-49f54674-465f-42cf-821b-5ce032a875a8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 24 04:11:40.477803 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-49f54674-465f-42cf-821b-5ce032a875a8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] update failed (client error): There was a conflict when trying to complete your request. Nov 24 04:11:40.482484 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-49f54674-465f-42cf-821b-5ce032a875a8 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "PUT /v2.0/security-groups/75e90b02-960f-49cf-ad40-83d1154de660 HTTP/1.1" status: 409 len: 330 time: 0.0371728 Nov 24 04:11:40.482993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59966) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:40.483329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59968) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:40.495293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.511623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38407603-3bbe-4c14-9681-4bea5ca1534d tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=75e90b02-960f-49cf-ad40-83d1154de660,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:40.542918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.620756 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97202a5-a817-40ec-b6a6-3a912f662dda req-6e4c70ee-93f8-4344-9935-f6e41f338dd4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:40.622414 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f97202a5-a817-40ec-b6a6-3a912f662dda req-6e4c70ee-93f8-4344-9935-f6e41f338dd4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.4300330 Nov 24 04:11:40.652257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.685229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37cbd362-82cf-40ae-842d-7f2dfa55059f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:40.712984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.717267 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b6aaf1bb-1048-4939-bd59-270026f770ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 1.4461241 Nov 24 04:11:40.727335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59974) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:40.786101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9456356d-2213-4a45-9f3b-e8dcdd456c77', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:40.805790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] No DVR routers for this DVR port 4402b7af-2a15-48cb-bda5-b588d82f61ab on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:40.815233 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Port': ['ID=4402b7af-2a15-48cb-bda5-b588d82f61ab,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:40.843616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.913626 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-10337a1d-af48-47f7-a83b-60f60a7e0e5a None None] Provisioning complete for port b581771e-6eb9-46f2-9ad8-a3b0160007c2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:40.914788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-10337a1d-af48-47f7-a83b-60f60a7e0e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.915494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f7be74b-ff5f-4ce7-ae68-fb0d88982fc8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.928659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.929079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.929400 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Floating IP 14190efe-a3ee-4a90-abb0-7635162df195 disassociated. External IP: 172.26.5.168, port: fd98637c-e3c8-4575-be66-b303e573d462. Nov 24 04:11:40.930395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for fd98637c-e3c8-4575-be66-b303e573d462 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:40.947412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8dd399f-2f99-4240-bbf9-1d610d6191cd tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:40.969349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b581771e-6eb9-46f2-9ad8-a3b0160007c2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:40.982308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 22bf6dde-91fe-4662-b38a-890e3bc47244 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:40.983367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.043264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.047864 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f97202a5-a817-40ec-b6a6-3a912f662dda req-bd14c24d-07a9-4198-98b6-4681eb448fb8 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4093006 Nov 24 04:11:41.061467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-10337a1d-af48-47f7-a83b-60f60a7e0e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.084402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b581771e-6eb9-46f2-9ad8-a3b0160007c2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:41.084786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.084982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f7be74b-ff5f-4ce7-ae68-fb0d88982fc8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.087679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.095694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.110704 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 22bf6dde-91fe-4662-b38a-890e3bc47244 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:41.136693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-10337a1d-af48-47f7-a83b-60f60a7e0e5a None None] For port b581771e-6eb9-46f2-9ad8-a3b0160007c2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b581771e-6eb9-46f2-9ad8-a3b0160007c2,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:41.146815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-10337a1d-af48-47f7-a83b-60f60a7e0e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.147534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8dd399f-2f99-4240-bbf9-1d610d6191cd tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.230523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10337a1d-af48-47f7-a83b-60f60a7e0e5a None None] Pushing event updated for resources: {'Port': ['ID=b581771e-6eb9-46f2-9ad8-a3b0160007c2,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.234098 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12205fb4-dac3-4af0-b4b6-24882f86dd40']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:41.272609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-400e427f-3dae-46a7-b54c-56343a4edd8c req-965da5d2-35c5-4f98-b8b6-973288fa7680 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:41.275177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:41.275609 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-400e427f-3dae-46a7-b54c-56343a4edd8c req-965da5d2-35c5-4f98-b8b6-973288fa7680 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1135657 Nov 24 04:11:41.275840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb2286bf-7127-4b8f-ac65-aa5b73d7d00c') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:41.319715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4402b7af-2a15-48cb-bda5-b588d82f61ab no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:41.322395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.360758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.361992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8dd399f-2f99-4240-bbf9-1d610d6191cd tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.364644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b8dd399f-2f99-4240-bbf9-1d610d6191cd tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.368403 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b8dd399f-2f99-4240-bbf9-1d610d6191cd tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/75e90b02-960f-49cf-ad40-83d1154de660 HTTP/1.1" status: 204 len: 168 time: 0.8800368 Nov 24 04:11:41.368833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59978) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.374594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f7be74b-ff5f-4ce7-ae68-fb0d88982fc8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.377109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f7be74b-ff5f-4ce7-ae68-fb0d88982fc8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.380762 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5f7be74b-ff5f-4ce7-ae68-fb0d88982fc8 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/d15877f7-8590-4191-b04b-bf0f7388df80 HTTP/1.1" status: 204 len: 168 time: 0.8939645 Nov 24 04:11:41.386594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.388572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.390296 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 4402b7af-2a15-48cb-bda5-b588d82f61ab {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:41.390834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4402b7af-2a15-48cb-bda5-b588d82f61ab not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:41.412846 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-400e427f-3dae-46a7-b54c-56343a4edd8c req-1460f760-44b0-4b24-9634-fd1810c814ab tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1211457 Nov 24 04:11:41.434969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8dd399f-2f99-4240-bbf9-1d610d6191cd tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=75e90b02-960f-49cf-ad40-83d1154de660,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.447424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Releasing vlan 159 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:41.447848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:41.450972 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:41.472677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.485560 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c01e4eec-a914-4f1d-b345-f81d7bbf95da tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1154861 Nov 24 04:11:41.489441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59984) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.491724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3999397e-0007-492a-ad9b-95694ee0f7a7,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.494007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.517667 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7be74b-ff5f-4ce7-ae68-fb0d88982fc8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d15877f7-8590-4191-b04b-bf0f7388df80,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.521422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.522690 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8c3e7b59-7f27-43c2-9113-c5d037a83048 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7623150 Nov 24 04:11:41.547713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59986) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.561839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9456356d-2213-4a45-9f3b-e8dcdd456c77', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:41.571077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=22bf6dde-91fe-4662-b38a-890e3bc47244,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.581649 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-f60eac6c-a7f3-4ee1-9308-6ef4bb052779 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] delete failed (client error): The resource could not be found. Nov 24 04:11:41.584820 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f60eac6c-a7f3-4ee1-9308-6ef4bb052779 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "DELETE /v2.0/security-groups/7e07c671-ab3a-4345-bc95-694a86bde625 HTTP/1.1" status: 404 len: 347 time: 0.0939848 Nov 24 04:11:41.594013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59988) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.619929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:41.627727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.635548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:41.653981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-223be363-76d9-40dd-9ec0-16b3bcb94b6a None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:41.655042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:41.656010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.660424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.690854 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-b9e612d1-9f56-4cfd-938d-86b881fe310a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] show failed (client error): The resource could not be found. Nov 24 04:11:41.696828 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b9e612d1-9f56-4cfd-938d-86b881fe310a tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-groups/0e6c911e-fadc-4e63-ad94-e9670fb22302 HTTP/1.1" status: 404 len: 347 time: 0.0835752 Nov 24 04:11:41.697010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.699470 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "DELETE /v2.0/networks/12205fb4-dac3-4af0-b4b6-24882f86dd40 HTTP/1.1" status: 204 len: 168 time: 3.1001861 Nov 24 04:11:41.704195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59990) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.704568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 59992) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.727748 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.751343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=fd98637c-e3c8-4575-be66-b303e573d462,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.758171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f006d00-7c6c-4593-bacb-12f30fe3d8ea tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Network': ['ID=12205fb4-dac3-4af0-b4b6-24882f86dd40,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:41.773929 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-30a58c64-1e81-4d9b-80a7-66602397d053 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.6179528 Nov 24 04:11:41.781477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c8ea50-73f3-48e6-90f5-5d0e82167474 req-bac05098-bf91-4241-8abd-27d5a9821969 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:41.783209 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e2c8ea50-73f3-48e6-90f5-5d0e82167474 req-bac05098-bf91-4241-8abd-27d5a9821969 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2020414 Nov 24 04:11:41.783767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 59994) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:41.789133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:c4:67:9a', 'name': 'tempest-NetworksTestDHCPv6-1201560408'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:41.809308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:41.834100 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-c2616cb3-7c24-4e89-87ef-3f72316cde55 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] show failed (client error): The resource could not be found. Nov 24 04:11:41.836157 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c2616cb3-7c24-4e89-87ef-3f72316cde55 tempest-NegativeSecGroupTest-752649303 tempest-NegativeSecGroupTest-752649303-project] 10.222.0.48 "GET /v2.0/security-group-rules/c7415d9b-7e63-4a94-914b-b3d9d7ff5865 HTTP/1.1" status: 404 len: 356 time: 0.1194925 Nov 24 04:11:42.078759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] Update dhcp port {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'fixed_ips': [{'subnet_id': '5f976dae-965d-47b3-a563-55c7d34c38e9', 'ip_address': '2001:db8::f816:3eff:fef1:bb1a'}, {'subnet_id': '8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': 'b581771e-6eb9-46f2-9ad8-a3b0160007c2'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:11:42.106023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.118728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:42.206253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.209696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.211918 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e2c8ea50-73f3-48e6-90f5-5d0e82167474 req-da0df4f8-98c4-43d5-8b24-3e3f16dcbef0 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4165645 Nov 24 04:11:42.264605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router 77998923-4d69-4ee7-8022-cc3100950059 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:42.299695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.379116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] Allocated IP 2001:db8:0:1::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1/b581771e-6eb9-46f2-9ad8-a3b0160007c2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:42.411687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.415675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port c87327c2-819d-4e5b-aa5f-66202fec651a yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:42.434028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.459984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60010) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:42.513447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9899dfbf-c25d-4569-88df-4be7ef02753b,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:42.527348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Deleting port 6b9a35b3-3efe-4b5b-b831-575209b85d34 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:42.528125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.531848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.536352 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60018) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:42.536572 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-631ed3d4-08be-4eb5-b1cb-33167d069c2b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.9861248 Nov 24 04:11:42.543001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9456356d-2213-4a45-9f3b-e8dcdd456c77', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:42.555546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:42.558266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] For port b581771e-6eb9-46f2-9ad8-a3b0160007c2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b581771e-6eb9-46f2-9ad8-a3b0160007c2,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:42.581568 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] Sync routers for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:42.631406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.633322 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:42.633959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:42.649155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.666396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router e69bb93d-78fa-499d-a7af-dfa32819151e has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:42.701864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.702479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.754814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:42.773905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.788640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Calling delete_port for 6b9a35b3-3efe-4b5b-b831-575209b85d34 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:42.828036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:42.838845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:42.842083 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b359d39e-1615-4373-a0cf-36adb1485a44 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/ports/fd98637c-e3c8-4575-be66-b303e573d462 HTTP/1.1" status: 204 len: 168 time: 3.8950751 Nov 24 04:11:42.842435 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] Sync routers for ids ['e69bb93d-78fa-499d-a7af-dfa32819151e'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:42.857184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:42.857980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:42.869953 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] Routers {'e69bb93d-78fa-499d-a7af-dfa32819151e'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:42.874928 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-37f15c11-82cc-4721-86cf-2e87d8d383ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/e69bb93d-78fa-499d-a7af-dfa32819151e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9180410 Nov 24 04:11:42.875248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60024) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:42.881862 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e69bb93d-78fa-499d-a7af-dfa32819151e'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:42.889376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60026) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:42.918640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:42.919732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa542aad-02d3-4a84-b2f4-f030ca6f8f21 None None] The sync data for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:42.922779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4c0778-5c93-4470-9a60-62006603cfb0 None None] Pushing event updated for resources: {'Port': ['ID=b581771e-6eb9-46f2-9ad8-a3b0160007c2,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:42.930566 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4c8a7d8d-d9c9-4996-af68-f748d8784315 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=e69bb93d-78fa-499d-a7af-dfa32819151e HTTP/1.1" status: 200 len: 205 time: 0.0397191 Nov 24 04:11:42.935954 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-49ba6032-5828-4073-aa9b-56538a424565 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=8b32b866b8024332a00edf86419c8deb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4688315 Nov 24 04:11:42.936791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60028) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:42.940240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60030) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:42.968200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7b783d-256e-469c-84be-29098dce00b6 req-e86b8643-a5f0-438f-84ad-d2faf359fa1d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:42.969470 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bf7b783d-256e-469c-84be-29098dce00b6 req-e86b8643-a5f0-438f-84ad-d2faf359fa1d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.3297968 Nov 24 04:11:42.986289 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:42.998578 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] Routers {'e69bb93d-78fa-499d-a7af-dfa32819151e'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:42.999500 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e69bb93d-78fa-499d-a7af-dfa32819151e'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:43.057551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b581771e-6eb9-46f2-9ad8-a3b0160007c2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:43.066205 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:43.077832 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dfe1360-f981-4d88-8a61-f62b429ce2b1 None None] The sync data for ids ['e69bb93d-78fa-499d-a7af-dfa32819151e'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:43.177865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.205265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b581771e-6eb9-46f2-9ad8-a3b0160007c2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:43.205861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.270617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f9f5fb9c-bdb9-4076-8637-d86a3581ac2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.341023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60036) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:43.402503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8:0:1::142 (a2b36c78-43a6-4954-8102-cb5638999bb1/8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1/c87327c2-819d-4e5b-aa5f-66202fec651a) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:43.423134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f9f5fb9c-bdb9-4076-8637-d86a3581ac2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.430173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.432433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::f816:3eff:fec4:679a (a2b36c78-43a6-4954-8102-cb5638999bb1/5f976dae-965d-47b3-a563-55c7d34c38e9/c87327c2-819d-4e5b-aa5f-66202fec651a) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:43.449796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.450646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.454445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.485798 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bf7b783d-256e-469c-84be-29098dce00b6 req-441bac49-da46-4162-9437-27471c46e768 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4972985 Nov 24 04:11:43.498428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.499778 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.9608614 Nov 24 04:11:43.510304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60040) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:43.515085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.519883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9456356d-2213-4a45-9f3b-e8dcdd456c77', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:43.539354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61279252-1518-466b-8cf1-8cb3b776411f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c57d68fa-8361-41be-aa2d-a33e6177f0b4,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:43.557076 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6999e6f4-49a9-471c-9498-d76d201728bb tempest-ServiceProvidersTest-432340707 tempest-ServiceProvidersTest-432340707-project] 10.222.0.48 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.2129560 Nov 24 04:11:43.559443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Pushing event deleted for resources: {'Port': ['ID=6b9a35b3-3efe-4b5b-b831-575209b85d34,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:43.561506 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.562230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router e69bb93d-78fa-499d-a7af-dfa32819151e {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:11:43.573218 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.574963 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0fdfe051-f4cb-48e9-a8c2-86587d378a44 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/e69bb93d-78fa-499d-a7af-dfa32819151e HTTP/1.1" status: 204 len: 168 time: 0.6355143 Nov 24 04:11:43.578670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60044) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:43.669918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f9f5fb9c-bdb9-4076-8637-d86a3581ac2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.672393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f9f5fb9c-bdb9-4076-8637-d86a3581ac2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.673558 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f9f5fb9c-bdb9-4076-8637-d86a3581ac2e admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/28c45979-da3c-421e-92e8-051a6aadb8b8 HTTP/1.1" status: 204 len: 168 time: 0.7263768 Nov 24 04:11:43.704922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet 86b66dec-73bb-497a-a092-63fdb23e66a0 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:43.708253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f5fb9c-bdb9-4076-8637-d86a3581ac2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28c45979-da3c-421e-92e8-051a6aadb8b8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:43.713567 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.739357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.742716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.743871 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e564fda6-6eb7-4148-a874-264dcc95705b tempest-FloatingIPAdminTestJSON-98642835 tempest-FloatingIPAdminTestJSON-98642835-project] 10.222.0.48 "DELETE /v2.0/floatingips/9882f860-20a4-41dd-ac89-bbf7ec286245 HTTP/1.1" status: 204 len: 168 time: 2.0180416 Nov 24 04:11:43.771826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.803878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.833587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ab0bfdc6-568e-4044-b4de-dfb537247e6b None None] Provisioning complete for port b581771e-6eb9-46f2-9ad8-a3b0160007c2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:43.833973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ab0bfdc6-568e-4044-b4de-dfb537247e6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.889380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:43.948493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.009812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.041833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9bb3274-df7f-48b8-9bb0-ebbc30916b0e None None] Network 34bef754-aa38-4d28-ad64-185579b03242 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:44.058410 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.070112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.074009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.075071 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/86b66dec-73bb-497a-a092-63fdb23e66a0 HTTP/1.1" status: 204 len: 168 time: 0.4939678 Nov 24 04:11:44.076620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29944ca-5616-4467-a964-fff1974e3122 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=86b66dec-73bb-497a-a092-63fdb23e66a0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:44.080889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60054) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.082993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60056) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.124797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.140004 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ec8e37e0-6d84-4371-a78a-be384664404f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:44.198099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.199279 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dada116d-533b-4208-9270-3b90d136a646 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.6842017 Nov 24 04:11:44.202872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60064) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.247508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e112330a-a66f-4575-be66-c77caa4ea265 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.256712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:44.257365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e112330a-a66f-4575-be66-c77caa4ea265 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.266231 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=c87327c2-819d-4e5b-aa5f-66202fec651a,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:44.270048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:44.278060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.281590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:44.290601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:44.291304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.302576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e112330a-a66f-4575-be66-c77caa4ea265 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.321049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e112330a-a66f-4575-be66-c77caa4ea265 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.325455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e112330a-a66f-4575-be66-c77caa4ea265 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/ec8e37e0-6d84-4371-a78a-be384664404f HTTP/1.1" status: 204 len: 168 time: 0.1189098 Nov 24 04:11:44.326215 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6b7e8426-c5e4-40ea-a76a-e6dde19e155c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 2.5411084 Nov 24 04:11:44.327465 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60068) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.334505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60070) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.347449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60072) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.352011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] DHCP port deletion for 34bef754-aa38-4d28-ad64-185579b03242 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:44.368485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e112330a-a66f-4575-be66-c77caa4ea265 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=ec8e37e0-6d84-4371-a78a-be384664404f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:44.388212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.439200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] Deleting port f462307c-16f4-4297-9ce6-7e609b1b1172 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:44.439802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.439928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6a50265b-a5af-4e76-aafd-887bbc15cb17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.529010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] For port f462307c-16f4-4297-9ce6-7e609b1b1172, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f462307c-16f4-4297-9ce6-7e609b1b1172,segment=NetworkSegment(8d21e374-3dbb-4722-b35d-9a17d222359d),segment_id=8d21e374-3dbb-4722-b35d-9a17d222359d)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:44.530439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.548594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] Calling delete_port for f462307c-16f4-4297-9ce6-7e609b1b1172 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:44.668823 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-81460190-d92a-4045-b228-d629a9448154 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.3400137 Nov 24 04:11:44.673631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60084) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.680502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.718786 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d4d22cb1-b7ea-4557-944d-c187b83eedbb admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=1610a0f31b814395a8b827274e159eaf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3701682 Nov 24 04:11:44.724455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60088) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.734230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] Pushing event deleted for resources: {'Port': ['ID=f462307c-16f4-4297-9ce6-7e609b1b1172,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:44.743176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65061688-26e1-4917-87e8-60e099d1aaa3 None None] No DVR routers for this DVR port f462307c-16f4-4297-9ce6-7e609b1b1172 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:44.763693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6a50265b-a5af-4e76-aafd-887bbc15cb17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.779928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d316d3bd-51c5-48fa-9c36-7e58b118c040 req-ba1d55f4-1c58-4610-a72c-11aeb297dfa4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:44.781888 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d316d3bd-51c5-48fa-9c36-7e58b118c040 req-ba1d55f4-1c58-4610-a72c-11aeb297dfa4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1616652 Nov 24 04:11:44.784330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6a50265b-a5af-4e76-aafd-887bbc15cb17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.787220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12153e24-9092-4f06-a9bc-bd6b05a07163 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.790457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port f462307c-16f4-4297-9ce6-7e609b1b1172 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:44.790786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.798117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-aad135ff-f045-4b3b-a6ac-86664667f6c1 None None] Provisioning complete for port c87327c2-819d-4e5b-aa5f-66202fec651a triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:44.798527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-aad135ff-f045-4b3b-a6ac-86664667f6c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.841541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12153e24-9092-4f06-a9bc-bd6b05a07163 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:44.862734 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a50265b-a5af-4e76-aafd-887bbc15cb17 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=f40188aa054641d99f8b31f5266bb22c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7653182 Nov 24 04:11:44.862841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60092) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:44.877464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-aad135ff-f045-4b3b-a6ac-86664667f6c1 None None] Port c87327c2-819d-4e5b-aa5f-66202fec651a cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:44.891448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a50265b-a5af-4e76-aafd-887bbc15cb17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a123763c-d53b-4785-8642-4dc66758ca24,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:44.949494 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d316d3bd-51c5-48fa-9c36-7e58b118c040 req-23bb4265-b77e-420a-b8a3-11d291acc265 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1476953 Nov 24 04:11:44.973525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b581771e-6eb9-46f2-9ad8-a3b0160007c2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:44.995299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port c87327c2-819d-4e5b-aa5f-66202fec651a {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:44.995544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.041735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b581771e-6eb9-46f2-9ad8-a3b0160007c2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:45.042577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.050180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fef531b-023b-4a44-86dd-13f058cbec3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.056611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port f462307c-16f4-4297-9ce6-7e609b1b1172, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:45.056973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.093352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60104) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.095421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12153e24-9092-4f06-a9bc-bd6b05a07163 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.201270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12153e24-9092-4f06-a9bc-bd6b05a07163 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.204956 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-12153e24-9092-4f06-a9bc-bd6b05a07163 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/c57d68fa-8361-41be-aa2d-a33e6177f0b4 HTTP/1.1" status: 204 len: 168 time: 0.5069652 Nov 24 04:11:45.205286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60112) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.218581 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fef531b-023b-4a44-86dd-13f058cbec3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.225038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for f462307c-16f4-4297-9ce6-7e609b1b1172 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:45.227483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12153e24-9092-4f06-a9bc-bd6b05a07163 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c57d68fa-8361-41be-aa2d-a33e6177f0b4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:45.251662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Port f462307c-16f4-4297-9ce6-7e609b1b1172 was not found and therefore no delete operation was performed {{(pid=103380) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:11:45.265756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f462307c-16f4-4297-9ce6-7e609b1b1172 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:45.272799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.292256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d9ff0f94-c891-4c7c-8275-d073ba0711e0 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-1833924242', 'prefixes': ['172.20.0.0/16']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:45.303193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: f462307c-16f4-4297-9ce6-7e609b1b1172 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:45.303718 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f462307c-16f4-4297-9ce6-7e609b1b1172 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:45.312881 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9091b457-7360-48f9-aedf-cab2d2e50a1e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.1062963 Nov 24 04:11:45.338305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60114) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.355546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=f462307c-16f4-4297-9ce6-7e609b1b1172,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:45.357341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a097b289-9103-43d6-8870-676cc9d8bdef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.361325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port f462307c-16f4-4297-9ce6-7e609b1b1172 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:45.368471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.410510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f8deae3-51d8-4a2a-b5da-f8c23cb08adf tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.424957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d7cd53-55c2-48e5-a4e9-f17b26ad2c38 req-105f8b40-ccc6-491d-94b6-e9b875b7192d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:45.425113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for c87327c2-819d-4e5b-aa5f-66202fec651a owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:45.431685 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8d7cd53-55c2-48e5-a4e9-f17b26ad2c38 req-105f8b40-ccc6-491d-94b6-e9b875b7192d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1887434 Nov 24 04:11:45.441417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f8deae3-51d8-4a2a-b5da-f8c23cb08adf tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.449183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-5399797a-c2b2-42e8-bd28-ef478de2330b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:45.450743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-5399797a-c2b2-42e8-bd28-ef478de2330b service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.1539478 Nov 24 04:11:45.457843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a097b289-9103-43d6-8870-676cc9d8bdef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.487635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fef531b-023b-4a44-86dd-13f058cbec3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.489324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fef531b-023b-4a44-86dd-13f058cbec3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.493710 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0fef531b-023b-4a44-86dd-13f058cbec3f admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/89a09ced-f235-4be1-9f85-a54d837d81a1 HTTP/1.1" status: 204 len: 168 time: 0.7635703 Nov 24 04:11:45.542602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f8deae3-51d8-4a2a-b5da-f8c23cb08adf tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.575637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f8deae3-51d8-4a2a-b5da-f8c23cb08adf tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.579558 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9f8deae3-51d8-4a2a-b5da-f8c23cb08adf tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/9899dfbf-c25d-4569-88df-4be7ef02753b HTTP/1.1" status: 204 len: 168 time: 0.2367222 Nov 24 04:11:45.581495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60120) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.589095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fef531b-023b-4a44-86dd-13f058cbec3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89a09ced-f235-4be1-9f85-a54d837d81a1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:45.603032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8deae3-51d8-4a2a-b5da-f8c23cb08adf tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9899dfbf-c25d-4569-88df-4be7ef02753b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:45.621765 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8d7cd53-55c2-48e5-a4e9-f17b26ad2c38 req-284a3b77-dc68-4a1d-8ca5-18c3926dbac7 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1891057 Nov 24 04:11:45.632568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9ff0f94-c891-4c7c-8275-d073ba0711e0 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] Publish callbacks [] for subnetpool, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.637898 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d9ff0f94-c891-4c7c-8275-d073ba0711e0 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] 10.222.0.48 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 737 time: 0.5411630 Nov 24 04:11:45.641756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60122) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.642453 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.692558 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['34bef754-aa38-4d28-ad64-185579b03242']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:45.713834 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f2f71ebc-d41b-43cb-a2f8-b4b91ed2392e tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] 10.222.0.48 "GET /v2.0/subnetpools/8997cbb5-47a3-4bbc-997c-20db2d25c4cb HTTP/1.1" status: 200 len: 732 time: 0.0661724 Nov 24 04:11:45.714715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60124) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.715844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d21e374-3dbb-4722-b35d-9a17d222359d') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:45.716033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d21e374-3dbb-4722-b35d-9a17d222359d') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:45.727403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8adf5a58-3eb5-4732-881b-f95f6c243675 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-303323888'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:45.731460 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.734872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-ae34c351-d92b-4aa9-8974-a08910337e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:45.737288 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-ae34c351-d92b-4aa9-8974-a08910337e46 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.2666132 Nov 24 04:11:45.753774 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d185b5f7-f14f-4f07-956c-102c06b8a850 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.1630263 Nov 24 04:11:45.761735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60128) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.781295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a097b289-9103-43d6-8870-676cc9d8bdef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.783951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a097b289-9103-43d6-8870-676cc9d8bdef admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.785084 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a097b289-9103-43d6-8870-676cc9d8bdef admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/a123763c-d53b-4785-8642-4dc66758ca24 HTTP/1.1" status: 204 len: 168 time: 0.8936195 Nov 24 04:11:45.787837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.798224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 684738f9-c16f-4f7d-bb3b-f152072ccfde {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:45.798590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.813579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 192 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:45.814204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:45.827507 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:45.856690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a097b289-9103-43d6-8870-676cc9d8bdef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a123763c-d53b-4785-8642-4dc66758ca24,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:45.873769 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-15a02c91-5fa8-4006-89fb-eadc8e87a548 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1001 time: 0.1254339 Nov 24 04:11:45.894189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dec86a4-f9e4-4466-913c-c018d008c661 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.941014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8adf5a58-3eb5-4732-881b-f95f6c243675 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] Publish callbacks [] for subnetpool, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.943263 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8adf5a58-3eb5-4732-881b-f95f6c243675 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] 10.222.0.48 "PUT /v2.0/subnetpools/8997cbb5-47a3-4bbc-997c-20db2d25c4cb HTTP/1.1" status: 200 len: 683 time: 0.2278802 Nov 24 04:11:45.946594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60132) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.982584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dec86a4-f9e4-4466-913c-c018d008c661 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:45.982795 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60134) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:45.999695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-817bb6ae-2a46-4767-9080-1be8a948473a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.001195 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-817bb6ae-2a46-4767-9080-1be8a948473a service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.1208003 Nov 24 04:11:46.022301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df14c04b-5ab9-46f8-baa8-003dc24eccc5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.038272 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.083094 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.091756 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/34bef754-aa38-4d28-ad64-185579b03242 HTTP/1.1" status: 204 len: 168 time: 2.0033808 Nov 24 04:11:46.092016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60136) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.100829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-16014811', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:46.107447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.112966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2c314d9-b8c4-4759-b46f-64cce08d6e9d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=34bef754-aa38-4d28-ad64-185579b03242,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:46.122240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dec86a4-f9e4-4466-913c-c018d008c661 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.139529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2dec86a4-f9e4-4466-913c-c018d008c661 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.143232 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2dec86a4-f9e4-4466-913c-c018d008c661 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/3999397e-0007-492a-ad9b-95694ee0f7a7 HTTP/1.1" status: 204 len: 168 time: 0.3779192 Nov 24 04:11:46.144434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60138) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.144931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 684738f9-c16f-4f7d-bb3b-f152072ccfde owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:46.154730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dec86a4-f9e4-4466-913c-c018d008c661 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=3999397e-0007-492a-ad9b-95694ee0f7a7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:46.169032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.173575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e1f5a2b7-2150-4e2c-bc4f-445902f60809 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] Publish callbacks [] for subnetpool, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.177524 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e1f5a2b7-2150-4e2c-bc4f-445902f60809 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] 10.222.0.48 "DELETE /v2.0/subnetpools/8997cbb5-47a3-4bbc-997c-20db2d25c4cb HTTP/1.1" status: 204 len: 168 time: 0.2234807 Nov 24 04:11:46.177524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-302049bb-925f-420a-bce3-b442a37ceae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.178392 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-302049bb-925f-420a-bce3-b442a37ceae4 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1693058 Nov 24 04:11:46.181006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60140) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.183587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.184066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.230510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=c87327c2-819d-4e5b-aa5f-66202fec651a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:46.243966 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-dd872f6b-da52-4ec2-b718-05b34fd9ef7d tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] show failed (client error): The resource could not be found. Nov 24 04:11:46.243966 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dd872f6b-da52-4ec2-b718-05b34fd9ef7d tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] 10.222.0.48 "GET /v2.0/subnetpools/8997cbb5-47a3-4bbc-997c-20db2d25c4cb HTTP/1.1" status: 404 len: 346 time: 0.0561252 Nov 24 04:11:46.258054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60142) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.300480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.304074 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-63b47a99-a66a-4f98-8999-33482827d26b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/c87327c2-819d-4e5b-aa5f-66202fec651a HTTP/1.1" status: 204 len: 168 time: 1.9684892 Nov 24 04:11:46.309590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60144) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.413227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90379dde-0728-44a3-b55f-d9dd3eabb459 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.418302 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-90379dde-0728-44a3-b55f-d9dd3eabb459 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.1043837 Nov 24 04:11:46.419427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60146) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.512257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-851f85c7-b4e9-4a16-9a25-87929c4dd9ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.516381 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-851f85c7-b4e9-4a16-9a25-87929c4dd9ac tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0942857 Nov 24 04:11:46.517788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60148) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.550112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.586029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=684738f9-c16f-4f7d-bb3b-f152072ccfde,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:46.648995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d1d88b0-d650-43c5-a969-d061b3e98068 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.650699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d1d88b0-d650-43c5-a969-d061b3e98068 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.652237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d1d88b0-d650-43c5-a969-d061b3e98068 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:46.656406 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9d1d88b0-d650-43c5-a969-d061b3e98068 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.1351717 Nov 24 04:11:46.657143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60152) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.684978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df14c04b-5ab9-46f8-baa8-003dc24eccc5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.700109 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-75ab3d70-017d-4b3f-ac61-0412e905ae6c tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.5536358 Nov 24 04:11:46.702916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60154) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.705558 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-fed54f12-591f-42ad-855d-380e39ccfdb7 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] delete failed (client error): The resource could not be found. Nov 24 04:11:46.714220 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fed54f12-591f-42ad-855d-380e39ccfdb7 tempest-SubnetPoolsTestJSON-506469173 tempest-SubnetPoolsTestJSON-506469173-project] 10.222.0.48 "DELETE /v2.0/subnetpools/8997cbb5-47a3-4bbc-997c-20db2d25c4cb HTTP/1.1" status: 404 len: 346 time: 0.4456847 Nov 24 04:11:46.714220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.714220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df14c04b-5ab9-46f8-baa8-003dc24eccc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.756131 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-df14c04b-5ab9-46f8-baa8-003dc24eccc5 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=be0fce88284e42b98f32df71ede0614e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7706988 Nov 24 04:11:46.779506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60158) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:46.915852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:46.923162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df14c04b-5ab9-46f8-baa8-003dc24eccc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b8c966b-33c0-4629-b689-319536d16ad0,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:46.931283 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-92e5d7ed-9651-4da5-a0e5-c0f82e8788f8 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7423644 Nov 24 04:11:47.112231 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-04af421c-4228-4890-92c6-d80e09cc3f34 req-bcfdd319-804a-4335-a8b6-b36888f52c30 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1633584 Nov 24 04:11:47.186537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2162fa5-ffa4-4e84-965e-1160134830c4 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.188632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.205682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60162) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:47.215778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 5f976dae-965d-47b3-a563-55c7d34c38e9 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:47.246442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2162fa5-ffa4-4e84-965e-1160134830c4 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.257461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.291979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.323336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.330427 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-6b6fa2a2-ee25-4b4c-9649-282189f80277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:47.330607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-393f8ea3-9e84-4cb0-9464-b18fab50c3dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.330741 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-6b6fa2a2-ee25-4b4c-9649-282189f80277 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=db5849637d02441e8e7822da79f37b83&device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 1098 time: 0.1007755 Nov 24 04:11:47.375379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48135f8f-c034-4290-8758-c2753a382edd req-fa93bdf3-365c-4c66-9dfc-3ab4ebb6e2df tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:47.376874 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-48135f8f-c034-4290-8758-c2753a382edd req-fa93bdf3-365c-4c66-9dfc-3ab4ebb6e2df tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.5996768 Nov 24 04:11:47.426778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.456836 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f33ecfc-3689-41a3-ab25-7bfac8f2a631 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.458593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2162fa5-ffa4-4e84-965e-1160134830c4 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.474138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2162fa5-ffa4-4e84-965e-1160134830c4 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.475260 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f2162fa5-ffa4-4e84-965e-1160134830c4 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/37cbd362-82cf-40ae-842d-7f2dfa55059f HTTP/1.1" status: 204 len: 168 time: 0.7700105 Nov 24 04:11:47.478914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60166) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:47.483950 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-393f8ea3-9e84-4cb0-9464-b18fab50c3dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.512005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-6347a454-6eac-4140-8104-ccd486019933 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:47.513457 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-6347a454-6eac-4140-8104-ccd486019933 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 200 len: 913 time: 0.1562419 Nov 24 04:11:47.552414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2162fa5-ffa4-4e84-965e-1160134830c4 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=37cbd362-82cf-40ae-842d-7f2dfa55059f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:47.596760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.26.5.61 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/68e59667-da85-4c51-a532-430d4bc0e63f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:47.627375 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bdac7ed6-1a41-42f2-8e4b-ade22aa141fb tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1452155 Nov 24 04:11:47.634261 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60168) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:47.637748 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-48135f8f-c034-4290-8758-c2753a382edd req-34448771-cd15-42ca-be82-8db8d06f85b4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2384717 Nov 24 04:11:47.643679 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-316e7e98-9f9a-4a9a-b471-d9c0fecb250f service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 200 len: 1001 time: 0.1189215 Nov 24 04:11:47.700824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.755898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-393f8ea3-9e84-4cb0-9464-b18fab50c3dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.759034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-393f8ea3-9e84-4cb0-9464-b18fab50c3dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.762002 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-393f8ea3-9e84-4cb0-9464-b18fab50c3dc admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/3b8c966b-33c0-4629-b689-319536d16ad0 HTTP/1.1" status: 204 len: 168 time: 0.9796791 Nov 24 04:11:47.785236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-08c5632d-54ed-4acd-a7e4-4d4d365155ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:47.786448 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-08c5632d-54ed-4acd-a7e4-4d4d365155ca service neutron] 10.222.0.21 "GET /v2.0/subnets?id=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 200 len: 851 time: 0.1308916 Nov 24 04:11:47.817289 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393f8ea3-9e84-4cb0-9464-b18fab50c3dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b8c966b-33c0-4629-b689-319536d16ad0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:47.841788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6ea2bd1-3220-40eb-813a-9a6cad6ac131 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.853877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.869219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.884420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6ea2bd1-3220-40eb-813a-9a6cad6ac131 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.893299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f33ecfc-3689-41a3-ab25-7bfac8f2a631 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.918712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router 77998923-4d69-4ee7-8022-cc3100950059 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:47.919723 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=5f976dae-965d-47b3-a563-55c7d34c38e9,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:47.923123 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-877467b2-1401-43b6-b6a5-3b63de9f8992 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:47.923561 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f33ecfc-3689-41a3-ab25-7bfac8f2a631 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.924648 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-877467b2-1401-43b6-b6a5-3b63de9f8992 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4064fe6e-1a4a-440d-8829-8ec4922458b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1289136 Nov 24 04:11:47.928559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:47.934350 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-84330086-2dcf-4f9d-88a8-67f4b9b63198 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/5f976dae-965d-47b3-a563-55c7d34c38e9 HTTP/1.1" status: 204 len: 168 time: 1.2735391 Nov 24 04:11:47.934591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60172) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:47.937392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41eccb62-f3fb-4011-a57d-9c36846c7ec6 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:47.978313 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2f33ecfc-3689-41a3-ab25-7bfac8f2a631 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=0b3e87d0c79c477d853b8e215a9a3f2c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7700331 Nov 24 04:11:48.009175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60176) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.022299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f33ecfc-3689-41a3-ab25-7bfac8f2a631 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40adc8b7-a33a-420c-afff-699cc894f80e,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:48.054777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6ea2bd1-3220-40eb-813a-9a6cad6ac131 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.057258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6ea2bd1-3220-40eb-813a-9a6cad6ac131 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.058491 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b6ea2bd1-3220-40eb-813a-9a6cad6ac131 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/9456356d-2213-4a45-9f3b-e8dcdd456c77 HTTP/1.1" status: 204 len: 168 time: 0.4233484 Nov 24 04:11:48.067903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60178) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.099785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.139666 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4963d21b-3eed-482e-a8bb-4930d69055b3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0667908 Nov 24 04:11:48.139897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:48.139988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:48.139988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60180) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.144996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--1488200603'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:48.153604 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a8f648b4-2f3d-4c35-a332-bc123e8e1663 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/routers/77998923-4d69-4ee7-8022-cc3100950059/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2721925 Nov 24 04:11:48.156497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60182) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.165913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] Sync routers for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:48.186455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:48.187388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:48.189653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ea2bd1-3220-40eb-813a-9a6cad6ac131 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9456356d-2213-4a45-9f3b-e8dcdd456c77,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:48.211602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.227084 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.238496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:48.239302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=68e59667-da85-4c51-a532-430d4bc0e63f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:48.255091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:48.255561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:48.263139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60184) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.268585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] Routers {'77998923-4d69-4ee7-8022-cc3100950059'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:48.269206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['77998923-4d69-4ee7-8022-cc3100950059'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:48.280545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:48.309177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:48.310562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c9b084a-5101-4fa8-94ff-179898c8fe21 None None] The sync data for ids ['77998923-4d69-4ee7-8022-cc3100950059'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:48.320403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a491b9b0-c960-40e0-9602-36afb3a4a0da None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:48.325995 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-64bda6c9-21d7-467d-993a-b187cefd3108 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3902369 Nov 24 04:11:48.331431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.336285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.337008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ca6d769-06f5-4ab0-8c7d-753575120f8a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.413205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0157d297-3e58-4623-afde-b462fff36731 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.440228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1321b58e-b5da-407e-b3a6-965f8acf1cc9 None None] Provisioning complete for port 68e59667-da85-4c51-a532-430d4bc0e63f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:48.440613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1321b58e-b5da-407e-b3a6-965f8acf1cc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.449142 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.460218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.495150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1321b58e-b5da-407e-b3a6-965f8acf1cc9 None None] Port 68e59667-da85-4c51-a532-430d4bc0e63f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:48.499058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.504417 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3595471 Nov 24 04:11:48.506191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60186) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.512970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '6727227e-6161-4dd1-b637-b240c34d0f72', 'direction': 'ingress', 'protocol': 17}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:48.526727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0157d297-3e58-4623-afde-b462fff36731 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.528445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a258389a-b3dd-41dc-9ef3-e64ac641b37f tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6727227e-6161-4dd1-b637-b240c34d0f72,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:48.532943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.586593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.642862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 7259cabb-83db-4063-84a3-d1c6aa82e64b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:48.643210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.662106 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.674918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.719333 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c3aa8a2c-c6c3-45f6-9a7f-330409183c44 req-bb27ffda-2512-44c3-aadb-17ac7f36a123 service neutron] 10.222.0.21 "GET /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3689632 Nov 24 04:11:48.743764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=705e62c1-fb0b-4cf6-9c90-712dc81f827c,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:48.761113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.766316 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6add3db7-67f2-493f-a3c9-c385cf7b03a7 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.2530098 Nov 24 04:11:48.766316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60190) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:48.769570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.812804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.841575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 7259cabb-83db-4063-84a3-d1c6aa82e64b owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:48.868347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2f6c710-170e-4ed7-9f40-3f15fbc88cbd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.903282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0157d297-3e58-4623-afde-b462fff36731 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.905893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0157d297-3e58-4623-afde-b462fff36731 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.907126 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0157d297-3e58-4623-afde-b462fff36731 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/40adc8b7-a33a-420c-afff-699cc894f80e HTTP/1.1" status: 204 len: 168 time: 0.8935301 Nov 24 04:11:48.925652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2f6c710-170e-4ed7-9f40-3f15fbc88cbd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.938906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ca6d769-06f5-4ab0-8c7d-753575120f8a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.959371 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4ca6d769-06f5-4ab0-8c7d-753575120f8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:48.983231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0157d297-3e58-4623-afde-b462fff36731 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40adc8b7-a33a-420c-afff-699cc894f80e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:48.998292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226b60ec-61bb-4447-a185-8043444d3bcd req-7b5bc5c7-ed12-4703-b621-46fd89664b61 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:49.000264 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-226b60ec-61bb-4447-a185-8043444d3bcd req-7b5bc5c7-ed12-4703-b621-46fd89664b61 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2612765 Nov 24 04:11:49.012113 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4ca6d769-06f5-4ab0-8c7d-753575120f8a admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=e0cf64180bbe4bca943111abe4014dc4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7460520 Nov 24 04:11:49.015115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60194) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:49.057045 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2f6c710-170e-4ed7-9f40-3f15fbc88cbd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.059885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2f6c710-170e-4ed7-9f40-3f15fbc88cbd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.061204 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d2f6c710-170e-4ed7-9f40-3f15fbc88cbd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/6727227e-6161-4dd1-b637-b240c34d0f72 HTTP/1.1" status: 204 len: 168 time: 0.2949989 Nov 24 04:11:49.068323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60196) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:49.074847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f6c710-170e-4ed7-9f40-3f15fbc88cbd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6727227e-6161-4dd1-b637-b240c34d0f72,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:49.121384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ca7f3421-983d-45fc-b6b3-9676d0fe9fd7 None None] Provisioning complete for port b581771e-6eb9-46f2-9ad8-a3b0160007c2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:49.121982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ca7f3421-983d-45fc-b6b3-9676d0fe9fd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.136057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.139890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.172778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=7259cabb-83db-4063-84a3-d1c6aa82e64b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:49.195484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4650d6ca-2b95-4376-808d-0963e08503fb None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:49.210959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca6d769-06f5-4ab0-8c7d-753575120f8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a72a02a9-eeae-4ff8-82f7-10abef221918,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:49.225146 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:49.241122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.247347 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-20fc43a8-c40e-43d4-a62e-4d6bd4959fb5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1 HTTP/1.1" status: 204 len: 168 time: 1.3059444 Nov 24 04:11:49.262703 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60198) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:49.277799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.281863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af966d4f-bd5c-4153-b996-bdfa6a1ce675 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:49.284051 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5ba24480-0e1b-40be-847e-b9cc6af33f6c tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2085190 Nov 24 04:11:49.296270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.322870 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-226b60ec-61bb-4447-a185-8043444d3bcd req-b537ace3-f475-41cc-9c74-9115175ce09b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2993066 Nov 24 04:11:49.323508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60200) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:49.424598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.427216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.503859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:49.505541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b1114d-1f39-4258-910d-87f975522bf8 req-4e9db2a2-a8ed-40d4-95b2-4fc7cb73082b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:49.508087 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d7b1114d-1f39-4258-910d-87f975522bf8 req-4e9db2a2-a8ed-40d4-95b2-4fc7cb73082b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1010747 Nov 24 04:11:49.509610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.510290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Fanout notify agent at l3_agent the message router_deleted on router 77998923-4d69-4ee7-8022-cc3100950059 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:11:49.518868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.520169 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8a425caf-2cee-4bad-8f2e-f3a37acf5aaa tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/routers/77998923-4d69-4ee7-8022-cc3100950059 HTTP/1.1" status: 204 len: 168 time: 1.3627198 Nov 24 04:11:49.524075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60204) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:49.563000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] Deleting port b581771e-6eb9-46f2-9ad8-a3b0160007c2 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:49.563375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.611314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting subnet f9d3412a-812d-4e31-868b-465c8722aabb {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:49.617900 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d7b1114d-1f39-4258-910d-87f975522bf8 req-641bff45-dd53-46f2-9ba1-7541114613cc tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0951524 Nov 24 04:11:49.618707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.629831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] For port b581771e-6eb9-46f2-9ad8-a3b0160007c2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b581771e-6eb9-46f2-9ad8-a3b0160007c2,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:49.630265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.659867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] Calling delete_port for b581771e-6eb9-46f2-9ad8-a3b0160007c2 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:49.666683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.681552 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0e5ba066-a254-4de8-8e3b-08358c3572d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.4127491 Nov 24 04:11:49.689047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--1834285560'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:49.694260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60208) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:49.699702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:49.764946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.791254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c11550d5-d33e-44ce-9081-dc4468b9725b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.804878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] Pushing event deleted for resources: {'Port': ['ID=b581771e-6eb9-46f2-9ad8-a3b0160007c2,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:49.808279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-defeab43-b5a7-444f-887e-05cd2f21a02a None None] No DVR routers for this DVR port b581771e-6eb9-46f2-9ad8-a3b0160007c2 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:49.812747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.875385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.887306 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c11550d5-d33e-44ce-9081-dc4468b9725b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.925487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.958179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Subnet': ['ID=f9d3412a-812d-4e31-868b-465c8722aabb,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:49.969331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05280ab-63e1-4ff3-bfd5-1c751427c381 req-d0ccdf0a-681a-4653-92a5-424d0fa746df tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:49.970113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c1add3a-eb06-4da8-84a8-b3b288394170 None None] Network 576cb395-ded1-477d-9995-f33c4a213744 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:49.971096 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f05280ab-63e1-4ff3-bfd5-1c751427c381 req-d0ccdf0a-681a-4653-92a5-424d0fa746df tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.0970683 Nov 24 04:11:49.972487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:49.975736 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f69629eb-3bdd-48a6-b3d0-34c838b22abe tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/subnets/f9d3412a-812d-4e31-868b-465c8722aabb HTTP/1.1" status: 204 len: 168 time: 0.4500616 Nov 24 04:11:49.978769 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60212) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:50.051160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:50.054683 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.103674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c11550d5-d33e-44ce-9081-dc4468b9725b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.106184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c11550d5-d33e-44ce-9081-dc4468b9725b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.106313 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f05280ab-63e1-4ff3-bfd5-1c751427c381 req-3c5d277d-b014-4070-aac5-dd9431bcac4c tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1247549 Nov 24 04:11:50.107326 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c11550d5-d33e-44ce-9081-dc4468b9725b admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/a72a02a9-eeae-4ff8-82f7-10abef221918 HTTP/1.1" status: 204 len: 168 time: 1.0826128 Nov 24 04:11:50.109900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.174507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11550d5-d33e-44ce-9081-dc4468b9725b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a72a02a9-eeae-4ff8-82f7-10abef221918,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:50.198409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.200758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 40d45a41-d786-45df-9c60-5edc8d385bcd {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:50.201396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.203610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] DHCP port deletion for 576cb395-ded1-477d-9995-f33c4a213744 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:50.220388 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.261695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.274105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] Deleting port 40d45a41-d786-45df-9c60-5edc8d385bcd {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:50.274778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.300110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] For port 40d45a41-d786-45df-9c60-5edc8d385bcd, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=40d45a41-d786-45df-9c60-5edc8d385bcd,segment=NetworkSegment(f93a35f0-1446-47aa-a2ad-98a906e6633e),segment_id=f93a35f0-1446-47aa-a2ad-98a906e6633e)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:50.300534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.322457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 40d45a41-d786-45df-9c60-5edc8d385bcd owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:50.343122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.344372 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6617780 Nov 24 04:11:50.354042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] For port 40d45a41-d786-45df-9c60-5edc8d385bcd, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=40d45a41-d786-45df-9c60-5edc8d385bcd,segment=NetworkSegment(f93a35f0-1446-47aa-a2ad-98a906e6633e),segment_id=f93a35f0-1446-47aa-a2ad-98a906e6633e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:50.354480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.363542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60216) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:50.367612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2270f79e-cc7a-4c0b-af4b-0f582b05d909 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=870df55b-481f-458f-9995-33b0c559a472,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:50.377225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--538821738'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:50.386877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] Calling delete_port for 40d45a41-d786-45df-9c60-5edc8d385bcd owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:50.446422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.459945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.474445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] No DVR routers for this DVR port 40d45a41-d786-45df-9c60-5edc8d385bcd on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:50.480752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=40d45a41-d786-45df-9c60-5edc8d385bcd,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:50.483613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.509540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.512090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] Pushing event deleted for resources: {'Port': ['ID=40d45a41-d786-45df-9c60-5edc8d385bcd,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:50.521145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4287ecc2-c8a4-4aba-87e1-e4b8ce703269 None None] No DVR routers for this DVR port 40d45a41-d786-45df-9c60-5edc8d385bcd on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:50.577970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:50.581839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router ab2ed2ad-9a67-4de0-9f0e-a6d60053938a is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:11:50.587932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:50.596640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.599637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:50.600242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.601112 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a4de14b-d75e-45d4-a706-984a56f282c9 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:50.605155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=43cdcfa5-6334-4e58-ae35-5977605b3fb5,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:50.645771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['576cb395-ded1-477d-9995-f33c4a213744']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:50.658433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f93a35f0-1446-47aa-a2ad-98a906e6633e') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:50.658840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f93a35f0-1446-47aa-a2ad-98a906e6633e') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:50.673019 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1dbf8b92-93cc-46fd-913e-1a832b17335a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.9746606 Nov 24 04:11:50.673130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.673130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60226) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:50.678662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:50.683205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.693988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.719312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.732084 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Releasing vlan 174 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:11:50.733277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:11:50.744499 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:11:50.767588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.768862 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.3993320 Nov 24 04:11:50.772118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60230) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:50.778844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '870df55b-481f-458f-9995-33b0c559a472', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '8692b5c7-e9f3-4371-9f99-0e66f9429536', 'remote_ip_prefix': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:50.782976 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a930e564-bad0-463c-a13f-e3856b9ebb4d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8692b5c7-e9f3-4371-9f99-0e66f9429536,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:50.805791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:50.821040 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] Sync routers for ids ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:50.839970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.841315 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cf808194-d580-440d-a3cd-6c40d6ab7f83 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 877 time: 4.7493424 Nov 24 04:11:50.844437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60232) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:50.851520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.864438 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] Routers {'ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:50.871850 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:50.895349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.938098 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:50.941838 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/networks/576cb395-ded1-477d-9995-f33c4a213744 HTTP/1.1" status: 204 len: 168 time: 0.9620523 Nov 24 04:11:50.949927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60234) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:50.977205 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:50.993775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b581771e-6eb9-46f2-9ad8-a3b0160007c2 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:51.002750 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] Routers {'ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:51.003391 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:51.011107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:51.018098 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.038457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b581771e-6eb9-46f2-9ad8-a3b0160007c2 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:51.039574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b581771e-6eb9-46f2-9ad8-a3b0160007c2 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:51.040329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 40d45a41-d786-45df-9c60-5edc8d385bcd no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:51.075769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 40d45a41-d786-45df-9c60-5edc8d385bcd {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:51.076459 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 40d45a41-d786-45df-9c60-5edc8d385bcd not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:51.104281 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:51.104987 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4618d414-ef62-4a20-9950-bf9d0c17bfe0 None None] The sync data for ids ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:51.142882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': '43cdcfa5-6334-4e58-ae35-5977605b3fb5'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:51.143489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.144067 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bcfce166-7ba6-44ef-a801-3413991a90bd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/routers/ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 200 len: 878 time: 0.2984943 Nov 24 04:11:51.149173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60244) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:51.164746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c935ff7-e047-4830-831b-00454bd9c948 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Network': ['ID=576cb395-ded1-477d-9995-f33c4a213744,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:51.192845 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 43cdcfa5-6334-4e58-ae35-5977605b3fb5 (CIDR: 2001:db8::/64) Nov 24 04:11:51.206659 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:11:51.207145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:11:51.226938 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3c660db8-0588-4fc9-a137-fd7d6eaef35e tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5529389 Nov 24 04:11:51.229484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.230137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60248) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:51.236216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:51.246912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.310514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c050ac1-1700-4e52-ba15-64ca1305b1b5,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:51.353498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/43cdcfa5-6334-4e58-ae35-5977605b3fb5/a500976e-905b-4b9e-9258-4d0e62bb798d) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:51.354324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.358598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60250) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:51.359040 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-43f5618a-a5eb-456c-906d-3f1955f85584 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.5854635 Nov 24 04:11:51.386684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:51.390804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.411888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-abb02f1e-a9a4-48d2-a5f0-9641361f42ad tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.413068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 427ef0ea-12b5-4eae-b6b9-313cf75262e1 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:51.414046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.431430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-abb02f1e-a9a4-48d2-a5f0-9641361f42ad tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.436040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb85ad9-67e1-4e60-8c1a-eb5b08bfadc1 req-e241d7ad-37db-414b-b8bd-7e34e568b5bd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:51.437709 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bcb85ad9-67e1-4e60-8c1a-eb5b08bfadc1 req-e241d7ad-37db-414b-b8bd-7e34e568b5bd tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.2026527 Nov 24 04:11:51.512641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-abb02f1e-a9a4-48d2-a5f0-9641361f42ad tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.517531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-abb02f1e-a9a4-48d2-a5f0-9641361f42ad tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.519075 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-abb02f1e-a9a4-48d2-a5f0-9641361f42ad tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/9c050ac1-1700-4e52-ba15-64ca1305b1b5 HTTP/1.1" status: 204 len: 168 time: 0.1586890 Nov 24 04:11:51.525621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60254) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:51.545736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb02f1e-a9a4-48d2-a5f0-9641361f42ad tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9c050ac1-1700-4e52-ba15-64ca1305b1b5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:51.603465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.607096 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bcb85ad9-67e1-4e60-8c1a-eb5b08bfadc1 req-2a22558a-87e9-4edd-812c-c03bea5d227a tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1545956 Nov 24 04:11:51.621650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.622097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.628476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.654071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 427ef0ea-12b5-4eae-b6b9-313cf75262e1 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:51.670622 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e97d1882-d717-4b19-8c1a-5dfffd68a41c tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.1418712 Nov 24 04:11:51.671075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60258) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:51.680639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:51.684061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:51.710645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Pushing event updated for resources: {'Port': ['ID=a500976e-905b-4b9e-9258-4d0e62bb798d,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:51.714795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:51.737778 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f3e01841-bd35-49a8-8f2d-aef02bbc6125 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 881 time: 0.5854094 Nov 24 04:11:51.744093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60264) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:51.750839 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-16014811'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:51.800144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Attempting to bind port a500976e-905b-4b9e-9258-4d0e62bb798d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:51.800685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Attempting to bind port a500976e-905b-4b9e-9258-4d0e62bb798d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:51.801066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Attempting to bind port a500976e-905b-4b9e-9258-4d0e62bb798d on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:51.806322 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:51.806704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:51.807114 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.807645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:51.808194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Bound port: a500976e-905b-4b9e-9258-4d0e62bb798d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:51.808668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.854265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.920939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] For port a500976e-905b-4b9e-9258-4d0e62bb798d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:51.929002 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] For port a500976e-905b-4b9e-9258-4d0e62bb798d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a500976e-905b-4b9e-9258-4d0e62bb798d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:51.934396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.969723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=427ef0ea-12b5-4eae-b6b9-313cf75262e1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:51.971739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.974487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:51.975680 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b55f870-f231-49cb-b130-7d6b51167408 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/floatingips/14190efe-a3ee-4a90-abb0-7635162df195 HTTP/1.1" status: 204 len: 168 time: 1.0233035 Nov 24 04:11:51.980118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60270) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.008401 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-74669985-270d-4d31-b6e7-a615ce9aaa15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:11:52.009284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-74669985-270d-4d31-b6e7-a615ce9aaa15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:11:52.011646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3726f0-1e71-4c3e-817f-79854a627b42 None None] Pushing event updated for resources: {'Port': ['ID=a500976e-905b-4b9e-9258-4d0e62bb798d,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:52.026506 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-74669985-270d-4d31-b6e7-a615ce9aaa15 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/ports/fd98637c-e3c8-4575-be66-b303e573d462 HTTP/1.1" status: 404 len: 333 time: 0.0452290 Nov 24 04:11:52.029121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60274) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.059756 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-def480a1-7e2d-45f5-88d7-bb8368f9d9d2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/ports?device_id=77998923-4d69-4ee7-8022-cc3100950059 HTTP/1.1" status: 200 len: 205 time: 0.0278392 Nov 24 04:11:52.059973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60276) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.101830 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-ced59b42-edcc-4f76-8188-7c794f596d8d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] delete failed (client error): The resource could not be found. Nov 24 04:11:52.103805 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ced59b42-edcc-4f76-8188-7c794f596d8d tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/routers/77998923-4d69-4ee7-8022-cc3100950059 HTTP/1.1" status: 404 len: 336 time: 0.0426018 Nov 24 04:11:52.106857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60278) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.142690 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-b2c74711-e638-474b-aff5-8acf9e29476a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:11:52.143155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b2c74711-e638-474b-aff5-8acf9e29476a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:11:52.146401 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b2c74711-e638-474b-aff5-8acf9e29476a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/subnets/f9d3412a-812d-4e31-868b-465c8722aabb HTTP/1.1" status: 404 len: 337 time: 0.0373189 Nov 24 04:11:52.149467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60280) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.214660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5204fdd8-d774-4ee5-9572-2c266a5c6f75 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.279195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5204fdd8-d774-4ee5-9572-2c266a5c6f75 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.304853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-16718413-b147-4728-a3a9-c307983f6d6b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:52.306532 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-16718413-b147-4728-a3a9-c307983f6d6b tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.21 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1128945 Nov 24 04:11:52.307109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60282) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.400605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:52.400997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.428527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.objects.ports [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103380) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:11:52.503068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-798377553'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:52.508399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5204fdd8-d774-4ee5-9572-2c266a5c6f75 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.511046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5204fdd8-d774-4ee5-9572-2c266a5c6f75 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.512205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5204fdd8-d774-4ee5-9572-2c266a5c6f75 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/8692b5c7-e9f3-4371-9f99-0e66f9429536 HTTP/1.1" status: 204 len: 168 time: 0.8398235 Nov 24 04:11:52.518901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60286) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:52.537563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Deleting port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:52.537899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.540679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5204fdd8-d774-4ee5-9572-2c266a5c6f75 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8692b5c7-e9f3-4371-9f99-0e66f9429536,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:52.557731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.595596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:52.610771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Made reservation on behalf of ce07443a74184ec9b000b86933101610 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:52.614240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.671487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.753387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.780009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.820999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fee763-76c9-43a8-bb01-17faf5d157bb req-b4f42f66-a630-4d61-a4f7-9994ea8ca507 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:52.822655 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a7fee763-76c9-43a8-bb01-17faf5d157bb req-b4f42f66-a630-4d61-a4f7-9994ea8ca507 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 945 time: 0.1349609 Nov 24 04:11:52.825957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:52.993159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a500976e-905b-4b9e-9258-4d0e62bb798d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:53.048945 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a7fee763-76c9-43a8-bb01-17faf5d157bb req-1b47d1a3-d0a9-4351-88e0-225e0da495c0 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups?id=fcf99b5f-7951-4261-91bc-7f9e9857a9fd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2135816 Nov 24 04:11:53.061909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a500976e-905b-4b9e-9258-4d0e62bb798d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:53.062410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.080782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router ab2ed2ad-9a67-4de0-9f0e-a6d60053938a has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:53.101521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] For port a500976e-905b-4b9e-9258-4d0e62bb798d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a500976e-905b-4b9e-9258-4d0e62bb798d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:53.127144 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a69bd22-6e39-4d9a-9d4f-5f1b69440966 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.6070979 Nov 24 04:11:53.146789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60290) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.148030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] For port bd0cfc7f-154f-4dba-bb4b-86d1245efb06, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:53.148839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.157859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.245837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.255804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.256614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.309774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:11:53.310130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:11:53.370793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0022d405-9efe-4f5e-8d61-3061546bbd77 None None] Provisioning complete for port a500976e-905b-4b9e-9258-4d0e62bb798d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:53.371173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0022d405-9efe-4f5e-8d61-3061546bbd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.373799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:53.376880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:53.391688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.392861 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3c788ed3-f031-427c-ace3-5308efdcfd76 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 200 len: 885 time: 1.6473777 Nov 24 04:11:53.394075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:53.400692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60292) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.403355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] Sync routers for ids ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:53.407607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=50180eb8-1743-4adc-afff-33e5b3177b3f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:53.409632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-36e54421-9392-4f86-8e45-bbe1fcc03ea9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.411873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:53.412458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.419408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.420104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed15aa34-7ede-42a4-b212-872476fb58de None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:53.430578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.453624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.466529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=a500976e-905b-4b9e-9258-4d0e62bb798d,revision_number=4']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:53.493513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-36e54421-9392-4f86-8e45-bbe1fcc03ea9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.510417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.510728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.511153 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Floating IP f8759b33-13ee-48c5-86ee-0deed077238c disassociated. External IP: 172.26.5.167, port: bd0cfc7f-154f-4dba-bb4b-86d1245efb06. Nov 24 04:11:53.511562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Calling delete_port for bd0cfc7f-154f-4dba-bb4b-86d1245efb06 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:53.513445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] vlan segment allocate from pool success with {'vlan_id': 150, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:53.519229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:53.520150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] Routers {'ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:53.521244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:53.526642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5bf5f26d-ae94-4421-a892-9a3c16003402,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:53.531629 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-696318d5-86ef-4b88-b47c-2266177447e3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 2.3000560 Nov 24 04:11:53.536341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60294) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.546041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:36:1d:d7', 'name': 'tempest-NetworksTestDHCPv6-446845684'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:53.563152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.563513 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Added segment 9cab86f0-8818-4dfb-b169-1e3793ed8028 of type vlan for network ceee3344-35f4-406e-a756-b0213671583f Nov 24 04:11:53.583300 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0bdbbd3a-ecac-47af-ad1c-6e0de698cb82 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/routers/ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 200 len: 885 time: 0.1812437 Nov 24 04:11:53.586556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60296) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.592211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20b5e7ca-2aa8-47b6-9266-b87b57d56620 None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:53.599505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:53.615599 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-66a58ed9-d645-4ac0-8bf0-265a2833b6dc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 200 len: 205 time: 0.0278332 Nov 24 04:11:53.617670 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] Routers {'ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:53.618209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60298) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.618892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:53.625493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-36e54421-9392-4f86-8e45-bbe1fcc03ea9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.628313 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-36e54421-9392-4f86-8e45-bbe1fcc03ea9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.629548 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-36e54421-9392-4f86-8e45-bbe1fcc03ea9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/870df55b-481f-458f-9995-33b0c559a472 HTTP/1.1" status: 204 len: 168 time: 0.4805722 Nov 24 04:11:53.646725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60300) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.665019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:53.665679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f0bdde9-b449-4d9e-b42c-8fd4e6173db6 None None] The sync data for ids ['ab2ed2ad-9a67-4de0-9f0e-a6d60053938a'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:53.676522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e54421-9392-4f86-8e45-bbe1fcc03ea9 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=870df55b-481f-458f-9995-33b0c559a472,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:53.748503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0022d405-9efe-4f5e-8d61-3061546bbd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.755754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.786519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0022d405-9efe-4f5e-8d61-3061546bbd77 None None] For port a500976e-905b-4b9e-9258-4d0e62bb798d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a500976e-905b-4b9e-9258-4d0e62bb798d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:53.792079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.792847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0022d405-9efe-4f5e-8d61-3061546bbd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.842381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.845709 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-326af7b4-3d8b-4e2a-8942-dc9d8c922f65 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/ports/6eecc0d9-e115-4ec3-b5bd-fa706f8d9aa8 HTTP/1.1" status: 204 len: 168 time: 1.6952364 Nov 24 04:11:53.848279 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60302) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.870751 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a0ba47cd-9135-406b-bd7f-9537e38fe3f3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2198436 Nov 24 04:11:53.878735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60304) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:53.891254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--1025144659'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:53.906277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.910798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:53.911494 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.913166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0022d405-9efe-4f5e-8d61-3061546bbd77 None None] Pushing event updated for resources: {'Port': ['ID=a500976e-905b-4b9e-9258-4d0e62bb798d,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:53.926241 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:53.999454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 5ee20480-1bf7-450b-b47b-dbf62c478f88 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:53.999832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.015443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.042165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 68e59667-da85-4c51-a532-430d4bc0e63f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:54.042532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.077666 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 1.7668724 Nov 24 04:11:54.079258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e972b7d-77e7-4692-9d0c-c5c4408d015a tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Pushing event updated for resources: {'Network': ['ID=ceee3344-35f4-406e-a756-b0213671583f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:54.083931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.095458 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network ceee3344-35f4-406e-a756-b0213671583f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:54.156423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event deleted for resources: {'Port': ['ID=bd0cfc7f-154f-4dba-bb4b-86d1245efb06,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:54.159455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:54.481588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60312) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:54.493304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Request body: {'port': {'network_id': 'ceee3344-35f4-406e-a756-b0213671583f', 'binding:host_id': 'hv-neutron-8190', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1398670157'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:54.527356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Router 3d0d90ae-c638-4277-9998-3fafd099dea4 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:54.593976 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.607026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.611150 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-43de542c-a90e-4bc7-99ef-e70d00474473 req-068f4f45-569d-4e0b-8384-de7b9da755b1 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/ports?device_id=639f0dbf-22c1-4153-8ca4-7b65de6aee72 HTTP/1.1" status: 200 len: 210 time: 0.0489025 Nov 24 04:11:54.638326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Made reservation on behalf of 0523bb9f69d041e18c6b833f743c058c for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:54.639495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 5ee20480-1bf7-450b-b47b-dbf62c478f88 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:54.640618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.646083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.648316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.659485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.660780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.665783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 68e59667-da85-4c51-a532-430d4bc0e63f owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:54.696387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port 1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:54.725176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0c2d7dce-424c-4632-81ba-90ccd9a82304 None None] Provisioning complete for port a500976e-905b-4b9e-9258-4d0e62bb798d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:54.725574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0c2d7dce-424c-4632-81ba-90ccd9a82304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.780143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.782519 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.9000461 Nov 24 04:11:54.787791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60314) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:54.794713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': 'fe44d46f-2387-472d-818d-591c3e9c02ad', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:54.803230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e925a3-2799-47d3-8960-e0a7014d4303 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fe44d46f-2387-472d-818d-591c3e9c02ad,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:54.856305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:54.871215 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] Sync routers for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:54.881625 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:54.883351 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:54.933202 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.939632 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.945700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] No DVR routers for this DVR port bd0cfc7f-154f-4dba-bb4b-86d1245efb06 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:11:54.950984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:54.954464 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-09b844ed-c1a1-4596-885d-6f8849a76e23 req-2c005aa0-cfb7-4fdf-bc99-8f56f8f29ce4 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.21 "DELETE /v2.0/ports/bd0cfc7f-154f-4dba-bb4b-86d1245efb06 HTTP/1.1" status: 204 len: 173 time: 2.6395335 Nov 24 04:11:54.958761 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'name': 'network-vif-deleted', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:11:54.961207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25ebdd77-ad63-4760-b417-62fb3437c62c" -d '{"events": [{"server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "name": "network-vif-deleted", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:11:54.977392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a500976e-905b-4b9e-9258-4d0e62bb798d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:55.017780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.026921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.036117 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:55.042687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:11:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-567f0eee-196c-4d10-9e97-f1d63a8b4196 x-openstack-request-id: req-567f0eee-196c-4d10-9e97-f1d63a8b4196 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:11:55.043271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "639f0dbf-22c1-4153-8ca4-7b65de6aee72", "name": "network-vif-deleted", "tag": "bd0cfc7f-154f-4dba-bb4b-86d1245efb06", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:11:55.043686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-567f0eee-196c-4d10-9e97-f1d63a8b4196 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:11:55.044255 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '639f0dbf-22c1-4153-8ca4-7b65de6aee72', 'name': 'network-vif-deleted', 'tag': 'bd0cfc7f-154f-4dba-bb4b-86d1245efb06', 'status': 'completed', 'code': 200} Nov 24 04:11:55.055376 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:11:55.092744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=5ee20480-1bf7-450b-b47b-dbf62c478f88,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.119644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.128440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a500976e-905b-4b9e-9258-4d0e62bb798d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:55.128924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.143723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51ac2e01-d1c7-4a56-9383-5f8e29388813 None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:55.151812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::e5 (a2b36c78-43a6-4954-8102-cb5638999bb1/43cdcfa5-6334-4e58-ae35-5977605b3fb5/1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:55.165842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b24e9dc8-2731-4feb-a675-4c93e5f7244d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.171775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8:0:1:f816:3eff:fe36:1dd7 (a2b36c78-43a6-4954-8102-cb5638999bb1/50180eb8-1743-4adc-afff-33e5b3177b3f/1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:55.222001 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6449bf6b-25ee-4323-8223-c550859bab3a None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:55.280935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=68e59667-da85-4c51-a532-430d4bc0e63f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.290464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.362106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device bd0cfc7f-154f-4dba-bb4b-86d1245efb06 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:11:55.389233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: bd0cfc7f-154f-4dba-bb4b-86d1245efb06 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:11:55.389796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device bd0cfc7f-154f-4dba-bb4b-86d1245efb06 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:11:55.402648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.411212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.413747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.417127 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-64be248a-f3e8-4549-8e27-c020d022f3b2 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/ports/5ee20480-1bf7-450b-b47b-dbf62c478f88 HTTP/1.1" status: 204 len: 168 time: 1.5637398 Nov 24 04:11:55.419745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60318) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.423837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.432019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.446095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4730dc22-2de3-43a4-af29-15508c5e004c,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.458117 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:28Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:55.470713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:55.492399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.496099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.500242 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] Checking router: 3d0d90ae-c638-4277-9998-3fafd099dea4 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:11:55.500678 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e5c39ff1-700d-42a1-8003-22abf397334d tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.7100496 Nov 24 04:11:55.502207 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60320) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.510103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.517782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.518008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.518376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router ab2ed2ad-9a67-4de0-9f0e-a6d60053938a {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:11:55.528754 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:55.529071 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.529615 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:55.534301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60322) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.534917 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-92454629-18f5-4e85-ae5b-88d6bdaa3d9a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 204 len: 168 time: 1.9156454 Nov 24 04:11:55.541636 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-82324527'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:55.544327 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dde07656-acf7-405b-b8d8-5a6c56ca9b4a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.553314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dde07656-acf7-405b-b8d8-5a6c56ca9b4a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.574511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b614646-48a1-4bf9-bd56-b81751ab894f tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:55.578852 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4b614646-48a1-4bf9-bd56-b81751ab894f tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "GET /v2.0/ports?device_id=a8386b6b-248e-4548-b4bd-473c72f35a73 HTTP/1.1" status: 200 len: 913 time: 0.1551027 Nov 24 04:11:55.579196 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60324) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.628243 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dde07656-acf7-405b-b8d8-5a6c56ca9b4a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.636217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.652859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dde07656-acf7-405b-b8d8-5a6c56ca9b4a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.653096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:55.654485 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dde07656-acf7-405b-b8d8-5a6c56ca9b4a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/4730dc22-2de3-43a4-af29-15508c5e004c HTTP/1.1" status: 204 len: 168 time: 0.1508746 Nov 24 04:11:55.656460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.674746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60328) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.677791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Checking segment: {'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:55.679114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Network hostable DHCP agents. Network: ceee3344-35f4-406e-a756-b0213671583f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:55.695637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.697438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 155, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:11:55.703824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde07656-acf7-405b-b8d8-5a6c56ca9b4a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=4730dc22-2de3-43a4-af29-15508c5e004c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.758461 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:11:55.767349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60332) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.770489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.770922 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 209ad88e-035f-4fc4-b139-38bb0c47165d of type vlan for network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 Nov 24 04:11:55.778680 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d7b8dcbd-b0fc-4676-9088-10028af3cc6b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1023812 Nov 24 04:11:55.785848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60334) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.788142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Network ceee3344-35f4-406e-a756-b0213671583f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:55.839286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, ceee3344-35f4-406e-a756-b0213671583f) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:55.842751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:55.851059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed767463-0153-411c-b86b-fe265cf052db None None] Network ceee3344-35f4-406e-a756-b0213671583f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:55.852565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:55.855821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:55.863343 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.874176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:55.880052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:55.885790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:55.886662 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.918381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:55.918778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:55.919263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:55.942452 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2f50f70f-a6c9-4c93-bf36-b53cef669b8d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 2.4017768 Nov 24 04:11:55.942684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:55.942997 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:55.944091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60336) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:55.945207 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 2 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:55.981650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:55.988536 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:55.989181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.042933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ea8898-8798-4a38-ad8b-a1b933903b92 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.072954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.073788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.073940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.077054 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:28Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:56.085424 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 764 time: 0.5500395 Nov 24 04:11:56.093599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60338) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:56.102315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:56.109790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3573b395-f7e0-42d6-9872-94adecd7fa57 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.118194 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d137ef5a-b14e-4179-a0ef-0cd5e2711461 None None] The sync data for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv is: [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:08:18Z', 'revision_number': 4, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658', 'name': '', 'network_id': '4064fe6e-1a4a-440d-8829-8ec4922458b8', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'mac_address': 'fa:16:3e:cd:8d:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:15Z', 'updated_at': '2021-11-24T04:08:28Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'subnets': [{'id': 'df7e7408-6a2c-4f38-aa9d-4f7793f54ec8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:56.119862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.119862 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.123425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 3 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.169152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be9332a-620a-475c-ab5b-ef27ec7b8862 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=e14b6f12-b9fb-4a39-a00f-3ef4417829e3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:56.173713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.173713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.173970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.184601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:11:56.190283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.190693 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.191261 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 4 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.215215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ea8898-8798-4a38-ad8b-a1b933903b92 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.226428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.226765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.227100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.232744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port 1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:56.233079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.239292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.239907 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.252503 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 5 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.280464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.280801 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.281237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.320883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.321209 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.323584 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 6 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.340736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3573b395-f7e0-42d6-9872-94adecd7fa57 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.342556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.342897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.343237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.361097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.361656 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.363895 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.366857 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 7 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.373805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-741218fb-e7c1-4ed1-aa11-75969d572010 None None] Provisioning complete for port 1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:56.374608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-741218fb-e7c1-4ed1-aa11-75969d572010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.402262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for 1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:56.404233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.404789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.405335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.417337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.417609 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.419490 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 8 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.433627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-741218fb-e7c1-4ed1-aa11-75969d572010 None None] Port 1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:11:56.463047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ea8898-8798-4a38-ad8b-a1b933903b92 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.464372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.464712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.465046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.465654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ea8898-8798-4a38-ad8b-a1b933903b92 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.466853 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a5ea8898-8798-4a38-ad8b-a1b933903b92 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "DELETE /v2.0/security-groups/fcf99b5f-7951-4261-91bc-7f9e9857a9fd HTTP/1.1" status: 204 len: 168 time: 0.6984031 Nov 24 04:11:56.470196 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60342) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:56.481950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.482302 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.483922 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c60a83c7-0031-4a39-a23c-c4a309d9fa51 None None] New status for floating IP f8759b33-13ee-48c5-86ee-0deed077238c: DOWN {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:11:56.490513 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 9 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.505901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ea8898-8798-4a38-ad8b-a1b933903b92 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcf99b5f-7951-4261-91bc-7f9e9857a9fd,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:56.506366 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-a843c6e8-0d23-4b11-b965-295458f6a12d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] show failed (client error): The resource could not be found. Nov 24 04:11:56.509999 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a843c6e8-0d23-4b11-b965-295458f6a12d tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "GET /v2.0/security-groups/fcf99b5f-7951-4261-91bc-7f9e9857a9fd HTTP/1.1" status: 404 len: 347 time: 0.0354364 Nov 24 04:11:56.510140 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:56.511093 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60344) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:56.520736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.523140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.523657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.523997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.550593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3573b395-f7e0-42d6-9872-94adecd7fa57 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.552887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3573b395-f7e0-42d6-9872-94adecd7fa57 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.554057 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3573b395-f7e0-42d6-9872-94adecd7fa57 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/fe44d46f-2387-472d-818d-591c3e9c02ad HTTP/1.1" status: 204 len: 168 time: 0.7656775 Nov 24 04:11:56.558887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60346) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:56.581409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.581630 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.583299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3573b395-f7e0-42d6-9872-94adecd7fa57 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe44d46f-2387-472d-818d-591c3e9c02ad,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:56.591152 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 10 to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 Nov 24 04:11:56.652451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:56.652781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:56.653113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:56.696981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:11:56.697294 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:11:56.697650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.701517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.738523 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b43cd98e-bb92-4ffa-9e21-c807f82da055 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1762552 Nov 24 04:11:56.743280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60350) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:56.749205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group': {'name': 'tempest-secgroup--470421094'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:56.852588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.890826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.894451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Deleting port 821066e1-70dd-43b3-8e94-cc706e3bbd45 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:56.894774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.916293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] For port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:56.916659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempted to set empty binding levels {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 04:11:56.951402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:56.960583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:57.016665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 9c22bb44-3211-49e7-bcde-f7d29f0a526d {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:57.017208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.124834 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.213822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=8d5f518d-c9d6-478a-82fd-b9f890fc8fb1,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:57.218951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.237187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '209ad88e-035f-4fc4-b139-38bb0c47165d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:57.237553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: e14b6f12-b9fb-4a39-a00f-3ef4417829e3, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:11:57.240164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 9c22bb44-3211-49e7-bcde-f7d29f0a526d owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:57.292593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:11:57.313691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, e14b6f12-b9fb-4a39-a00f-3ef4417829e3) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:57.325477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad612f92-23ee-4008-90fb-174c7e601f64 None None] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:57.342619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.343746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.367282 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9a34ce0a-caf8-4e29-b781-9aeff4604a22 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2725832 Nov 24 04:11:57.374538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60354) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.385856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1636273816', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:57.393275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.393863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.427781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.431249 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a138dc9e-d0ff-4028-8a84-477f6ab1fb89 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b HTTP/1.1" status: 204 len: 168 time: 1.4831686 Nov 24 04:11:57.433933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60356) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.473838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:57.477290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.477610 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.506223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.507370 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.511028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Calling delete_port for 821066e1-70dd-43b3-8e94-cc706e3bbd45 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:57.521816 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-07633b63-b471-40ac-b5f6-4def3ad4f6e0 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 982 time: 3.0328600 Nov 24 04:11:57.525264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-e14b6f12-b9fb-4a39-a00f-3ef4417829e3', 'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': '8d5f518d-c9d6-478a-82fd-b9f890fc8fb1'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:11:57.526191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.526357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52f60a20-96c3-4aeb-8f23-61d254d65846 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.527827 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-52f60a20-96c3-4aeb-8f23-61d254d65846 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.0928431 Nov 24 04:11:57.528478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60358) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.532948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60360) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.535411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.551612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.596255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.634281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=9c22bb44-3211-49e7-bcde-f7d29f0a526d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:57.660357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb293044-4837-4233-a709-700952bc16be None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:57.694202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9efe3274-3ba4-4e48-ac7c-f1f2dc2f1b35,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:57.694939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Allocated IP 172.20.0.2 (e14b6f12-b9fb-4a39-a00f-3ef4417829e3/8d5f518d-c9d6-478a-82fd-b9f890fc8fb1/84092878-1d24-4ecb-a6f7-04140cc83a48) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:57.705192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.709644 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-03f42a33-670a-47aa-8c36-3ab37daeb648 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.9616454 Nov 24 04:11:57.709644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.710980 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60362) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.716092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9efe3274-3ba4-4e48-ac7c-f1f2dc2f1b35', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:57.727693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38e9b6b3-46f7-4508-b4e8-6515018c449f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.729155 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-38e9b6b3-46f7-4508-b4e8-6515018c449f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1924582 Nov 24 04:11:57.732018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.734740 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60364) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.818211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.818510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Deleting port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:11:57.818857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.848751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Pushing event deleted for resources: {'Port': ['ID=821066e1-70dd-43b3-8e94-cc706e3bbd45,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:57.856611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.861065 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b5484d31-c22c-435a-8695-7c6011bbad46 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.4784636 Nov 24 04:11:57.863397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60368) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.958733 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.973126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c4af595-6b2e-4bc9-9972-a991ded1f438 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.974673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c4af595-6b2e-4bc9-9972-a991ded1f438 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.976881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c4af595-6b2e-4bc9-9972-a991ded1f438 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:11:57.981168 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2c4af595-6b2e-4bc9-9972-a991ded1f438 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.2408330 Nov 24 04:11:57.983519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60370) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:57.986914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-715d6ecb-d2c1-4797-bbaf-79288c03b6db None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:11:57.994918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.997701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:57.999121 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6694186e-62a7-465f-8b93-5a4a7889ee78 tempest-ServerActionsTestJSON-170385737 tempest-ServerActionsTestJSON-170385737-project] 10.222.0.48 "DELETE /v2.0/floatingips/f8759b33-13ee-48c5-86ee-0deed077238c HTTP/1.1" status: 204 len: 168 time: 1.4871299 Nov 24 04:11:58.002844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60372) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.012735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] For port f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4, host hv-neutron-8190, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:58.013508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.015371 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.042981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.048531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.082021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Calling delete_port for f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:11:58.088459 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:58.091339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:58.094946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:58.122140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 43cdcfa5-6334-4e58-ae35-5977605b3fb5 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:58.126540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Pushing event updated for resources: {'Port': ['ID=84092878-1d24-4ecb-a6f7-04140cc83a48,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:58.128315 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.158248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Attempting to bind port 84092878-1d24-4ecb-a6f7-04140cc83a48 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:11:58.158609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Attempting to bind port 84092878-1d24-4ecb-a6f7-04140cc83a48 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '209ad88e-035f-4fc4-b139-38bb0c47165d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:11:58.159311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Attempting to bind port 84092878-1d24-4ecb-a6f7-04140cc83a48 on network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:11:58.165252 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:11:58.165636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Checking segment: {'id': '209ad88e-035f-4fc4-b139-38bb0c47165d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:11:58.166042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.167553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Bound using segment: {'id': '209ad88e-035f-4fc4-b139-38bb0c47165d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:11:58.168048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Bound port: 84092878-1d24-4ecb-a6f7-04140cc83a48, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '209ad88e-035f-4fc4-b139-38bb0c47165d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'e14b6f12-b9fb-4a39-a00f-3ef4417829e3'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:11:58.168440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.235716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] For port 84092878-1d24-4ecb-a6f7-04140cc83a48, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:11:58.239346 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] For port 84092878-1d24-4ecb-a6f7-04140cc83a48, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84092878-1d24-4ecb-a6f7-04140cc83a48,segment=NetworkSegment(209ad88e-035f-4fc4-b139-38bb0c47165d),segment_id=209ad88e-035f-4fc4-b139-38bb0c47165d)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:11:58.244629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.256139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.305816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bdee39-07d6-4f16-9d46-f2033b030ccd None None] Pushing event updated for resources: {'Port': ['ID=84092878-1d24-4ecb-a6f7-04140cc83a48,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:58.350369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.475290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.493585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.552054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.627316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.650424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=43e9d998-8813-4916-9e28-01bbc31f206e,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:58.681858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.687650 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f20b2fbb-1f8e-49b7-85c9-54a85a2912c0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9713082 Nov 24 04:11:58.687960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=43cdcfa5-6334-4e58-ae35-5977605b3fb5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:58.694599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60376) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.699761 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.702951 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c95ab7a9-d9c3-45ea-bfb6-9c8c88e61c26 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/43cdcfa5-6334-4e58-ae35-5977605b3fb5 HTTP/1.1" status: 204 len: 168 time: 0.7170656 Nov 24 04:11:58.708202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2ed6d58-034f-4fc9-b216-5f1373d44a3a None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:58.715250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60378) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.776290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.20.0.1 (e14b6f12-b9fb-4a39-a00f-3ef4417829e3/8d5f518d-c9d6-478a-82fd-b9f890fc8fb1/d61540d8-2fb7-462e-8765-7c1bd2afe551) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:11:58.784021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.789365 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d246f001-018e-4ed2-add9-4d88a0a6becc tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules/43e9d998-8813-4916-9e28-01bbc31f206e HTTP/1.1" status: 200 len: 763 time: 0.0962007 Nov 24 04:11:58.793285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60380) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.833637 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event deleted for resources: {'Port': ['ID=f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:58.858696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 50180eb8-1743-4adc-afff-33e5b3177b3f {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:11:58.877768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.883756 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9dcafdd1-08d8-41db-adf9-57316c657179 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "DELETE /v2.0/ports/f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 HTTP/1.1" status: 204 len: 168 time: 1.3499091 Nov 24 04:11:58.887766 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3c0dbc38-5bbc-4016-bb7b-a03f69070e1b tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0903113 Nov 24 04:11:58.888141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60382) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.893422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60384) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.894082 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.952320 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-5fa619c9-56fa-4b8b-aaa5-5b95711d19d9 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:11:58.957880 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5fa619c9-56fa-4b8b-aaa5-5b95711d19d9 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "GET /v2.0/ports/f099a3fa-dfd5-477f-ad3a-a3ddcb7285c4 HTTP/1.1" status: 404 len: 333 time: 0.0675275 Nov 24 04:11:58.962540 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60386) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:58.963216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:58.977407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Request body: {'port': {'network_id': 'ceee3344-35f4-406e-a756-b0213671583f', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1971453981'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:59.002408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e8ab98d-59fd-4eb7-b868-5e1c6df74b55 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.008870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Made reservation on behalf of 0523bb9f69d041e18c6b833f743c058c for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:11:59.011516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.032198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e8ab98d-59fd-4eb7-b868-5e1c6df74b55 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.039778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84092878-1d24-4ecb-a6f7-04140cc83a48 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:11:59.069872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Router a8386b6b-248e-4548-b4bd-473c72f35a73 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:11:59.085639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:11:59.114085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.122901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 84092878-1d24-4ecb-a6f7-04140cc83a48 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:59.123287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.129470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.178083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e8ab98d-59fd-4eb7-b868-5e1c6df74b55 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.205678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e8ab98d-59fd-4eb7-b868-5e1c6df74b55 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.206889 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6e8ab98d-59fd-4eb7-b868-5e1c6df74b55 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/43e9d998-8813-4916-9e28-01bbc31f206e HTTP/1.1" status: 204 len: 168 time: 0.2935338 Nov 24 04:11:59.211238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60388) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.258892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.266532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.278482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8ab98d-59fd-4eb7-b868-5e1c6df74b55 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=43e9d998-8813-4916-9e28-01bbc31f206e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:59.320771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 84092878-1d24-4ecb-a6f7-04140cc83a48, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84092878-1d24-4ecb-a6f7-04140cc83a48,segment=NetworkSegment(209ad88e-035f-4fc4-b139-38bb0c47165d),segment_id=209ad88e-035f-4fc4-b139-38bb0c47165d)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:11:59.327814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.342067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.361632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:59.407425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=84092878-1d24-4ecb-a6f7-04140cc83a48,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:59.420918 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bd8c2ba9-227e-4675-a0ec-8b0d792db627 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2064672 Nov 24 04:11:59.422066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:11:59.424101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=50180eb8-1743-4adc-afff-33e5b3177b3f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:59.425736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60390) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.426727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:11:59.443793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9efe3274-3ba4-4e48-ac7c-f1f2dc2f1b35', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:59.486601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.493305 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-475cee19-937c-4398-b4f2-d69fa45c75cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/50180eb8-1743-4adc-afff-33e5b3177b3f HTTP/1.1" status: 204 len: 168 time: 0.7674901 Nov 24 04:11:59.493305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=d61540d8-2fb7-462e-8765-7c1bd2afe551,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:59.497531 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60392) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.523096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:11:59.526977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.537372 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] Sync routers for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:11:59.541174 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a55e744-039e-496a-a410-4867f3c5f7dc tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "PUT /v2.0/routers/a8386b6b-248e-4548-b4bd-473c72f35a73/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9576173 Nov 24 04:11:59.543642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60394) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.548678 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:59.549465 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:59.556742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.567675 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-62118576-b7c8-4485-8bcd-fd321fdc547f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0687897 Nov 24 04:11:59.610851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60396) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.621197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:11:59.621961 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:59.634826 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] Routers {'a8386b6b-248e-4548-b4bd-473c72f35a73'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:11:59.635684 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a8386b6b-248e-4548-b4bd-473c72f35a73'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:59.666111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.674108 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:11:59.675123 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3dc56c1-7a84-4f34-a946-ad47b0353f02 None None] The sync data for ids ['a8386b6b-248e-4548-b4bd-473c72f35a73'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:11:59.740013 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.769956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.773816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.784961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.817404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f0d7c81-3ec0-465d-8232-71e3aeabcae7 None None] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:59.828486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cad8dda-c4a9-4a8e-808f-29219763acc3,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:11:59.841713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.846280 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1996cae5-abfc-4496-a3ea-5293a778ddb3 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4066629 Nov 24 04:11:59.846280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60398) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.853164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.877247 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0863bf76-05f6-4520-bbb4-89232ab4888e tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules/6cad8dda-c4a9-4a8e-808f-29219763acc3 HTTP/1.1" status: 200 len: 763 time: 0.0276735 Nov 24 04:11:59.882618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60400) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:11:59.901169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7d1c37f-ae5e-479b-9640-f5d57e638ddc None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:11:59.906804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.982919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Network ceee3344-35f4-406e-a756-b0213671583f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:11:59.993723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d612a098-9b39-43b3-9779-e162466cfeb8 None None] Provisioning complete for port 84092878-1d24-4ecb-a6f7-04140cc83a48 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:11:59.994089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d612a098-9b39-43b3-9779-e162466cfeb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:11:59.997966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:00.001764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.005328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:00.017114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:00.017985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:00.019172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.022991 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2970f9e4-e3fa-4df3-9b16-e55fe6200bdc tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1392407 Nov 24 04:12:00.023862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60402) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:00.045033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=61da1ce6-3ff4-477c-925a-8e0dc34a5227,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:00.068979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86347b9b-90ae-424f-b1d7-f98e75fa82af tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.090058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86347b9b-90ae-424f-b1d7-f98e75fa82af tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.158992 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ea2a28f9-5428-4877-8780-dbe9c32af05b tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.1854353 Nov 24 04:12:00.164716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60404) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:00.170978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:00.203360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d612a098-9b39-43b3-9779-e162466cfeb8 None None] Provisioning complete for port a500976e-905b-4b9e-9258-4d0e62bb798d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:00.204022 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d612a098-9b39-43b3-9779-e162466cfeb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.207324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86347b9b-90ae-424f-b1d7-f98e75fa82af tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.213297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-86347b9b-90ae-424f-b1d7-f98e75fa82af tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.217739 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-86347b9b-90ae-424f-b1d7-f98e75fa82af tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/6cad8dda-c4a9-4a8e-808f-29219763acc3 HTTP/1.1" status: 204 len: 168 time: 0.1911893 Nov 24 04:12:00.218558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60406) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:00.233642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.283208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.293560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:00.308509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86347b9b-90ae-424f-b1d7-f98e75fa82af tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=6cad8dda-c4a9-4a8e-808f-29219763acc3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:00.378506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] Deleting port a500976e-905b-4b9e-9258-4d0e62bb798d {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:00.382499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.402777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60408) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:00.403008 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-baf0ce9a-95cf-4c5b-b7af-c12d84cfd1cd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1423376 Nov 24 04:12:00.407579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Request body: {'security_group_rule': {'security_group_id': '9efe3274-3ba4-4e48-ac7c-f1f2dc2f1b35', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:00.422285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.463591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] For port a500976e-905b-4b9e-9258-4d0e62bb798d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a500976e-905b-4b9e-9258-4d0e62bb798d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:00.463919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.464838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.489587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] Calling delete_port for a500976e-905b-4b9e-9258-4d0e62bb798d owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:00.498472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.523425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting port 9b8e9f28-d49a-41d5-ab8b-1b403fdd0826 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:00.523765 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.565050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:00.583042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:00.589749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:00.590366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.592755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=ab833988-2618-4266-9d1f-55f42940b695,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:00.598897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.621327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.623076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=d61540d8-2fb7-462e-8765-7c1bd2afe551,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:00.664713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.692555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:00.703781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.727598 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] Pushing event deleted for resources: {'Port': ['ID=a500976e-905b-4b9e-9258-4d0e62bb798d,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:00.735108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc354476-630c-4b64-827e-c11fc7ec6b4e None None] No DVR routers for this DVR port a500976e-905b-4b9e-9258-4d0e62bb798d on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:00.738024 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1d72b037-4034-45df-abab-ecdcf3a4e322 None None] Provisioning complete for port 84092878-1d24-4ecb-a6f7-04140cc83a48 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:00.738449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1d72b037-4034-45df-abab-ecdcf3a4e322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.745628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:00.820249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce667b1b-9de5-4cb7-9a85-c48284268fbb None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:00.837979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=61da1ce6-3ff4-477c-925a-8e0dc34a5227,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:00.856368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:00.857382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:00.857718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:00.858109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:00.865281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:00.870040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:00.870502 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:00.871641 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 2 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:00.953900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:00.954296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:00.954605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.007354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.007750 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.011897 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 3 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.037119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.037472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.037785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.047641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.047993 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.049650 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 4 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.069552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.069892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.070369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.077719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.078044 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.080010 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 5 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.107988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.108325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.108651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.109657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84092878-1d24-4ecb-a6f7-04140cc83a48 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:01.120232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.120568 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.126822 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 6 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.140422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router c4c47676-087d-4294-b078-629be3c2c426 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:01.151928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.152271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.152502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.155710 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-92b04541-5e2b-42b7-9c42-de2892e1186a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.5428815 Nov 24 04:12:01.164713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60410) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:01.169482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.169817 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.170414 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 7 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.170564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:01.193435 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1d72b037-4034-45df-abab-ecdcf3a4e322 None None] Provisioning complete for port d61540d8-2fb7-462e-8765-7c1bd2afe551 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:01.193821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1d72b037-4034-45df-abab-ecdcf3a4e322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.245614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.247319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a2b36c78-43a6-4954-8102-cb5638999bb1', 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'tenant_id': 'f7a52a1f2e7f4bf2b011e140727dd116', 'fixed_ips': [{'subnet_id': 'ab833988-2618-4266-9d1f-55f42940b695'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:01.249315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.270797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.271189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1d72b037-4034-45df-abab-ecdcf3a4e322 None None] Port d61540d8-2fb7-462e-8765-7c1bd2afe551 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:01.271595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.273273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.287780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.288151 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.290613 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 8 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.308081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Deleting port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:01.308419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.308702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.309038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.309373 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.311656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:01.317327 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-87c51438-8ccf-4d8e-beff-427bd799dbb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/c4c47676-087d-4294-b078-629be3c2c426/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4528046 Nov 24 04:12:01.322007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60412) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:01.324189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.325259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Calling delete_port for 9b8e9f28-d49a-41d5-ab8b-1b403fdd0826 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:01.330894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.331052 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.333479 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 9 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.341820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 84092878-1d24-4ecb-a6f7-04140cc83a48 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:01.342255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.345363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] Sync routers for ids ['c4c47676-087d-4294-b078-629be3c2c426'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:01.351758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.373096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.373888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.374265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.385597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b81dcc2f-d235-4f29-a82d-352a9b6317b7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:01.387170 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b81dcc2f-d235-4f29-a82d-352a9b6317b7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports/d61540d8-2fb7-462e-8765-7c1bd2afe551 HTTP/1.1" status: 200 len: 910 time: 0.0641809 Nov 24 04:12:01.389607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.389946 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.390562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60414) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:01.391492 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 10 to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 Nov 24 04:12:01.398838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '8d5f518d-c9d6-478a-82fd-b9f890fc8fb1'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:01.418057 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] Routers {'c4c47676-087d-4294-b078-629be3c2c426'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:01.418729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c4c47676-087d-4294-b078-629be3c2c426'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:01.439885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:01.440280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:01.440568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:01.460883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:01.461269 dv-neutron-819049-1-hyperv neutron-server[103381]: ERROR neutron.plugins.ml2.managers [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:01.461578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.467383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80783d64-42e1-4314-bfd7-d695696c0047,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:01.494130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.496313 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4877ffdc-6600-4330-89e6-44c2592734ed tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0909586 Nov 24 04:12:01.507170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60416) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:01.544970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] For port 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:01.545390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.562977 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a53a07ba-283a-4f25-bac9-bea13af06c3a tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules/80783d64-42e1-4314-bfd7-d695696c0047 HTTP/1.1" status: 200 len: 764 time: 0.0514534 Nov 24 04:12:01.566137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Allocated IP 2001:db8::2 (a2b36c78-43a6-4954-8102-cb5638999bb1/ab833988-2618-4266-9d1f-55f42940b695/1892b3ea-a5fc-41fd-a458-b9714c5a708d) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:01.570252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60418) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:01.606091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Calling delete_port for 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:01.616712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:01.620340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.831354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.850321 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet ab833988-2618-4266-9d1f-55f42940b695 (CIDR: 2001:db8::/64) Nov 24 04:12:01.858699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.871076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:12:01.871795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:01.889307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:01.917521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Port': ['ID=9b8e9f28-d49a-41d5-ab8b-1b403fdd0826,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:01.927241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-cfc1797a-7ebd-44cb-8f2c-4d8afc1988e7 None None] Provisioning complete for port d61540d8-2fb7-462e-8765-7c1bd2afe551 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:01.927561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cfc1797a-7ebd-44cb-8f2c-4d8afc1988e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.937809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:01.944906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e062254f-0df6-400e-a48e-9078e52975a6 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:01.973033 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c6d2fca1-8b49-4531-93c7-af740888b58b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.8062232 Nov 24 04:12:01.976693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60420) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:01.985520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'subnet': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:01.996961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] Routers {'c4c47676-087d-4294-b078-629be3c2c426'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:01.997879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c4c47676-087d-4294-b078-629be3c2c426'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:02.002226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] For port 61da1ce6-3ff4-477c-925a-8e0dc34a5227, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:02.004021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempted to set empty binding levels {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 04:12:02.047433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.077763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.087864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.135044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Pushing event deleted for resources: {'Port': ['ID=0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:02.156438 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e5fca9f2-5df6-4e6e-ac8f-c594fb5c23b0 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.5812278 Nov 24 04:12:02.159031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] In _notify_port_updated(), no bound segment for port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:12:02.159906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.160516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.164684 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "PUT /v2.0/ports/61da1ce6-3ff4-477c-925a-8e0dc34a5227 HTTP/1.1" status: 200 len: 977 time: 1.9956841 Nov 24 04:12:02.164684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.184537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60422) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:02.184888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60424) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:02.223655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:02.224325 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6135bbb8-11df-4cbc-b823-998eb6b4f7ca None None] The sync data for ids ['c4c47676-087d-4294-b078-629be3c2c426'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:02.239265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.244276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.294125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-cfc1797a-7ebd-44cb-8f2c-4d8afc1988e7 None None] Port d61540d8-2fb7-462e-8765-7c1bd2afe551 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:02.298733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:02.303737 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Pushing event updated for resources: {'Port': ['ID=1892b3ea-a5fc-41fd-a458-b9714c5a708d,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:02.314244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:02.318294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:02.322761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.324963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Fanout notify agent at l3_agent the message router_deleted on router a8386b6b-248e-4548-b4bd-473c72f35a73 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:02.337139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.338338 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-05a6129b-640f-4c90-83b4-4c1a7519954a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/routers/a8386b6b-248e-4548-b4bd-473c72f35a73 HTTP/1.1" status: 204 len: 168 time: 2.7881148 Nov 24 04:12:02.356968 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60426) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:02.402499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a500976e-905b-4b9e-9258-4d0e62bb798d no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:02.426439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Attempting to bind port 1892b3ea-a5fc-41fd-a458-b9714c5a708d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:02.426823 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Attempting to bind port 1892b3ea-a5fc-41fd-a458-b9714c5a708d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:02.427192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Attempting to bind port 1892b3ea-a5fc-41fd-a458-b9714c5a708d on network a2b36c78-43a6-4954-8102-cb5638999bb1 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:02.431033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: a500976e-905b-4b9e-9258-4d0e62bb798d {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:02.431368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a500976e-905b-4b9e-9258-4d0e62bb798d not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:02.436155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 11, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:02.436994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Checking segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:02.436994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.437315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Bound using segment: {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:02.437957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Bound port: 1892b3ea-a5fc-41fd-a458-b9714c5a708d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd051869f-c3c0-4ecf-a145-43173c8bbee4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:02.438208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.455498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8481cb72-cc25-437e-93eb-af7ae48c0687 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=61da1ce6-3ff4-477c-925a-8e0dc34a5227,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:02.458057 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21b4444d-a703-43e8-ac53-fbd3c35f4f11 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.486752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21b4444d-a703-43e8-ac53-fbd3c35f4f11 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.519430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] For port 1892b3ea-a5fc-41fd-a458-b9714c5a708d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:02.523144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] For port 1892b3ea-a5fc-41fd-a458-b9714c5a708d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1892b3ea-a5fc-41fd-a458-b9714c5a708d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:02.527763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.543744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Deleting subnet 2f7d8ed8-b820-4cb9-a339-78c29b4488cf {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:02.549915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.568094 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.568352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.568643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.569434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.569608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.570024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.570963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.570963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.571595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.571831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:02.577150 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aceb5242-3318-40aa-9de7-d34872150f3e tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 9202 time: 0.3853414 Nov 24 04:12:02.579577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60428) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:02.593401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75447910-dbff-4b12-91a5-a64f206a4702 None None] Pushing event updated for resources: {'Port': ['ID=1892b3ea-a5fc-41fd-a458-b9714c5a708d,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:02.632656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21b4444d-a703-43e8-ac53-fbd3c35f4f11 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.643411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21b4444d-a703-43e8-ac53-fbd3c35f4f11 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.646795 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-21b4444d-a703-43e8-ac53-fbd3c35f4f11 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-group-rules/80783d64-42e1-4314-bfd7-d695696c0047 HTTP/1.1" status: 204 len: 168 time: 0.4570928 Nov 24 04:12:02.649851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:02.651054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60430) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:02.652828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.675973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b4444d-a703-43e8-ac53-fbd3c35f4f11 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=80783d64-42e1-4314-bfd7-d695696c0047,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:02.682595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.768896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.783870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.795545 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-422da015-9f5c-4894-9707-f8a95db48292 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1417372 Nov 24 04:12:02.800379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60432) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:02.949808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84388f9e-2a4c-45e0-9ea6-330e7e63fccd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:02.977736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Deleting port 61da1ce6-3ff4-477c-925a-8e0dc34a5227 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:02.978035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.015367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.050760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84388f9e-2a4c-45e0-9ea6-330e7e63fccd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.053426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.055730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.099332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Subnet': ['ID=2f7d8ed8-b820-4cb9-a339-78c29b4488cf,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:03.103258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1892b3ea-a5fc-41fd-a458-b9714c5a708d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:03.108908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] For port 61da1ce6-3ff4-477c-925a-8e0dc34a5227, host hv-neutron-8190, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:03.109274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.119494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.125653 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-03f8097a-07a3-43b0-b35b-00d513ecc37a tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/subnets/2f7d8ed8-b820-4cb9-a339-78c29b4488cf HTTP/1.1" status: 204 len: 168 time: 0.7655213 Nov 24 04:12:03.126912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60434) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.134952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-070ab96a-6295-41e8-9edf-7e7eb78a869f None None] Network a47a2785-1e21-4a90-b046-5bf9f26ab1aa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:03.175655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Calling delete_port for 61da1ce6-3ff4-477c-925a-8e0dc34a5227 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:03.209382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:03.209866 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.213943 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/ports/d61540d8-2fb7-462e-8765-7c1bd2afe551 HTTP/1.1" status: 200 len: 910 time: 1.8174710 Nov 24 04:12:03.213943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bafd129-1bb4-4085-a5f8-dbc1e11caa19 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=d61540d8-2fb7-462e-8765-7c1bd2afe551,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:03.218104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60436) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.259480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1892b3ea-a5fc-41fd-a458-b9714c5a708d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:03.260025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.285200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9f5ea2a-778a-4583-8339-9fe89fc3a263 None None] DHCP port deletion for a47a2785-1e21-4a90-b046-5bf9f26ab1aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:03.303015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84388f9e-2a4c-45e0-9ea6-330e7e63fccd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.307038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84388f9e-2a4c-45e0-9ea6-330e7e63fccd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.308214 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-84388f9e-2a4c-45e0-9ea6-330e7e63fccd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "DELETE /v2.0/security-groups/9efe3274-3ba4-4e48-ac7c-f1f2dc2f1b35 HTTP/1.1" status: 204 len: 168 time: 0.4998150 Nov 24 04:12:03.322466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60438) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.336295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84388f9e-2a4c-45e0-9ea6-330e7e63fccd tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9efe3274-3ba4-4e48-ac7c-f1f2dc2f1b35,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:03.375886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.378270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.413760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 1892b3ea-a5fc-41fd-a458-b9714c5a708d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1892b3ea-a5fc-41fd-a458-b9714c5a708d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:03.419892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.439901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Router 3d0d90ae-c638-4277-9998-3fafd099dea4 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:03.445144 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bd5e0c4f-05fd-4858-a6de-1ebca3c34509 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1217515 Nov 24 04:12:03.451484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.470617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60440) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.484520 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=1892b3ea-a5fc-41fd-a458-b9714c5a708d,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:03.518949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event deleted for resources: {'Port': ['ID=61da1ce6-3ff4-477c-925a-8e0dc34a5227,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:03.541182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.544437 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-666adc0e-ee43-4929-b381-d885cadf64c3 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "DELETE /v2.0/ports/61da1ce6-3ff4-477c-925a-8e0dc34a5227 HTTP/1.1" status: 204 len: 168 time: 0.9653034 Nov 24 04:12:03.550330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60442) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.578009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.603357 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fbd01d9f-5af2-4b85-8b9e-023090481222 tempest-SecGroupTest-1445319304 tempest-SecGroupTest-1445319304-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1297629 Nov 24 04:12:03.604726 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-9eb11eca-b1ec-4661-876e-5d71b38818e4 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:12:03.609680 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9eb11eca-b1ec-4661-876e-5d71b38818e4 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "GET /v2.0/ports/61da1ce6-3ff4-477c-925a-8e0dc34a5227 HTTP/1.1" status: 404 len: 333 time: 0.0557306 Nov 24 04:12:03.612722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60446) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.648228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1112612474', 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:03.650701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a47a2785-1e21-4a90-b046-5bf9f26ab1aa']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:03.671731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:12:03.699439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5523fa93-94f7-413e-8471-cf3c22a7a3da') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:03.699743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5523fa93-94f7-413e-8471-cf3c22a7a3da') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:03.714949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.735941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:03.738358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.744920 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-07268962-ac54-4a4f-9ac5-b6fecc72ad64 admin admin] 10.222.0.48 "PUT /v2.0/routers/3d0d90ae-c638-4277-9998-3fafd099dea4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7371359 Nov 24 04:12:03.747577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60448) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:03.755633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Releasing vlan 189 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:03.756039 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.764247 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] Sync routers for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:03.771039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Made reservation on behalf of 0523bb9f69d041e18c6b833f743c058c for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:03.773574 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:03.776099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.784758 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:03.785384 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:03.805478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:03.951011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.961357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:03.968076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] 10.222.0.48 "DELETE /v2.0/networks/a47a2785-1e21-4a90-b046-5bf9f26ab1aa HTTP/1.1" status: 204 len: 168 time: 0.8385780 Nov 24 04:12:03.984549 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ad3a52-1f10-47e7-87ee-f664226bbce9 tempest-FloatingIPTestJSON-53001933 tempest-FloatingIPTestJSON-53001933-project] Pushing event deleted for resources: {'Network': ['ID=a47a2785-1e21-4a90-b046-5bf9f26ab1aa,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:03.993213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.052525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.062233 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:04.081821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60456) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:04.130069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.145234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.170175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.265226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Deleting port b16f6f22-9ec8-455b-bfdc-56955cdb66ff {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:04.265802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.276261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c390c7bc-46eb-43d0-a82a-a575bd5eb4a0 None None] Provisioning complete for port 1892b3ea-a5fc-41fd-a458-b9714c5a708d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:04.276766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c390c7bc-46eb-43d0-a82a-a575bd5eb4a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.396594 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113'}], 'enable_snat': True}, 'gw_port_id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:12:02Z', 'revision_number': 5, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port': {'id': 'b16f6f22-9ec8-455b-bfdc-56955cdb66ff', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:cc:35:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:08:12Z', 'updated_at': '2021-11-24T04:08:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:04.443036 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] Checking router: 3d0d90ae-c638-4277-9998-3fafd099dea4 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:04.462868 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] Routers {'3d0d90ae-c638-4277-9998-3fafd099dea4'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:04.464337 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3d0d90ae-c638-4277-9998-3fafd099dea4'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:04.561125 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] Set router 3d0d90ae-c638-4277-9998-3fafd099dea4 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:04.581903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60464) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:04.620083 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:12:04Z', 'revision_number': 6, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:04.683716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] For port b16f6f22-9ec8-455b-bfdc-56955cdb66ff, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:04.684309 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.724928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Calling delete_port for b16f6f22-9ec8-455b-bfdc-56955cdb66ff owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:04.755231 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eab99c3-f100-48d1-a296-09c0ec8c0b64 None None] The sync data for ids ['3d0d90ae-c638-4277-9998-3fafd099dea4'] in dv-neutron-819049-1-hyperv is: [{'id': '3d0d90ae-c638-4277-9998-3fafd099dea4', 'name': 'tempest-ServerActionsTestJSON-1056098563-router', 'tenant_id': 'db5849637d02441e8e7822da79f37b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:08:11Z', 'updated_at': '2021-11-24T04:12:04Z', 'revision_number': 6, 'project_id': 'db5849637d02441e8e7822da79f37b83', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:04.764084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.799252 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-da6b678c-612f-45d5-b62a-ef7e2929f8bd admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=69073a2d6ab34b54a6451825f7590db1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2138410 Nov 24 04:12:04.799570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60470) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:04.898393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Network ceee3344-35f4-406e-a756-b0213671583f is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:04.902463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-227a9f8a-213d-41f5-a106-f2baeb179e6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.903770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] For port 1892b3ea-a5fc-41fd-a458-b9714c5a708d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1892b3ea-a5fc-41fd-a458-b9714c5a708d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:04.910692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:04.917193 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-21a03807-477b-491c-82ce-fdfd890af049 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=917ee233f40b492ca8fe95ab3082e427&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8282897 Nov 24 04:12:04.920306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60472) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:04.927951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:04.929720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:04.930200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.939080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:04.955555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e81854f0-5c4a-430e-b581-eeb514a42ab6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.971130 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-79c5d573-49e1-4c70-b73a-8d0115e017bf tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.3354294 Nov 24 04:12:04.974002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60474) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:04.976454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.980889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-227a9f8a-213d-41f5-a106-f2baeb179e6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.992703 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:04.993426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.033264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.072418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Pushing event deleted for resources: {'Port': ['ID=b16f6f22-9ec8-455b-bfdc-56955cdb66ff,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:05.093159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08f4e811-7c59-4da4-b6a2-0842efe39922 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:05.093348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:05.098422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5ad27da-6c9d-4caa-96df-61f339d05f18 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.098585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6bd8527-8bec-457c-a3eb-b340a7db6781 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:05.099863 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d6bd8527-8bec-457c-a3eb-b340a7db6781 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "GET /v2.0/ports/e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d HTTP/1.1" status: 200 len: 955 time: 0.1215453 Nov 24 04:12:05.104626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60476) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:05.109994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:05.117714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:05.118404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.143202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31e71762-16df-4a73-a30b-9f83b30a85af None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:05.156102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=1892b3ea-a5fc-41fd-a458-b9714c5a708d,revision_number=5']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:05.165311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Subnet': ['ID=0de81cdf-b406-4d3d-add2-bf50d2c3696c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:05.207365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5ad27da-6c9d-4caa-96df-61f339d05f18 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.226433 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-17bdbbbb-82bb-4ddd-8c42-0a0e5114cc35 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 3.2448974 Nov 24 04:12:05.230680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60478) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:05.237886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Request body: {'port': {'network_id': 'a2b36c78-43a6-4954-8102-cb5638999bb1', 'mac_address': 'fa:16:3e:c7:29:26', 'name': 'tempest-NetworksTestDHCPv6-1375208681'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:05.245714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-227a9f8a-213d-41f5-a106-f2baeb179e6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.248263 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-227a9f8a-213d-41f5-a106-f2baeb179e6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.251505 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-227a9f8a-213d-41f5-a106-f2baeb179e6a admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/42736ac5-448b-4f73-83a3-03b5753bdb67 HTTP/1.1" status: 204 len: 168 time: 0.4487550 Nov 24 04:12:05.263362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.317907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-227a9f8a-213d-41f5-a106-f2baeb179e6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42736ac5-448b-4f73-83a3-03b5753bdb67,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:05.390741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port d61540d8-2fb7-462e-8765-7c1bd2afe551 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:05.391442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.406333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.409664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.458764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5ad27da-6c9d-4caa-96df-61f339d05f18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.461972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5ad27da-6c9d-4caa-96df-61f339d05f18 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.465447 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b5ad27da-6c9d-4caa-96df-61f339d05f18 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/ef7bbc38-fc4e-48de-8cb1-4bcb5e7586fc HTTP/1.1" status: 204 len: 168 time: 0.5419145 Nov 24 04:12:05.468889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Deleting port e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:05.469474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.478662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ad27da-6c9d-4caa-96df-61f339d05f18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef7bbc38-fc4e-48de-8cb1-4bcb5e7586fc,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:05.495286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.495850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3d0d90ae-c638-4277-9998-3fafd099dea4 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:05.500191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.501360 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3383d7f0-eb6d-49f1-bc49-e25e92bb46ae admin admin] 10.222.0.48 "DELETE /v2.0/routers/3d0d90ae-c638-4277-9998-3fafd099dea4 HTTP/1.1" status: 204 len: 168 time: 1.7528572 Nov 24 04:12:05.509023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60484) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:05.557773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.574580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Calling delete_port for e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:05.605387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Deleting subnet df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:05.611311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.613167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Made reservation on behalf of f7a52a1f2e7f4bf2b011e140727dd116 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:05.688178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1892b3ea-a5fc-41fd-a458-b9714c5a708d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:05.730842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.744793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.785385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1892b3ea-a5fc-41fd-a458-b9714c5a708d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:05.785958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.814607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.821698 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "DELETE /v2.0/ports/e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d HTTP/1.1" status: 204 len: 168 time: 0.7142804 Nov 24 04:12:05.821698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2366744-b1cf-416f-93f3-644de9e8f802 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event deleted for resources: {'Port': ['ID=e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:05.823871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60496) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:05.832974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for d61540d8-2fb7-462e-8765-7c1bd2afe551 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:05.865104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.876365 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-e8f7f24c-0061-46dd-9a65-f2ed14d9edca tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:12:05.878261 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e8f7f24c-0061-46dd-9a65-f2ed14d9edca tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "GET /v2.0/ports/e9c5d045-8c2d-4edf-9e05-5e2c7a354b1d HTTP/1.1" status: 404 len: 333 time: 0.0534966 Nov 24 04:12:05.882785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60498) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:05.891483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Request body: {'port': {'network_id': 'ceee3344-35f4-406e-a756-b0213671583f', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1460802659'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:05.952693 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Made reservation on behalf of 0523bb9f69d041e18c6b833f743c058c for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:05.955252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:05.996342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port c272fd42-72cd-4339-be30-211866b2591d yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:06.028671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:06.037084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.086338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:06.086668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0fc0d4e0-d38b-403f-9a8e-5ecbc3a66658 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:06.150065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] device_id is not set on port af384040-e992-4979-8397-64edfb9b61a1 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:06.310232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.339964 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.393181 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.480935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=c272fd42-72cd-4339-be30-211866b2591d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:06.488896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Network ceee3344-35f4-406e-a756-b0213671583f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:06.491986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:06.494703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:06.496334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:06.497127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.504169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.513503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b610836a-869b-421c-afa3-1acee9dabadd None None] Provisioning complete for port 1892b3ea-a5fc-41fd-a458-b9714c5a708d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:06.514000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b610836a-869b-421c-afa3-1acee9dabadd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.521972 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-74d4ec5a-82bc-4510-8d71-9cb578f1879a tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 0.6353014 Nov 24 04:12:06.522317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60526) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:06.528811 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8190'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:06.550328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.559073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83825362-a5ec-43da-ae79-03d0ec03e014 None None] Network 4064fe6e-1a4a-440d-8829-8ec4922458b8 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:06.565170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.568683 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] 10.222.0.48 "DELETE /v2.0/subnets/df7e7408-6a2c-4f38-aa9d-4f7793f54ec8 HTTP/1.1" status: 204 len: 168 time: 1.0514345 Nov 24 04:12:06.573404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89efeeb7-fdca-4392-8ca4-bab8ac9b9141 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=df7e7408-6a2c-4f38-aa9d-4f7793f54ec8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:06.578997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60530) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:06.645066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:06.666834 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=d61540d8-2fb7-462e-8765-7c1bd2afe551,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:06.782811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60534) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:06.818449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60538) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:06.824000 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [-] 10.222.0.48 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0026190 Nov 24 04:12:06.842884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60540) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:06.889532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8::61 (a2b36c78-43a6-4954-8102-cb5638999bb1/ab833988-2618-4266-9d1f-55f42940b695/af384040-e992-4979-8397-64edfb9b61a1) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:06.916811 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] DHCP port deletion for 4064fe6e-1a4a-440d-8829-8ec4922458b8 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:07.024223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1892b3ea-a5fc-41fd-a458-b9714c5a708d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:07.032030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.035873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.045483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Allocated IP 2001:db8:0:1:f816:3eff:fec7:2926 (a2b36c78-43a6-4954-8102-cb5638999bb1/0de81cdf-b406-4d3d-add2-bf50d2c3696c/af384040-e992-4979-8397-64edfb9b61a1) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:07.054469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1060789900'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:07.060735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] device_id is not set on port c272fd42-72cd-4339-be30-211866b2591d yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:07.072673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.077927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] Deleting port ebd48602-ede1-47f6-8ef4-bccd3575ea0d {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:07.078543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.090379 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f8ece432-28a4-4fbb-9caa-d4ff035797b6 tempest-NetworksApiDiscovery-880661313 tempest-NetworksApiDiscovery-880661313-project] 10.222.0.48 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.2419014 Nov 24 04:12:07.098410 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.155693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] For port ebd48602-ede1-47f6-8ef4-bccd3575ea0d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,segment=NetworkSegment(672d840f-137e-4e24-919f-90c802e55efb),segment_id=672d840f-137e-4e24-919f-90c802e55efb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:07.156447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.158521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1892b3ea-a5fc-41fd-a458-b9714c5a708d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:07.158885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.171196 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=c272fd42-72cd-4339-be30-211866b2591d,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:07.173478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.173816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.174174 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.179358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.179697 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.180092 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 2 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.189861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] Calling delete_port for ebd48602-ede1-47f6-8ef4-bccd3575ea0d owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:07.192596 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.193412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.193768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.199491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.199821 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.200217 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 3 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.214983 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.215325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.215666 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.221359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.221694 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.222089 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 4 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.237598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.237844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.238068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.243416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.243976 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.244191 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 5 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.259458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.259811 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.260151 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.264915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.265147 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.265513 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 6 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.275648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:07.279529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.279895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.280285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.280606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.286473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.286834 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.287283 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 7 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.303077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.304117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.304474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.310188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.310426 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.311872 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 8 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.313005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.329069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.334255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.335178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.335742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.342838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b16f6f22-9ec8-455b-bfdc-56955cdb66ff no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:07.345711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.346422 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.348514 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 9 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.373250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.376262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.376847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.382089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.382865 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.383505 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempt 10 to bind port c272fd42-72cd-4339-be30-211866b2591d Nov 24 04:12:07.385069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] Pushing event deleted for resources: {'Port': ['ID=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:07.387010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53685ebf-0e36-4ab3-81b3-8b8b681805b9 None None] No DVR routers for this DVR port ebd48602-ede1-47f6-8ef4-bccd3575ea0d on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:07.388423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b16f6f22-9ec8-455b-bfdc-56955cdb66ff {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:07.388763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b16f6f22-9ec8-455b-bfdc-56955cdb66ff not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:07.417127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:07.417605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:07.418048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempting to bind port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:07.422914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:07.423863 dv-neutron-819049-1-hyperv neutron-server[103380]: ERROR neutron.plugins.ml2.managers [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Failed to bind port c272fd42-72cd-4339-be30-211866b2591d on host hv-neutron-8190 for vnic_type normal using segments [{'id': '9cab86f0-8818-4dfb-b169-1e3793ed8028', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': 'ceee3344-35f4-406e-a756-b0213671583f'}] Nov 24 04:12:07.423863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.472873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60548) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:07.477174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router c4c47676-087d-4294-b078-629be3c2c426 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:07.501537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Deleting port ebd48602-ede1-47f6-8ef4-bccd3575ea0d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:07.501881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.505077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] For port c272fd42-72cd-4339-be30-211866b2591d, host hv-neutron-8190, cleared binding levels {{(pid=103380) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:07.505559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attempted to set empty binding levels {{(pid=103380) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 04:12:07.510977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.545205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] In _notify_port_updated(), no bound segment for port c272fd42-72cd-4339-be30-211866b2591d on network ceee3344-35f4-406e-a756-b0213671583f {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:12:07.546379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:07.547066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.548848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "PUT /v2.0/ports/c272fd42-72cd-4339-be30-211866b2591d HTTP/1.1" status: 200 len: 977 time: 1.0252469 Nov 24 04:12:07.551528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60552) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:07.638986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22c8505-081f-488b-bdb2-beb4501689ea tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event updated for resources: {'Port': ['ID=c272fd42-72cd-4339-be30-211866b2591d,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:07.643091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae4162bd-9dd2-48a3-91bd-878bb4312c81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.683397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Deleting port c272fd42-72cd-4339-be30-211866b2591d {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:07.683761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.686288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] For port ebd48602-ede1-47f6-8ef4-bccd3575ea0d, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:07.686674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.692620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.694350 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:07.705216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] Sync routers for ids ['c4c47676-087d-4294-b078-629be3c2c426'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:07.714606 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bd41c04b-ff82-47ec-8ef4-100da212c35e tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/c4c47676-087d-4294-b078-629be3c2c426/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4951062 Nov 24 04:12:07.714892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60554) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:07.720632 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] Routers {'c4c47676-087d-4294-b078-629be3c2c426'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:07.721538 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c4c47676-087d-4294-b078-629be3c2c426'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:07.728999 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Calling delete_port for ebd48602-ede1-47f6-8ef4-bccd3575ea0d owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:07.736471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Port ebd48602-ede1-47f6-8ef4-bccd3575ea0d was not found and therefore no delete operation was performed {{(pid=103381) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:12:07.746798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.750592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.761810 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:07.766421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.771145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] Routers {'c4c47676-087d-4294-b078-629be3c2c426'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:07.771862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:11:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['c4c47676-087d-4294-b078-629be3c2c426'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:07.782089 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-641ee443-af05-44be-bf7d-d7ec69458271 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=c4c47676-087d-4294-b078-629be3c2c426 HTTP/1.1" status: 200 len: 205 time: 0.0648065 Nov 24 04:12:07.789837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60556) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:07.803745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Pushing event deleted for resources: {'Port': ['ID=ebd48602-ede1-47f6-8ef4-bccd3575ea0d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:07.807107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:07.807932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afdfcea9-e7d8-405e-96bf-bf265f9082e1 None None] The sync data for ids ['c4c47676-087d-4294-b078-629be3c2c426'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:07.814690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] No DVR routers for this DVR port ebd48602-ede1-47f6-8ef4-bccd3575ea0d on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:07.823432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 161, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:07.851270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] For port c272fd42-72cd-4339-be30-211866b2591d, host hv-neutron-8190, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:07.851854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.863512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.863843 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment b0ab0804-7f9b-4c31-bf12-1c25c5735467 of type vlan for network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 Nov 24 04:12:07.879962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.881556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'SecurityGroup': ['ID=538ad144-886d-4797-a27b-4065d8353844,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:07.908801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Calling delete_port for c272fd42-72cd-4339-be30-211866b2591d owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:07.914389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.930675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae4162bd-9dd2-48a3-91bd-878bb4312c81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.948259 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0388bf84-bbd4-423b-8905-bca539e3b796 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.989042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.992608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:07.993472 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae4162bd-9dd2-48a3-91bd-878bb4312c81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.015878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Network a2b36c78-43a6-4954-8102-cb5638999bb1 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:08.034574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:08.040047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4064fe6e-1a4a-440d-8829-8ec4922458b8']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:08.042065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:08.047763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:08.048587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.056374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event updated for resources: {'Port': ['ID=af384040-e992-4979-8397-64edfb9b61a1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:08.087468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '672d840f-137e-4e24-919f-90c802e55efb') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:08.087922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '672d840f-137e-4e24-919f-90c802e55efb') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:08.104522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.105919 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ae4162bd-9dd2-48a3-91bd-878bb4312c81 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=2db9ebf5510346d488e2aa68ba59d579&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6319439 Nov 24 04:12:08.109787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60558) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.127527 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-44aa5fcd-396c-4362-8b47-b2f045455a53 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 2.8931699 Nov 24 04:12:08.127527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.133397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:08.134015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.136281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60560) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.142426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae4162bd-9dd2-48a3-91bd-878bb4312c81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=719726d8-17d2-442c-8e6a-bfba68f20db3,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:08.187278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.191209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.197698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.4573255 Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Releasing vlan 157 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:08.262171 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:08.271338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.273105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router c4c47676-087d-4294-b078-629be3c2c426 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:08.288871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.292932 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-34db65ac-208f-4ba7-b04f-3b3dc7fee124 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/c4c47676-087d-4294-b078-629be3c2c426 HTTP/1.1" status: 204 len: 168 time: 0.4994392 Nov 24 04:12:08.292932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60562) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.303734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.365439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a2b59dde-aa98-464c-be70-5e56c36a568a None None] Provisioning complete for port af384040-e992-4979-8397-64edfb9b61a1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:08.365821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a2b59dde-aa98-464c-be70-5e56c36a568a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.378869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.390166 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "DELETE /v2.0/ports/c272fd42-72cd-4339-be30-211866b2591d HTTP/1.1" status: 204 len: 168 time: 0.8339677 Nov 24 04:12:08.412683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60564) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.413702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60566) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.417153 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a2b59dde-aa98-464c-be70-5e56c36a568a None None] Port af384040-e992-4979-8397-64edfb9b61a1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:08.429881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:08.436900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33ef3a7-0abc-46ec-823d-720ea2fa0984 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] Pushing event deleted for resources: {'Port': ['ID=c272fd42-72cd-4339-be30-211866b2591d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:08.471031 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-f9e251ae-5c68-4dbd-b43e-840e091d9bb9 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] GET failed (client error): The resource could not be found. Nov 24 04:12:08.476807 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f9e251ae-5c68-4dbd-b43e-840e091d9bb9 tempest-PortsAdminExtendedAttrsTestJSON-1998016902 tempest-PortsAdminExtendedAttrsTestJSON-1998016902-project-admin] 10.222.0.48 "GET /v2.0/ports/c272fd42-72cd-4339-be30-211866b2591d HTTP/1.1" status: 404 len: 333 time: 0.0576987 Nov 24 04:12:08.480146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60568) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.486405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet 8d5f518d-c9d6-478a-82fd-b9f890fc8fb1 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:08.498410 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.625332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.651322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53deeb38-e106-4887-939b-4cd9036cf68b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=c62f8a24-132b-4a75-9aa8-b8366a6c2c14,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:08.663568 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:08.670390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.704298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:08.704806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-68adb77e-2025-411d-9c5e-926362722a53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.708580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.715847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.720257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.724148 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] 10.222.0.48 "DELETE /v2.0/networks/4064fe6e-1a4a-440d-8829-8ec4922458b8 HTTP/1.1" status: 204 len: 168 time: 2.1122475 Nov 24 04:12:08.755682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.761501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa46e5fc-9a9c-4cba-94b5-d3809f845fa3 admin admin] Pushing event deleted for resources: {'Network': ['ID=4064fe6e-1a4a-440d-8829-8ec4922458b8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:08.766482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-68adb77e-2025-411d-9c5e-926362722a53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.788360 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting port af384040-e992-4979-8397-64edfb9b61a1 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:08.788767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.876471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.891227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-68adb77e-2025-411d-9c5e-926362722a53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.894395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-68adb77e-2025-411d-9c5e-926362722a53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.895831 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-68adb77e-2025-411d-9c5e-926362722a53 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/719726d8-17d2-442c-8e6a-bfba68f20db3 HTTP/1.1" status: 204 len: 168 time: 0.7846341 Nov 24 04:12:08.916961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60574) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:08.917478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.933506 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Calling delete_port for af384040-e992-4979-8397-64edfb9b61a1 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:08.949853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68adb77e-2025-411d-9c5e-926362722a53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=719726d8-17d2-442c-8e6a-bfba68f20db3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:08.956430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ebd48602-ede1-47f6-8ef4-bccd3575ea0d no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:08.973790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:08.982874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ebd48602-ede1-47f6-8ef4-bccd3575ea0d {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:08.983230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ebd48602-ede1-47f6-8ef4-bccd3575ea0d not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:09.020810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ceee3344-35f4-406e-a756-b0213671583f']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:09.048542 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9cab86f0-8818-4dfb-b169-1e3793ed8028') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:09.048845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9cab86f0-8818-4dfb-b169-1e3793ed8028') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:09.072302 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.077501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.100904 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8b5f5c8a-4543-4bc6-8fbc-cc459bee336b admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=db5849637d02441e8e7822da79f37b83&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1809125 Nov 24 04:12:09.106166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60578) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:09.144955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=8d5f518d-c9d6-478a-82fd-b9f890fc8fb1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:09.148299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.151524 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2a949ef1-9712-4421-94aa-35799bc13d6f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/8d5f518d-c9d6-478a-82fd-b9f890fc8fb1 HTTP/1.1" status: 204 len: 168 time: 0.8576443 Nov 24 04:12:09.154479 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60582) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:09.155742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.158436 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb72fd48-12ce-435e-b385-d9e084c95074 None None] Network e14b6f12-b9fb-4a39-a00f-3ef4417829e3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:09.186298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Releasing vlan 150 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:09.186612 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:09.192466 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:09.227699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-255ce223-1499-4f3c-9da4-9c2fe98d7e31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.246241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.303177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-255ce223-1499-4f3c-9da4-9c2fe98d7e31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.320839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Port': ['ID=af384040-e992-4979-8397-64edfb9b61a1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:09.353059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.360381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.373146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.376667 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] 10.222.0.48 "DELETE /v2.0/networks/ceee3344-35f4-406e-a756-b0213671583f HTTP/1.1" status: 204 len: 168 time: 0.8954442 Nov 24 04:12:09.389398 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.397380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee01d0b2-d2a4-48e4-86ac-1f3f494f5e59 tempest-PortsAdminExtendedAttrsTestJSON-89761006 tempest-PortsAdminExtendedAttrsTestJSON-89761006-project] Pushing event deleted for resources: {'Network': ['ID=ceee3344-35f4-406e-a756-b0213671583f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:09.397871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] DHCP port deletion for e14b6f12-b9fb-4a39-a00f-3ef4417829e3 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:09.468253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.478848 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d9d3136c-5c16-47a0-896c-78c073ab1263 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/af384040-e992-4979-8397-64edfb9b61a1 HTTP/1.1" status: 204 len: 168 time: 1.3361588 Nov 24 04:12:09.480760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60592) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:09.484819 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] Deleting port 84092878-1d24-4ecb-a6f7-04140cc83a48 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:09.485202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.532246 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=99e91869-c724-430f-9652-ac006fab3f8a,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:09.547005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-255ce223-1499-4f3c-9da4-9c2fe98d7e31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.549623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-255ce223-1499-4f3c-9da4-9c2fe98d7e31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.558737 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-255ce223-1499-4f3c-9da4-9c2fe98d7e31 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/f0b82a50-8098-4b00-997f-087063d3800e HTTP/1.1" status: 204 len: 168 time: 0.4514740 Nov 24 04:12:09.573083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': 'b0ab0804-7f9b-4c31-bf12-1c25c5735467', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:09.573714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: c62f8a24-132b-4a75-9aa8-b8366a6c2c14, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:09.588072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 84092878-1d24-4ecb-a6f7-04140cc83a48 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:09.588409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.604960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5418fa32-a1a7-4ec5-94b1-5a031add85d0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:09.612697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60598) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:09.614532 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5418fa32-a1a7-4ec5-94b1-5a031add85d0 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.1323638 Nov 24 04:12:09.615714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255ce223-1499-4f3c-9da4-9c2fe98d7e31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0b82a50-8098-4b00-997f-087063d3800e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:09.626616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] For port 84092878-1d24-4ecb-a6f7-04140cc83a48, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84092878-1d24-4ecb-a6f7-04140cc83a48,segment=NetworkSegment(209ad88e-035f-4fc4-b139-38bb0c47165d),segment_id=209ad88e-035f-4fc4-b139-38bb0c47165d)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:09.628553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.636966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:09.679885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] Calling delete_port for 84092878-1d24-4ecb-a6f7-04140cc83a48 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:09.708758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, c62f8a24-132b-4a75-9aa8-b8366a6c2c14) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:09.727843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 84092878-1d24-4ecb-a6f7-04140cc83a48, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84092878-1d24-4ecb-a6f7-04140cc83a48,segment=NetworkSegment(209ad88e-035f-4fc4-b139-38bb0c47165d),segment_id=209ad88e-035f-4fc4-b139-38bb0c47165d)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:09.728486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.733538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:09.734169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.777409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32832b88-1122-413a-9f48-8811c40033a2 None None] Network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:09.838010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60604) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:09.900008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:09.958991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] No DVR routers for this DVR port 84092878-1d24-4ecb-a6f7-04140cc83a48 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:09.964951 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e78a45-f6f2-4342-a554-a677a6943f4f None None] Pushing event deleted for resources: {'Port': ['ID=84092878-1d24-4ecb-a6f7-04140cc83a48,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:10.024620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-c62f8a24-132b-4a75-9aa8-b8366a6c2c14', 'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': '99e91869-c724-430f-9652-ac006fab3f8a'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:10.025515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.066512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.066657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 84092878-1d24-4ecb-a6f7-04140cc83a48 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:10.077771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9d94f13-a4e7-4585-a561-47a94747e31f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:10.080263 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c9d94f13-a4e7-4585-a561-47a94747e31f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.4648707 Nov 24 04:12:10.082860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60616) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:10.134029 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-56f98ae7-c819-41df-a59c-b81d0fcbbb07 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.7117724 Nov 24 04:12:10.136698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60620) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:10.143622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1838245574'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:10.219618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Allocated IP 172.20.255.242 (c62f8a24-132b-4a75-9aa8-b8366a6c2c14/99e91869-c724-430f-9652-ac006fab3f8a/984231f8-e4fb-4b65-892f-c5e8bc34ada8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:10.270420 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-11e869a8-e3ed-41c9-ac1c-18fdbc34c2a3 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=ce07443a74184ec9b000b86933101610&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4264190 Nov 24 04:12:10.273819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:10.283414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:10.286939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.313280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-740409db-1d54-4e71-848c-1d1e9e55a421 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:10.314944 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-740409db-1d54-4e71-848c-1d1e9e55a421 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:10.317074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-740409db-1d54-4e71-848c-1d1e9e55a421 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:10.318715 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-740409db-1d54-4e71-848c-1d1e9e55a421 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.2348282 Nov 24 04:12:10.322023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60630) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:10.346097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 188, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:10.351572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.383127 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet 0de81cdf-b406-4d3d-add2-bf50d2c3696c {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:10.385189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.385604 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment c7b14d5b-ae50-4842-a029-c77fcd474051 of type vlan for network 31a4b687-b268-49e1-9f85-a530cacdb9fa Nov 24 04:12:10.386464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.387257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=84092878-1d24-4ecb-a6f7-04140cc83a48,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:10.399267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port 84092878-1d24-4ecb-a6f7-04140cc83a48 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:10.431469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.479692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.552587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-844a0001-3176-4ae3-be68-6f219cff1f57 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.555211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.570642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.576950 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:10.577366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.597808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e14b6f12-b9fb-4a39-a00f-3ef4417829e3']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:10.613946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-844a0001-3176-4ae3-be68-6f219cff1f57 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.628354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '209ad88e-035f-4fc4-b139-38bb0c47165d') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:10.628657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '209ad88e-035f-4fc4-b139-38bb0c47165d') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:10.642759 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.5022480 Nov 24 04:12:10.651018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60640) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:10.660416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:10.693446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.696975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.707297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.712282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.721046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315552c6-71b8-4b4a-941d-876493654e53 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=31a4b687-b268-49e1-9f85-a530cacdb9fa,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:10.744055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.757953 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-844a0001-3176-4ae3-be68-6f219cff1f57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.761979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-844a0001-3176-4ae3-be68-6f219cff1f57 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.765869 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-844a0001-3176-4ae3-be68-6f219cff1f57 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/5bf5f26d-ae94-4421-a892-9a3c16003402 HTTP/1.1" status: 204 len: 168 time: 0.4910400 Nov 24 04:12:10.782918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844a0001-3176-4ae3-be68-6f219cff1f57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bf5f26d-ae94-4421-a892-9a3c16003402,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:10.788804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 31a4b687-b268-49e1-9f85-a530cacdb9fa details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:10.790976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 155 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:10.791664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:10.795378 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:10.868336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.878244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:10.896010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:10.933063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:10.933903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.941853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Pushing event updated for resources: {'Port': ['ID=984231f8-e4fb-4b65-892f-c5e8bc34ada8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:10.960030 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.972495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.982881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=0de81cdf-b406-4d3d-add2-bf50d2c3696c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:10.983594 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/e14b6f12-b9fb-4a39-a00f-3ef4417829e3 HTTP/1.1" status: 204 len: 168 time: 1.8249671 Nov 24 04:12:10.984864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:10.991764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97145da6-5a7e-48ec-9199-518d13d775f6 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=e14b6f12-b9fb-4a39-a00f-3ef4417829e3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:11.000378 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-06725cdd-0c78-4230-be24-2c3d24e1fada tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/0de81cdf-b406-4d3d-add2-bf50d2c3696c HTTP/1.1" status: 204 len: 168 time: 0.6773033 Nov 24 04:12:11.001372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60654) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.001586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:11.006072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.010848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-466995232', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:11.012422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60656) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.024377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84092878-1d24-4ecb-a6f7-04140cc83a48 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:11.024914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12c3d6fa-4326-4905-a0e1-1de9a97d0c26 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:11.067502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.069120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.120599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Attempting to bind port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:11.121866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Attempting to bind port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'b0ab0804-7f9b-4c31-bf12-1c25c5735467', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:11.122480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Attempting to bind port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 on network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:11.134892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 84092878-1d24-4ecb-a6f7-04140cc83a48 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:11.135287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84092878-1d24-4ecb-a6f7-04140cc83a48 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:11.146531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Deleting subnet ab833988-2618-4266-9d1f-55f42940b695 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:11.155025 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.157928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:11.158515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Checking segment: {'id': 'b0ab0804-7f9b-4c31-bf12-1c25c5735467', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:11.159127 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.159377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Bound using segment: {'id': 'b0ab0804-7f9b-4c31-bf12-1c25c5735467', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:11.160294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Bound port: 984231f8-e4fb-4b65-892f-c5e8bc34ada8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b0ab0804-7f9b-4c31-bf12-1c25c5735467', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'c62f8a24-132b-4a75-9aa8-b8366a6c2c14'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:11.160978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.187796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.198041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.208445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.242970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.246964 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c468e7e9-0a28-4fe2-bd52-71e4cf2b4179 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.2422862 Nov 24 04:12:11.248577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60662) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.258980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-401814761'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:11.283572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] For port 984231f8-e4fb-4b65-892f-c5e8bc34ada8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:11.286923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:11.287447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] For port 984231f8-e4fb-4b65-892f-c5e8bc34ada8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=984231f8-e4fb-4b65-892f-c5e8bc34ada8,segment=NetworkSegment(b0ab0804-7f9b-4c31-bf12-1c25c5735467),segment_id=b0ab0804-7f9b-4c31-bf12-1c25c5735467)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:11.295830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.296585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.329559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 180, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:11.347693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.348033 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 6bcc484d-8451-4326-bc3a-c89847342164 of type vlan for network bfb31842-b19b-4567-8e79-11d158d17b4d Nov 24 04:12:11.422986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19aa004f-9830-4e66-a8cf-2d16075144cb None None] Pushing event updated for resources: {'Port': ['ID=984231f8-e4fb-4b65-892f-c5e8bc34ada8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:11.445570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.503304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.510490 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:11.511803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.513276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.577775 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.3264873 Nov 24 04:12:11.581174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60670) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.587448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:11.620837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.653962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60672) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.655132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1445568-2ef3-4136-bfca-143959b6ccf8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=bfb31842-b19b-4567-8e79-11d158d17b4d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:11.668169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network bfb31842-b19b-4567-8e79-11d158d17b4d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:11.719275 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=0322cd41-0f7d-483c-84bb-528778b128fc,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:11.767551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': 'c7b14d5b-ae50-4842-a029-c77fcd474051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:11.775754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: 31a4b687-b268-49e1-9f85-a530cacdb9fa, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:11.809316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network 31a4b687-b268-49e1-9f85-a530cacdb9fa is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:11.831554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 31a4b687-b268-49e1-9f85-a530cacdb9fa) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:11.865551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-485dd555-3510-46a0-94f9-027870597c05 None None] Network 31a4b687-b268-49e1-9f85-a530cacdb9fa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:11.874074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60676) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.880534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:11.882505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.899345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.918469 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-48ba6847-f2fa-4302-aef3-69b4c9a96646 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=0523bb9f69d041e18c6b833f743c058c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2507718 Nov 24 04:12:11.925358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60680) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:11.981059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Subnet': ['ID=ab833988-2618-4266-9d1f-55f42940b695,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:11.988182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:11.996924 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e389d833-1b04-4aab-bc1d-28daf4395962 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ab833988-2618-4266-9d1f-55f42940b695 HTTP/1.1" status: 204 len: 168 time: 0.9832430 Nov 24 04:12:12.008234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60684) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.033565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:12.045060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.112347 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cb7c1ea2-1dec-4525-85d5-5f99bdf5c4ee tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1028993 Nov 24 04:12:12.128139 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5dd4efb6-e8e1-4c6f-8a01-96e593af685c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 1.4752343 Nov 24 04:12:12.128863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60688) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.130861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60690) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.144442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.187391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-31a4b687-b268-49e1-9f85-a530cacdb9fa', 'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': '0322cd41-0f7d-483c-84bb-528778b128fc'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:12.188542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.258432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--1980469136', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:12.360903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6c22efa-31f4-4cd9-9388-27a385cca481 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.366966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.380143 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:12:12.414106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Allocated IP 172.20.0.2 (31a4b687-b268-49e1-9f85-a530cacdb9fa/0322cd41-0f7d-483c-84bb-528778b128fc/dc8e8e80-622e-49dd-90bc-8b8f9549e031) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:12.453458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:12.460770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.479025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6c22efa-31f4-4cd9-9388-27a385cca481 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.491493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73942d93-a579-4ef0-bf75-226c258bbb90 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:12.495014 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-73942d93-a579-4ef0-bf75-226c258bbb90 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.3581455 Nov 24 04:12:12.495409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60700) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.532336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.604121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e24ce49-2256-4431-bc20-5e366e59ccdc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:12.608056 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1e24ce49-2256-4431-bc20-5e366e59ccdc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1092362 Nov 24 04:12:12.608269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60704) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.611193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fb3bb3f-f9c4-42a5-be06-10ad91913295 None None] Network a2b36c78-43a6-4954-8102-cb5638999bb1 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:12.620489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.673490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bb8afdd9-de28-4d58-a5a3-dc405e9c8ea9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0611444 Nov 24 04:12:12.680535 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60706) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.729563 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-2725a4a4-e87a-4d0f-856a-464b8b1925d2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:12.730565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2725a4a4-e87a-4d0f-856a-464b8b1925d2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:12.734068 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2725a4a4-e87a-4d0f-856a-464b8b1925d2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/af384040-e992-4979-8397-64edfb9b61a1 HTTP/1.1" status: 404 len: 333 time: 0.0498707 Nov 24 04:12:12.737641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60708) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.752738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60710) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.760831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6c22efa-31f4-4cd9-9388-27a385cca481 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.763578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b6c22efa-31f4-4cd9-9388-27a385cca481 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.764891 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b6c22efa-31f4-4cd9-9388-27a385cca481 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/b24e9dc8-2731-4feb-a675-4c93e5f7244d HTTP/1.1" status: 204 len: 168 time: 0.8384919 Nov 24 04:12:12.784237 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e88651b-1966-4c15-b3fd-9d1564683073 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:12.785749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e88651b-1966-4c15-b3fd-9d1564683073 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:12.789940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c22efa-31f4-4cd9-9388-27a385cca481 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b24e9dc8-2731-4feb-a675-4c93e5f7244d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:12.791664 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0e88651b-1966-4c15-b3fd-9d1564683073 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/0de81cdf-b406-4d3d-add2-bf50d2c3696c HTTP/1.1" status: 404 len: 337 time: 0.0526025 Nov 24 04:12:12.796133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60716) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.809903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-906ce431-ac39-4f51-8c65-7a27754c265f None None] Provisioning complete for port 1892b3ea-a5fc-41fd-a458-b9714c5a708d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:12.811028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-906ce431-ac39-4f51-8c65-7a27754c265f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.820075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.834074 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-b5d1f22e-23e6-4da9-ac12-21a521b91325 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:12.835248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b5d1f22e-23e6-4da9-ac12-21a521b91325 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:12.842368 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b5d1f22e-23e6-4da9-ac12-21a521b91325 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ab833988-2618-4266-9d1f-55f42940b695 HTTP/1.1" status: 404 len: 337 time: 0.0447879 Nov 24 04:12:12.842881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60718) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.873843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.892199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:12.948167 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-ff12f705-ce61-454c-bc52-07b147f148bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:12.949355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ff12f705-ce61-454c-bc52-07b147f148bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:12.955351 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60720) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:12.967210 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ff12f705-ce61-454c-bc52-07b147f148bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/1be8c6f3-e2c0-488e-a2f2-d24944cd8b8b HTTP/1.1" status: 404 len: 333 time: 0.1038430 Nov 24 04:12:12.987169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.010735 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-517dc4f8-b774-4048-920a-7090309ed119 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.011232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-517dc4f8-b774-4048-920a-7090309ed119 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.022654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.025309 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-517dc4f8-b774-4048-920a-7090309ed119 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/50180eb8-1743-4adc-afff-33e5b3177b3f HTTP/1.1" status: 404 len: 337 time: 0.0678368 Nov 24 04:12:13.027923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60722) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.046284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Network 31a4b687-b268-49e1-9f85-a530cacdb9fa is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:13.051652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b27992f1-92b0-42f2-a1e4-15d3b165bb88 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Request body: {'quota': {'network': 2}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:13.058709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:13.061166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:13.065889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Pushing event updated for resources: {'Port': ['ID=dc8e8e80-622e-49dd-90bc-8b8f9549e031,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.099870 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d3088908-b194-49d4-a34b-892ba8a06867 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.102030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d3088908-b194-49d4-a34b-892ba8a06867 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.107174 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d3088908-b194-49d4-a34b-892ba8a06867 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/43cdcfa5-6334-4e58-ae35-5977605b3fb5 HTTP/1.1" status: 404 len: 337 time: 0.0683134 Nov 24 04:12:13.112400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb5d0104-b845-46c1-932d-140cec33515f None None] Network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:13.113358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=55c9bcd5-c346-4d90-b085-6eb5a018f8ca,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.115067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 984231f8-e4fb-4b65-892f-c5e8bc34ada8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:13.115432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60724) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.120196 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=2fd90e2e-d7be-46b0-b347-1ae9291266ea,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.127482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.160926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=0322cd41-0f7d-483c-84bb-528778b128fc,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.169643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 156, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:13.174167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:13.174708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: bfb31842-b19b-4567-8e79-11d158d17b4d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:13.174855 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-429aa64e-d4d7-407d-ba25-a4c2437c8776 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.175455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-429aa64e-d4d7-407d-ba25-a4c2437c8776 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.181945 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-429aa64e-d4d7-407d-ba25-a4c2437c8776 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/c87327c2-819d-4e5b-aa5f-66202fec651a HTTP/1.1" status: 404 len: 333 time: 0.0599797 Nov 24 04:12:13.187715 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b27992f1-92b0-42f2-a1e4-15d3b165bb88 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "PUT /v2.0/quotas/9152ba16476a4f0baab8b13f27f9135e HTTP/1.1" status: 200 len: 368 time: 0.4309099 Nov 24 04:12:13.187897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60728) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.188054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60730) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.199337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Request body: {'network': {'project_id': '9152ba16476a4f0baab8b13f27f9135e'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:13.239456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Made reservation on behalf of 9152ba16476a4f0baab8b13f27f9135e for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:13.253041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.263662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.283191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] DHCP port deletion for a2b36c78-43a6-4954-8102-cb5638999bb1 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:13.293369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Attempting to bind port dc8e8e80-622e-49dd-90bc-8b8f9549e031 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:13.293369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Attempting to bind port dc8e8e80-622e-49dd-90bc-8b8f9549e031 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'c7b14d5b-ae50-4842-a029-c77fcd474051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:13.293369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Attempting to bind port dc8e8e80-622e-49dd-90bc-8b8f9549e031 on network 31a4b687-b268-49e1-9f85-a530cacdb9fa {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:13.308122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:13.308521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Checking segment: {'id': 'c7b14d5b-ae50-4842-a029-c77fcd474051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:13.308921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.309393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Bound using segment: {'id': 'c7b14d5b-ae50-4842-a029-c77fcd474051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:13.309795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Bound port: dc8e8e80-622e-49dd-90bc-8b8f9549e031, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c7b14d5b-ae50-4842-a029-c77fcd474051', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 188, 'network_id': '31a4b687-b268-49e1-9f85-a530cacdb9fa'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:13.310869 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.316230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.316573 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment 30f1aa6c-2278-4dd6-a015-c8daf36f40bb of type vlan for network becef48c-b834-483b-91dc-0f71ec58e834 Nov 24 04:12:13.359032 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-8e7f3c62-848e-4357-aad3-b122dd31a88a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.359392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8e7f3c62-848e-4357-aad3-b122dd31a88a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.366175 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8e7f3c62-848e-4357-aad3-b122dd31a88a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/8f3b8bef-c0b8-404e-b92f-0f386a1ae5e1 HTTP/1.1" status: 404 len: 337 time: 0.1725018 Nov 24 04:12:13.369998 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.370178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60736) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.416889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.418606 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-0aa8cdbc-5879-46c8-861e-21bbb8048010 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.419192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0aa8cdbc-5879-46c8-861e-21bbb8048010 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.421072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:13.421488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.422496 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0aa8cdbc-5879-46c8-861e-21bbb8048010 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/5f976dae-965d-47b3-a563-55c7d34c38e9 HTTP/1.1" status: 404 len: 337 time: 0.0528882 Nov 24 04:12:13.425482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60740) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.426352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network bfb31842-b19b-4567-8e79-11d158d17b4d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:13.447050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['31a4b687-b268-49e1-9f85-a530cacdb9fa']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:13.449175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, bfb31842-b19b-4567-8e79-11d158d17b4d) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:13.459358 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-2dbfbfa0-2499-490d-854d-060eee7f4524 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.460531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2dbfbfa0-2499-490d-854d-060eee7f4524 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.463961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c7b14d5b-ae50-4842-a029-c77fcd474051') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:13.464261 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c7b14d5b-ae50-4842-a029-c77fcd474051') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:13.467148 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.469116 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2dbfbfa0-2499-490d-854d-060eee7f4524 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/7449cddc-7e25-440d-973c-876468db5e92 HTTP/1.1" status: 404 len: 333 time: 0.0413222 Nov 24 04:12:13.470317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.473339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24f2be53-5ca4-45ed-981f-7542fe7fa19c None None] Network bfb31842-b19b-4567-8e79-11d158d17b4d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:13.474679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60742) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.478668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:13.479279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.488327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.526581 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6cb5d280-a630-4a7a-89fc-3d90e54c4acb tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9439445 Nov 24 04:12:13.526915 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-472e6d76-0c76-46c4-857b-e83bdaf6a7ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.527553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-472e6d76-0c76-46c4-857b-e83bdaf6a7ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.527731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.531314 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-472e6d76-0c76-46c4-857b-e83bdaf6a7ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/791109fa-23b9-47ce-8d9a-b7c6c90d0dcc HTTP/1.1" status: 404 len: 337 time: 0.0531664 Nov 24 04:12:13.536892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60746) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.536892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60748) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.540154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] vlan segment allocate from pool success with {'vlan_id': 151, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:13.551105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c68ace57-8015-4b8a-97de-52057764c5c7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.557549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 188 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:13.558474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.561064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.563956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.564440 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.564653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.565004 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.565525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.565743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.566182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.566536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.566873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.567208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.567606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.567958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:13.570051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:13.570702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.574938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.575290 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Added segment 00713b17-fbf3-4018-9325-7c2723831b85 of type vlan for network 279a33b1-3790-4c91-b98a-0bfd3c3e6cd3 Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:13.581380 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:13.594398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-47c63b43-8675-4d09-89fc-3039ef4da2c1 None None] Provisioning complete for port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:13.594776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-47c63b43-8675-4d09-89fc-3039ef4da2c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.613423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] For port dc8e8e80-622e-49dd-90bc-8b8f9549e031, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:13.637651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.671730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] Deleting port 1892b3ea-a5fc-41fd-a458-b9714c5a708d {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:13.671730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.686776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.687744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:13.688324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.697857 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-9c483903-28a2-47ce-9b65-e4ce0a524b59 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.698365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9c483903-28a2-47ce-9b65-e4ce0a524b59 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.703118 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9c483903-28a2-47ce-9b65-e4ce0a524b59 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/291d6211-bfb7-45e5-a876-477d327b329f HTTP/1.1" status: 404 len: 337 time: 0.1638627 Nov 24 04:12:13.711199 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.8378718 Nov 24 04:12:13.713685 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60752) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.714016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60754) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.734627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-655074813', 'admin_state_up': True, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:13.801549 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.6125164 Nov 24 04:12:13.810765 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-f86f6e93-2f50-4d64-939c-c91831eb9aa8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.811356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f86f6e93-2f50-4d64-939c-c91831eb9aa8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.814388 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f86f6e93-2f50-4d64-939c-c91831eb9aa8 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/b43d342a-1cf7-46b7-88cd-1ddf7d6ccd31 HTTP/1.1" status: 404 len: 333 time: 0.0983844 Nov 24 04:12:13.815088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60760) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.829525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.db.api [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:12:13.829525 dv-neutron-819049-1-hyperv neutron-server[103381]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:12:13.829525 dv-neutron-819049-1-hyperv neutron-server[103381]: [parameters: {'id': '31a4b687-b268-49e1-9f85-a530cacdb9fa'}] Nov 24 04:12:13.829525 dv-neutron-819049-1-hyperv neutron-server[103381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103381) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:13.829969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG oslo_db.api [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:13.830269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60762) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.832893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Request body: {'network': {'project_id': '9152ba16476a4f0baab8b13f27f9135e'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:13.885578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] For port dc8e8e80-622e-49dd-90bc-8b8f9549e031, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=dc8e8e80-622e-49dd-90bc-8b8f9549e031,segment=NetworkSegment(c7b14d5b-ae50-4842-a029-c77fcd474051),segment_id=c7b14d5b-ae50-4842-a029-c77fcd474051)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:13.885793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5241129b-5b31-4a1f-82f6-71bcbf9ad6ec tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Pushing event updated for resources: {'Network': ['ID=279a33b1-3790-4c91-b98a-0bfd3c3e6cd3,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.905827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.906948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.926475 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-e0d3ae70-d33e-4bd8-83f0-ece427fafb0a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.926939 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e0d3ae70-d33e-4bd8-83f0-ece427fafb0a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:13.927056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.933669 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e0d3ae70-d33e-4bd8-83f0-ece427fafb0a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/eb0bc524-c90e-4c1c-a020-88bfe7695242 HTTP/1.1" status: 404 len: 337 time: 0.0391779 Nov 24 04:12:13.934828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60766) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:13.951833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac88bcd1-b820-4760-a0d9-5f88b6a82e1c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=becef48c-b834-483b-91dc-0f71ec58e834,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:13.970287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 279a33b1-3790-4c91-b98a-0bfd3c3e6cd3 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:13.971697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Made reservation on behalf of 9152ba16476a4f0baab8b13f27f9135e for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:13.971931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network becef48c-b834-483b-91dc-0f71ec58e834 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:13.974458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:13.985531 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e78d033-033b-44b9-b03f-a3b5f13e3ab2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:13.986808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9e78d033-033b-44b9-b03f-a3b5f13e3ab2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.000964 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9e78d033-033b-44b9-b03f-a3b5f13e3ab2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/d4731a66-223d-4e63-aacd-9aa0eecccf6d HTTP/1.1" status: 404 len: 333 time: 0.0602872 Nov 24 04:12:14.004064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60770) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.017210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.033719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] vlan segment allocate from pool success with {'vlan_id': 160, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:14.124434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.125115 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Added segment dd89ca1d-a4f9-49be-9eff-a188be98e76f of type vlan for network 570231dc-f8be-448c-b6a6-0afeb14f65d9 Nov 24 04:12:14.161743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-e01ec228-dded-4aaf-b891-a6263c192698 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.162256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e01ec228-dded-4aaf-b891-a6263c192698 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.169112 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e01ec228-dded-4aaf-b891-a6263c192698 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/f2940f3b-e03c-4e0b-80ee-f2f95573bc53 HTTP/1.1" status: 404 len: 337 time: 0.0887837 Nov 24 04:12:14.170943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60774) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.187214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.210671 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-afb81555-3320-4502-86d9-e8a6fc29a57b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.211241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-afb81555-3320-4502-86d9-e8a6fc29a57b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.217211 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-afb81555-3320-4502-86d9-e8a6fc29a57b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/bce97896-4b07-4386-9b72-55fb8a8643c6 HTTP/1.1" status: 404 len: 333 time: 0.0430503 Nov 24 04:12:14.218727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60776) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.288907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.294728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] For port 1892b3ea-a5fc-41fd-a458-b9714c5a708d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1892b3ea-a5fc-41fd-a458-b9714c5a708d,segment=NetworkSegment(d051869f-c3c0-4ecf-a145-43173c8bbee4),segment_id=d051869f-c3c0-4ecf-a145-43173c8bbee4)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:14.295391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.298245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.318076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.326170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.327412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:14.328064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.359739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] Calling delete_port for 1892b3ea-a5fc-41fd-a458-b9714c5a708d owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:14.370604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.374269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Pushing event updated for resources: {'Port': ['ID=dc8e8e80-622e-49dd-90bc-8b8f9549e031,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:14.386416 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.5583463 Nov 24 04:12:14.388274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-47c63b43-8675-4d09-89fc-3039ef4da2c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.414212 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-90249230-7e0f-412b-9ad3-73aac59e62a2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.414686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-90249230-7e0f-412b-9ad3-73aac59e62a2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.420026 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-90249230-7e0f-412b-9ad3-73aac59e62a2 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/01827815-09a0-4019-9607-6c2d6fa1680e HTTP/1.1" status: 404 len: 337 time: 0.1977417 Nov 24 04:12:14.420026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60780) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.421420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60782) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.436015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7602909-b200-4938-979c-3eebe1313333 None None] Network 31a4b687-b268-49e1-9f85-a530cacdb9fa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:14.452806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.453066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fa604d8c-4a40-4895-a5f4-eed6fe7e849a tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Request body: {'network': {'project_id': '9152ba16476a4f0baab8b13f27f9135e'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:14.453188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.453493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.453836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.454189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.454552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.454894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.455310 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.455635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.456015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.456343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.456732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3439c16f-ada7-4959-b70e-6313325cbcf8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:14.485145 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-3963614d-c98d-4475-869e-2c8a2220c6f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.485731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3963614d-c98d-4475-869e-2c8a2220c6f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.489327 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3963614d-c98d-4475-869e-2c8a2220c6f6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/070202f2-67a0-4a47-a21b-4347303667e4 HTTP/1.1" status: 404 len: 333 time: 0.0667927 Nov 24 04:12:14.493979 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60786) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.504764 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-bfb31842-b19b-4567-8e79-11d158d17b4d', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:14.505754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.536676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 984231f8-e4fb-4b65-892f-c5e8bc34ada8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=984231f8-e4fb-4b65-892f-c5e8bc34ada8,segment=NetworkSegment(b0ab0804-7f9b-4c31-bf12-1c25c5735467),segment_id=b0ab0804-7f9b-4c31-bf12-1c25c5735467)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:14.554052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.571144 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-94e76b27-2d4b-4804-90f0-c75faeaac43b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.571659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-94e76b27-2d4b-4804-90f0-c75faeaac43b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.576966 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-94e76b27-2d4b-4804-90f0-c75faeaac43b tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/41066cd7-91c3-4db6-a76a-fa226cc6234f HTTP/1.1" status: 404 len: 337 time: 0.0785980 Nov 24 04:12:14.582461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60790) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.586239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12a53c0-5f62-4ef2-a9d0-2b95b67eaf35 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Pushing event updated for resources: {'Network': ['ID=570231dc-f8be-448c-b6a6-0afeb14f65d9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:14.600675 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-fa604d8c-4a40-4895-a5f4-eed6fe7e849a tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 24 04:12:14.601139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fa604d8c-4a40-4895-a5f4-eed6fe7e849a tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.606205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fa604d8c-4a40-4895-a5f4-eed6fe7e849a tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.1682787 Nov 24 04:12:14.606702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60792) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.608134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting port dc8e8e80-622e-49dd-90bc-8b8f9549e031 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:14.608472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.641618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 570231dc-f8be-448c-b6a6-0afeb14f65d9 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:14.644792 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-e916617c-dc5f-43fb-add9-91706e968ec9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.646166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e916617c-dc5f-43fb-add9-91706e968ec9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.654495 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e916617c-dc5f-43fb-add9-91706e968ec9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/7b1a5734-63c2-45fa-878c-126e0b1f949a HTTP/1.1" status: 404 len: 333 time: 0.0698211 Nov 24 04:12:14.656230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60796) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.754165 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-dbbaf3d5-f488-4eb8-a4b7-c438fb72bbdc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.754895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dbbaf3d5-f488-4eb8-a4b7-c438fb72bbdc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.762664 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dbbaf3d5-f488-4eb8-a4b7-c438fb72bbdc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/8a67f037-eaa1-480a-bb39-a99413aa923b HTTP/1.1" status: 404 len: 337 time: 0.1043303 Nov 24 04:12:14.763283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60798) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.771029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] For port dc8e8e80-622e-49dd-90bc-8b8f9549e031, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=dc8e8e80-622e-49dd-90bc-8b8f9549e031,segment=NetworkSegment(c7b14d5b-ae50-4842-a029-c77fcd474051),segment_id=c7b14d5b-ae50-4842-a029-c77fcd474051)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:14.771396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.783573 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2c720bbe-d575-4d6e-a988-bc5d2e220b84 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=9152ba16476a4f0baab8b13f27f9135e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1729019 Nov 24 04:12:14.787767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60802) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.798763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Calling delete_port for dc8e8e80-622e-49dd-90bc-8b8f9549e031 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:14.811755 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d653e04c-d954-497e-99be-5c5a718db240 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.812998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d653e04c-d954-497e-99be-5c5a718db240 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.817049 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d653e04c-d954-497e-99be-5c5a718db240 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/9c6e6da7-1d8c-4195-b3fe-83568a4e170f HTTP/1.1" status: 404 len: 333 time: 0.0497303 Nov 24 04:12:14.820162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60804) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.820288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.20.0.1 (bfb31842-b19b-4567-8e79-11d158d17b4d/2fd90e2e-d7be-46b0-b347-1ae9291266ea/6368baaf-36f9-4a6f-9950-2cd5c1f3d14e) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:14.866051 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a84c29d-038e-4dfd-af36-00672dcba088 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.866724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0a84c29d-038e-4dfd-af36-00672dcba088 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.870351 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0a84c29d-038e-4dfd-af36-00672dcba088 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/bd40dcd2-bd79-4919-806d-c505504e9783 HTTP/1.1" status: 404 len: 337 time: 0.0487251 Nov 24 04:12:14.872901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60808) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.876391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-47c63b43-8675-4d09-89fc-3039ef4da2c1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:14.876875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-47c63b43-8675-4d09-89fc-3039ef4da2c1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:14.913545 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2c90115-605e-4c18-9fd7-698ec7582231 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.914537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d2c90115-605e-4c18-9fd7-698ec7582231 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.914708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=984231f8-e4fb-4b65-892f-c5e8bc34ada8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:14.933011 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d2c90115-605e-4c18-9fd7-698ec7582231 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/50c2f613-f46e-4578-ba41-577ee0fbb7c0 HTTP/1.1" status: 404 len: 337 time: 0.0555708 Nov 24 04:12:14.933166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60810) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:14.939344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:14.965437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] No DVR routers for this DVR port 1892b3ea-a5fc-41fd-a458-b9714c5a708d on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:14.973593 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-188637a5-a18b-48bf-9888-347f425bacfc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:14.974178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-188637a5-a18b-48bf-9888-347f425bacfc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:14.979940 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-188637a5-a18b-48bf-9888-347f425bacfc tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/6fcdd7cf-a7cc-4996-a2a2-09000d520674 HTTP/1.1" status: 404 len: 333 time: 0.0381327 Nov 24 04:12:14.989938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60812) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.016150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1892b3ea-a5fc-41fd-a458-b9714c5a708d no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:15.039539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cfbb4d4-ec48-4f4a-ae8b-8f86d369c137 None None] Pushing event deleted for resources: {'Port': ['ID=1892b3ea-a5fc-41fd-a458-b9714c5a708d,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:15.047187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 1892b3ea-a5fc-41fd-a458-b9714c5a708d {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:15.047600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1892b3ea-a5fc-41fd-a458-b9714c5a708d not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:15.052014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60814) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.065299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b88dd25c-92f9-497f-9717-94b0289b4ef1 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.076959 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f35d0f7-dd61-45e3-b196-800fd87691db tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.077413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0f35d0f7-dd61-45e3-b196-800fd87691db tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.082775 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0f35d0f7-dd61-45e3-b196-800fd87691db tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/cebdfc86-f93f-4bfd-9dfa-9ec76cf3116c HTTP/1.1" status: 404 len: 337 time: 0.0889192 Nov 24 04:12:15.085395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60818) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.093000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.120988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b88dd25c-92f9-497f-9717-94b0289b4ef1 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.128035 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-1f15273b-cfc3-4bb5-8710-ae2a49b5f463 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.128505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1f15273b-cfc3-4bb5-8710-ae2a49b5f463 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.134025 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1f15273b-cfc3-4bb5-8710-ae2a49b5f463 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ccfbaa0d-a530-44e7-9dc8-6518b7c60224 HTTP/1.1" status: 404 len: 337 time: 0.0452993 Nov 24 04:12:15.134761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60820) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.137742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.142764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.172081 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-bc7e0c54-5c10-4cb6-a886-4dadb66b60ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.172644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bc7e0c54-5c10-4cb6-a886-4dadb66b60ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.178585 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bc7e0c54-5c10-4cb6-a886-4dadb66b60ae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/1ae068be-93bf-42f1-8697-36c677b3f994 HTTP/1.1" status: 404 len: 333 time: 0.0399461 Nov 24 04:12:15.178926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60822) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.194616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Port': ['ID=dc8e8e80-622e-49dd-90bc-8b8f9549e031,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:15.199784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.204863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No DVR routers for this DVR port dc8e8e80-622e-49dd-90bc-8b8f9549e031 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:15.229163 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8141134-f7cc-4b13-b160-038b68e139d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.229548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b8141134-f7cc-4b13-b160-038b68e139d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.233038 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b8141134-f7cc-4b13-b160-038b68e139d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/641ca6d1-3b91-405b-9c75-da69801a406c HTTP/1.1" status: 404 len: 337 time: 0.0531518 Nov 24 04:12:15.236060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60824) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.241472 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-1385107755', 'router:external': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:15.280330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Made reservation on behalf of e9d040c743724e29897c8fd842f0d888 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:15.282651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.294787 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-262b71cb-e7b8-4a11-8975-3139856af0a5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.295286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-262b71cb-e7b8-4a11-8975-3139856af0a5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.298284 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-262b71cb-e7b8-4a11-8975-3139856af0a5 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/dcb31614-0f41-463c-be02-aaf883b8ca54 HTTP/1.1" status: 404 len: 337 time: 0.0514286 Nov 24 04:12:15.301437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60826) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.316706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.338002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.340329 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b88dd25c-92f9-497f-9717-94b0289b4ef1 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.342829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b88dd25c-92f9-497f-9717-94b0289b4ef1 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.343951 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b88dd25c-92f9-497f-9717-94b0289b4ef1 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "DELETE /v2.0/security-groups/c68ace57-8015-4b8a-97de-52057764c5c7 HTTP/1.1" status: 204 len: 168 time: 0.5527692 Nov 24 04:12:15.349749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60828) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.350717 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a10a762-72cb-4608-b324-e85ef0a622d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.351277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4a10a762-72cb-4608-b324-e85ef0a622d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.354251 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4a10a762-72cb-4608-b324-e85ef0a622d9 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/0e11df9b-d4c4-45dc-a6bb-0f2d9a2e9f31 HTTP/1.1" status: 404 len: 333 time: 0.0464630 Nov 24 04:12:15.363651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60830) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.377730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88dd25c-92f9-497f-9717-94b0289b4ef1 tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c68ace57-8015-4b8a-97de-52057764c5c7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:15.385774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['31a4b687-b268-49e1-9f85-a530cacdb9fa']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:15.409608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.70 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/c28b89a3-39b5-4dd6-a2c6-fa8640fa8153) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:15.416038 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-5bc7916c-c76f-4d8a-a88f-a42108604c73 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.416503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5bc7916c-c76f-4d8a-a88f-a42108604c73 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.422339 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5bc7916c-c76f-4d8a-a88f-a42108604c73 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/8a4ffb10-1a31-4ecd-9b76-1baf8ea21076 HTTP/1.1" status: 404 len: 337 time: 0.0550354 Nov 24 04:12:15.422590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60832) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.432643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c7b14d5b-ae50-4842-a029-c77fcd474051') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:15.432974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c7b14d5b-ae50-4842-a029-c77fcd474051') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:15.434972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.472948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.482176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Allocated IP 172.20.0.2 (bfb31842-b19b-4567-8e79-11d158d17b4d/2fd90e2e-d7be-46b0-b347-1ae9291266ea/068a0968-802e-4184-aeb6-5b45930e0ffe) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:15.493125 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-512da290-3010-40d0-a114-9180778c6c29 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:15.493588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-512da290-3010-40d0-a114-9180778c6c29 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:15.499457 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-512da290-3010-40d0-a114-9180778c6c29 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/b355b0b6-1ebf-44f5-8f8d-b8f601b9a48d HTTP/1.1" status: 404 len: 337 time: 0.0731819 Nov 24 04:12:15.500851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.502761 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60834) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.549839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network bfb31842-b19b-4567-8e79-11d158d17b4d is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:15.555719 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-75c68358-c58f-4e7a-92f2-d3dcf7477b66 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports?device_id=a5d44d1f-24d1-41c1-b30b-40c7e92ea3da HTTP/1.1" status: 200 len: 205 time: 0.0500829 Nov 24 04:12:15.559661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.562000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:15.564440 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:15.570282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60836) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:15.597920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:15.604652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 188 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:15.604978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:15.608131 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:15.612550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5cc71a9a-79a4-4d9f-898e-6ce033e65a5d None None] Provisioning complete for port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:15.613578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5cc71a9a-79a4-4d9f-898e-6ce033e65a5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.659465 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.663524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.684759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.703106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.721540 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['570231dc-f8be-448c-b6a6-0afeb14f65d9']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:15.726442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.730070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.738770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] vlan segment allocate from pool success with {'vlan_id': 189, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:15.754476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dd89ca1d-a4f9-49be-9eff-a188be98e76f') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:15.755133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dd89ca1d-a4f9-49be-9eff-a188be98e76f') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:15.788289 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.788843 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Added segment b52f53bc-a832-4e38-97d0-fd8cd45904f7 of type vlan for network 5531718d-5fcd-40c6-82d4-49a2e693f755 Nov 24 04:12:15.790491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=685e132c-5a61-4d70-b831-65ee5534aaf5,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:15.792380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Network bfb31842-b19b-4567-8e79-11d158d17b4d is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:15.793534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Pushing event updated for resources: {'Port': ['ID=068a0968-802e-4184-aeb6-5b45930e0ffe,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:15.795638 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.797031 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:15.799368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:15.850844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.861242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Attempting to bind port 068a0968-802e-4184-aeb6-5b45930e0ffe on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:15.861612 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Attempting to bind port 068a0968-802e-4184-aeb6-5b45930e0ffe by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:15.862213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Attempting to bind port 068a0968-802e-4184-aeb6-5b45930e0ffe on network bfb31842-b19b-4567-8e79-11d158d17b4d {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:15.869032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:15.869827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Checking segment: {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:15.870424 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.870824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Bound using segment: {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:15.871898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Bound port: 068a0968-802e-4184-aeb6-5b45930e0ffe, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:15.872303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.872432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Releasing vlan 160 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:15.872708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:15.874655 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:15.891718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.904977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.943429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] For port 068a0968-802e-4184-aeb6-5b45930e0ffe, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:15.947243 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] For port 068a0968-802e-4184-aeb6-5b45930e0ffe, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=068a0968-802e-4184-aeb6-5b45930e0ffe,segment=NetworkSegment(6bcc484d-8451-4326-bc3a-c89847342164),segment_id=6bcc484d-8451-4326-bc3a-c89847342164)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:15.957538 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:15.997178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.000607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.001068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.001458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.001873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.002207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.002996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.003345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.004171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.005926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.006472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.006877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.007244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:16.009440 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:16.012330 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-8a26b502-d311-4375-a90e-24538ea6a4c3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] delete failed (client error): The resource could not be found. Nov 24 04:12:16.014205 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8a26b502-d311-4375-a90e-24538ea6a4c3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/routers/a5d44d1f-24d1-41c1-b30b-40c7e92ea3da HTTP/1.1" status: 404 len: 336 time: 0.4427862 Nov 24 04:12:16.018629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.025050 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "DELETE /v2.0/networks/570231dc-f8be-448c-b6a6-0afeb14f65d9 HTTP/1.1" status: 204 len: 168 time: 0.6665599 Nov 24 04:12:16.025345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60838) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.026193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60840) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.045884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b61d7610-1358-41a2-8944-baa729bd217c None None] Pushing event updated for resources: {'Port': ['ID=068a0968-802e-4184-aeb6-5b45930e0ffe,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:16.069984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:16.073477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.076390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:16.078130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:16.091238 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f564be79-31ac-460c-9e1b-c0ab097a0b6a None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:16.104866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.105812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:16.106440 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.108633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a65d24fb-d878-463e-9f89-6bf84953e26c tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Pushing event deleted for resources: {'Network': ['ID=570231dc-f8be-448c-b6a6-0afeb14f65d9,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:16.126422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.130645 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.137638 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/31a4b687-b268-49e1-9f85-a530cacdb9fa HTTP/1.1" status: 204 len: 168 time: 3.9983020 Nov 24 04:12:16.156909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60842) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.165191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1997500312'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:16.172712 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-82ca567a-1176-4359-9936-a389f50a83cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.173180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-82ca567a-1176-4359-9936-a389f50a83cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.178758 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-82ca567a-1176-4359-9936-a389f50a83cd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ffd5ae43-00b3-45a7-8d66-aaec11c4be13 HTTP/1.1" status: 404 len: 337 time: 0.1470034 Nov 24 04:12:16.184089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60844) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.198702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd510e84-673e-480e-9a25-abbae11c1aa1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=31a4b687-b268-49e1-9f85-a530cacdb9fa,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:16.230303 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.242309 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c80fafe2-5bf5-42c6-8601-edbb4865c95f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "GET /v2.0/ports?device_id=3e582de3-12d1-4bc4-a1af-369538214a02 HTTP/1.1" status: 200 len: 205 time: 0.0548477 Nov 24 04:12:16.247239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60846) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.269568 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4ad0c7d9-ca29-426a-ad02-8da62ebdb365 None None] Provisioning complete for port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:16.269944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4ad0c7d9-ca29-426a-ad02-8da62ebdb365 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.310851 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-32e2bf33-bea8-4c81-bd58-6321f01c2038 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] delete failed (client error): The resource could not be found. Nov 24 04:12:16.311647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4ad0c7d9-ca29-426a-ad02-8da62ebdb365 None None] Port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:16.312664 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-32e2bf33-bea8-4c81-bd58-6321f01c2038 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/routers/3e582de3-12d1-4bc4-a1af-369538214a02 HTTP/1.1" status: 404 len: 336 time: 0.0609057 Nov 24 04:12:16.315362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60848) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.344867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:16.348588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.373540 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-6f108f3d-8085-4cff-973a-086b8cba5bae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.374014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6f108f3d-8085-4cff-973a-086b8cba5bae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.377107 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6f108f3d-8085-4cff-973a-086b8cba5bae tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/2100e375-5f8f-4a0b-af60-5361c23739fd HTTP/1.1" status: 404 len: 337 time: 0.0603955 Nov 24 04:12:16.387483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60850) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.420868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.425396 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-eac187c5-1799-49da-8cca-abb6dfc11234 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.425850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eac187c5-1799-49da-8cca-abb6dfc11234 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.431257 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eac187c5-1799-49da-8cca-abb6dfc11234 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/20d6a246-7b1f-4b75-b499-168177411685 HTTP/1.1" status: 404 len: 337 time: 0.0405159 Nov 24 04:12:16.437557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60852) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.458632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:16.480748 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-96c2bbc5-8945-408c-8166-d8a68b6ef6d1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.481324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-96c2bbc5-8945-408c-8166-d8a68b6ef6d1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.484425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-96c2bbc5-8945-408c-8166-d8a68b6ef6d1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/bc4b029e-005d-4daa-a79d-f8abe6be3931 HTTP/1.1" status: 404 len: 333 time: 0.0458305 Nov 24 04:12:16.505753 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60854) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.518236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.518578 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 071a8e76-29de-4fa6-8096-f6fba9d8ed67 of type vlan for network 15b914c6-fff3-4369-84a1-492a5ab5f7fe Nov 24 04:12:16.548148 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Network': ['ID=5531718d-5fcd-40c6-82d4-49a2e693f755,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:16.552163 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb829ae6-a0d2-421c-a493-8e09c756d8a1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.552619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb829ae6-a0d2-421c-a493-8e09c756d8a1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.555078 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9e79346d-ab63-45d8-b316-f76bd4c0008d tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 1.5019207 Nov 24 04:12:16.559889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fb829ae6-a0d2-421c-a493-8e09c756d8a1 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/82492f48-3952-4ecb-baca-5397eaa51eb6 HTTP/1.1" status: 404 len: 337 time: 0.0493264 Nov 24 04:12:16.562523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 5531718d-5fcd-40c6-82d4-49a2e693f755 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:16.578853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60856) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.579178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60858) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.585619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'subnet': {'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:16.690929 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-24d0794d-cc9b-4d11-acdb-65f831499b8c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.691479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-24d0794d-cc9b-4d11-acdb-65f831499b8c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.695186 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-24d0794d-cc9b-4d11-acdb-65f831499b8c tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/f5fbb2af-1b51-4f92-bf9b-e85189a935a3 HTTP/1.1" status: 404 len: 333 time: 0.1137409 Nov 24 04:12:16.700868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.707186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60860) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.721795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.750508 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-d9f420fb-2f5b-4d4b-9b38-ed28f6af2f16 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.750967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d9f420fb-2f5b-4d4b-9b38-ed28f6af2f16 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.753937 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d9f420fb-2f5b-4d4b-9b38-ed28f6af2f16 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/99e8a855-2923-4474-9465-b5f9427a8d4d HTTP/1.1" status: 404 len: 337 time: 0.0458021 Nov 24 04:12:16.761568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60862) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.764869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Made reservation on behalf of e9d040c743724e29897c8fd842f0d888 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:16.767137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.781355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['279a33b1-3790-4c91-b98a-0bfd3c3e6cd3']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:16.797274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00713b17-fbf3-4018-9325-7c2723831b85') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:16.797574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00713b17-fbf3-4018-9325-7c2723831b85') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:16.824675 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-f5d91b23-d79b-4863-9dc3-55e824dd2913 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.825264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f5d91b23-d79b-4863-9dc3-55e824dd2913 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.828358 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f5d91b23-d79b-4863-9dc3-55e824dd2913 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/40a6be7b-eb7b-43d0-a05a-5cb1d2dc8521 HTTP/1.1" status: 404 len: 333 time: 0.0643635 Nov 24 04:12:16.834999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60864) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.836934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.843353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.848919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:16.849544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.883836 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-6a58570b-d15a-4d66-b791-2427b9b9167d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.884314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6a58570b-d15a-4d66-b791-2427b9b9167d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.887620 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6a58570b-d15a-4d66-b791-2427b9b9167d tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/41e43747-a1ce-4657-bc29-b195db1f42a3 HTTP/1.1" status: 404 len: 337 time: 0.0485854 Nov 24 04:12:16.893696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60866) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.898677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.942953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Releasing vlan 151 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:16.943579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:16.945928 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca575eb4-8a48-47df-8fdc-ec9038d017d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:16.946822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ca575eb4-8a48-47df-8fdc-ec9038d017d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:16.950605 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ca575eb4-8a48-47df-8fdc-ec9038d017d3 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/fb1d0dc5-8998-4696-88ee-137f1fc79b6d HTTP/1.1" status: 404 len: 333 time: 0.0538146 Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:16.951712 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:16.956452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60868) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.985695 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.8252547 Nov 24 04:12:16.989707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60870) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:16.994447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.000442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': '15b914c6-fff3-4369-84a1-492a5ab5f7fe', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:17.061774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27786e38-db31-4d73-aea3-8671084def24 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=15b914c6-fff3-4369-84a1-492a5ab5f7fe,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:17.073436 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-69862197-ba5c-4a35-b1f7-d250811812bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.075020 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-69862197-ba5c-4a35-b1f7-d250811812bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.078317 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-69862197-ba5c-4a35-b1f7-d250811812bd tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/73ae8a6d-17d2-4316-adf9-8d55606b46cd HTTP/1.1" status: 404 len: 337 time: 0.1109698 Nov 24 04:12:17.083419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60872) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.092076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 15b914c6-fff3-4369-84a1-492a5ab5f7fe details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:17.133873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.138613 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-3ccf52a7-2882-4cae-94b6-9ecee29f5a69 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.139247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3ccf52a7-2882-4cae-94b6-9ecee29f5a69 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.150745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.151196 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3ccf52a7-2882-4cae-94b6-9ecee29f5a69 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/1ed2eb12-2b94-4c06-bba4-5eab6337ce53 HTTP/1.1" status: 404 len: 333 time: 0.0659814 Nov 24 04:12:17.154187 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] 10.222.0.48 "DELETE /v2.0/networks/279a33b1-3790-4c91-b98a-0bfd3c3e6cd3 HTTP/1.1" status: 204 len: 168 time: 1.1237245 Nov 24 04:12:17.156424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60874) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.181375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.194639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.253681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34219f4a-6e4e-4c39-b11f-99786648705e tempest-QuotasNegativeTest-1791828125 tempest-QuotasNegativeTest-1791828125-project-admin] Pushing event deleted for resources: {'Network': ['ID=279a33b1-3790-4c91-b98a-0bfd3c3e6cd3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:17.292558 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-3e6de3ea-9791-4574-aa92-40e680e10f94 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.292896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3e6de3ea-9791-4574-aa92-40e680e10f94 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.297601 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3e6de3ea-9791-4574-aa92-40e680e10f94 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/6f314de2-454e-4f08-bee4-baf05f5a736b HTTP/1.1" status: 404 len: 337 time: 0.1123664 Nov 24 04:12:17.299463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60878) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.333118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:17.337702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.380537 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-5300798d-589f-475f-9508-3b9e13ccfe0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.381681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5300798d-589f-475f-9508-3b9e13ccfe0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.386666 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5300798d-589f-475f-9508-3b9e13ccfe0f tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/2d1223b5-a664-49ff-a1ca-75e4bc515541 HTTP/1.1" status: 404 len: 333 time: 0.0804253 Nov 24 04:12:17.387579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.388899 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60880) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.391879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:17.395868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 984231f8-e4fb-4b65-892f-c5e8bc34ada8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:17.513381 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-2ca21825-9658-4c76-8ad5-49841ce70c82 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.513908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2ca21825-9658-4c76-8ad5-49841ce70c82 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.516997 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2ca21825-9658-4c76-8ad5-49841ce70c82 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/5bb4c713-c27b-470a-888a-694f63a7aaab HTTP/1.1" status: 404 len: 337 time: 0.1231668 Nov 24 04:12:17.524439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60882) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.571089 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-589c85a9-0856-4261-80d8-79f4694a35c6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.571880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-589c85a9-0856-4261-80d8-79f4694a35c6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.575110 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-589c85a9-0856-4261-80d8-79f4694a35c6 tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/ports/aede96d2-5d6c-45b5-8c19-5d520ff7835c HTTP/1.1" status: 404 len: 333 time: 0.0494220 Nov 24 04:12:17.583078 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60886) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.601420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Performing IP validity checks on allocation pools {{(pid=103380) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:12:17.602083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103380) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:12:17.625611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.645047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network bfb31842-b19b-4567-8e79-11d158d17b4d is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:17.648047 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-b04fd7cb-deb4-4999-9132-6161c200100a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:17.648507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b04fd7cb-deb4-4999-9132-6161c200100a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:17.651577 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b04fd7cb-deb4-4999-9132-6161c200100a tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/subnets/ba411cff-abfe-421c-93a3-cc27adcca313 HTTP/1.1" status: 404 len: 337 time: 0.0673249 Nov 24 04:12:17.673853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60888) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:17.680413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a9ae1af-d163-4b99-8ee0-5a979af0b5e4 None None] Network bfb31842-b19b-4567-8e79-11d158d17b4d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:17.683328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:17.779412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1ad2b89e-6a1a-4aef-aeb1-12437829512e None None] Provisioning complete for port 068a0968-802e-4184-aeb6-5b45930e0ffe triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:17.780180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1ad2b89e-6a1a-4aef-aeb1-12437829512e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.839973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:17.840711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.841766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.objects.ports [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103381) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 04:12:17.842259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.855063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:17.906302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Subnet': ['ID=beae5781-a64e-41fd-a2bc-7b1098a9c7df,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:17.917079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:17.931955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Checking segment: {'id': 'b52f53bc-a832-4e38-97d0-fd8cd45904f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:17.932323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network hostable DHCP agents. Network: 5531718d-5fcd-40c6-82d4-49a2e693f755, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:18.015107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1ad2b89e-6a1a-4aef-aeb1-12437829512e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.025447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network 5531718d-5fcd-40c6-82d4-49a2e693f755 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:18.032812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.038689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.039847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:18.046140 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0a7d1460-2e1b-4b5b-b2cb-6a32839b5a9b tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5084240 Nov 24 04:12:18.047478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 5531718d-5fcd-40c6-82d4-49a2e693f755) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:18.049157 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60892) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:18.052583 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:18.056462 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-1884531645'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:18.064844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:18.064844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.067278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60894) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:18.070883 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:18.071623 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:18.104012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:18.106583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-430a7afc-2406-4822-9b6a-f9b313860801 None None] Network 5531718d-5fcd-40c6-82d4-49a2e693f755 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:18.111718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.130024 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a3af92b-5445-4e63-bf97-204b85aee856 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 1.5473788 Nov 24 04:12:18.137047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60898) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:18.146634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a2b36c78-43a6-4954-8102-cb5638999bb1']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:18.162756 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-288553517', 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:18.169947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 155, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:18.181052 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:18.182938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd051869f-c3c0-4ecf-a145-43173c8bbee4') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:18.183237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd051869f-c3c0-4ecf-a145-43173c8bbee4') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:18.200076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.200411 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment 8e83a68c-90ac-4187-a0fb-888745040938 of type vlan for network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 Nov 24 04:12:18.217200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.223490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=c08f999d-55a2-4bec-9742-1bd26d19ac3f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:18.227064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:18.255191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1ad2b89e-6a1a-4aef-aeb1-12437829512e None None] For port 068a0968-802e-4184-aeb6-5b45930e0ffe, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=068a0968-802e-4184-aeb6-5b45930e0ffe,segment=NetworkSegment(6bcc484d-8451-4326-bc3a-c89847342164),segment_id=6bcc484d-8451-4326-bc3a-c89847342164)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:18.258941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.268113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '071a8e76-29de-4fa6-8096-f6fba9d8ed67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '15b914c6-fff3-4369-84a1-492a5ab5f7fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:18.268516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: 15b914c6-fff3-4369-84a1-492a5ab5f7fe, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:18.283141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6c60d77-8fb3-44d6-baec-d8f442c2e211 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.286186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.311276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Releasing vlan 185 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:18.311682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.314886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Made reservation on behalf of e9d040c743724e29897c8fd842f0d888 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:18.317477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:18.320597 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:18.360882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 068a0968-802e-4184-aeb6-5b45930e0ffe up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:18.372814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6c60d77-8fb3-44d6-baec-d8f442c2e211 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.381991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6c60d77-8fb3-44d6-baec-d8f442c2e211 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.413716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1ad2b89e-6a1a-4aef-aeb1-12437829512e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.413959 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:18.418308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c60d77-8fb3-44d6-baec-d8f442c2e211 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d14fdbe5-ff64-4cd1-96f2-b9fef38b2759,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:18.429005 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] device_id is not set on port a9028d62-c47f-446f-8ed9-f86a2594f26b yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:18.440886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.446624 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:18.447054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:18.447198 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Updating router af1bca15-198f-4ff7-9729-e777368c7abb port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:18.447661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.461777 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a6c60d77-8fb3-44d6-baec-d8f442c2e211 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=dedbab7b58b04c40bbc9e0d7ec5ba82d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3908851 Nov 24 04:12:18.461978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network 15b914c6-fff3-4369-84a1-492a5ab5f7fe is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:18.468884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60900) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:18.478070 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.491656 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4413092 Nov 24 04:12:18.494661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60902) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:18.502446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:18.522391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:18.539294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-910eab30-2649-4d11-a002-4803633c5e52 None None] Network 5531718d-5fcd-40c6-82d4-49a2e693f755 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:18.548729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:18.573130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6714ff7b-c87b-45a6-b4bc-926870146b3f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=07ee17ec-7e98-4e35-a61a-8469c8c8e6d6,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:18.604034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:18.640133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 068a0968-802e-4184-aeb6-5b45930e0ffe triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:18.640769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.676984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:18.682545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.693408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:18.694071 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Allocated IP 2001:db8::1ec (5531718d-5fcd-40c6-82d4-49a2e693f755/beae5781-a64e-41fd-a2bc-7b1098a9c7df/a9028d62-c47f-446f-8ed9-f86a2594f26b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:18.694925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:18.754198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.787120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.793106 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] 10.222.0.48 "DELETE /v2.0/networks/a2b36c78-43a6-4954-8102-cb5638999bb1 HTTP/1.1" status: 204 len: 168 time: 1.1158712 Nov 24 04:12:18.820742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 15b914c6-fff3-4369-84a1-492a5ab5f7fe) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:18.836165 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad2b89e-6a1a-4aef-aeb1-12437829512e None None] Pushing event updated for resources: {'Port': ['ID=068a0968-802e-4184-aeb6-5b45930e0ffe,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:18.873002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a2f978-f427-4b23-ba14-be3929687daa tempest-NetworksTestDHCPv6-949360997 tempest-NetworksTestDHCPv6-949360997-project] Pushing event deleted for resources: {'Network': ['ID=a2b36c78-43a6-4954-8102-cb5638999bb1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:18.879800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee067cb6-0658-4e3c-bac3-cf1bc69c13bf None None] Network 15b914c6-fff3-4369-84a1-492a5ab5f7fe requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:18.896008 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.912883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:18.912883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.914610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.929251 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:18.929465 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7a9c6911-9ca0-493e-83f5-887799f1eca5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 5.2033453 Nov 24 04:12:18.961920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60906) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:18.972411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.057141 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8985d2d1-a6b2-4f93-8a65-158c778b7f19 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 2.0627322 Nov 24 04:12:19.067011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60910) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:19.074218 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Pushing event updated for resources: {'Port': ['ID=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:19.098058 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.098847 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.099584 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.100808 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.101375 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.102074 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.103100 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.103700 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.104268 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.104831 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.105521 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.106067 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:12:19.128203 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Attempting to bind port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:19.128809 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Attempting to bind port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:19.129501 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Attempting to bind port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e on network bfb31842-b19b-4567-8e79-11d158d17b4d {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:19.136212 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:19.136928 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Checking segment: {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:19.137612 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.138251 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Bound using segment: {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:19.138955 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Bound port: 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6bcc484d-8451-4326-bc3a-c89847342164', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 180, 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:19.139778 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.169897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64a7c9a7-aade-45a8-af71-066cb9dc3fcc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.185712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.200951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:19.201520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:19.220888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64a7c9a7-aade-45a8-af71-066cb9dc3fcc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.230668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=df7589cb-718c-4fcd-ba62-6833177081f9,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:19.235887 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] For port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:19.239778 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] For port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,segment=NetworkSegment(6bcc484d-8451-4326-bc3a-c89847342164),segment_id=6bcc484d-8451-4326-bc3a-c89847342164)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:19.247326 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.307856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64a7c9a7-aade-45a8-af71-066cb9dc3fcc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.310433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-64a7c9a7-aade-45a8-af71-066cb9dc3fcc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.311119 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b687e45-7146-4112-b153-a12da616d7d9 None None] Pushing event updated for resources: {'Port': ['ID=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:19.311615 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-64a7c9a7-aade-45a8-af71-066cb9dc3fcc admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/d14fdbe5-ff64-4cd1-96f2-b9fef38b2759 HTTP/1.1" status: 204 len: 168 time: 0.7972314 Nov 24 04:12:19.340736 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:19.341564 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:19.351808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60916) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:19.353680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.364957 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-81a797a8-411c-4ea1-856a-ec44a09e7c57 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.4000511 Nov 24 04:12:19.372981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60918) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:19.376993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a7c9a7-aade-45a8-af71-066cb9dc3fcc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d14fdbe5-ff64-4cd1-96f2-b9fef38b2759,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:19.429735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.453375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:19.463114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:19.487864 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:19.508325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.546067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:19.596115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:19.597939 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.600340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network 5531718d-5fcd-40c6-82d4-49a2e693f755 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:19.614773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:19.619206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:19.620204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:19.621929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.631845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a8d5a6e-ee5a-4106-8e7a-71a10e15891b None None] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:19.634510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Port': ['ID=a9028d62-c47f-446f-8ed9-f86a2594f26b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:19.638858 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Provisioning complete for port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:19.641322 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.660665 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2ce60461-8149-4479-ab71-4f5aba5dda5a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 1.5166125 Nov 24 04:12:19.662789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60924) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:19.790205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Deleting port a9028d62-c47f-446f-8ed9-f86a2594f26b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:19.790799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.813943 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1ff2904b-72a1-482c-8c80-7ba48f161062 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3176463 Nov 24 04:12:19.824435 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60926) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:19.925754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:19.934458 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:19Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:19.943123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Calling delete_port for a9028d62-c47f-446f-8ed9-f86a2594f26b owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:19.962569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60928) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:19.983504 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f20d62e1-bf66-4e72-ad61-659bbed96874 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:19Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:20.043519 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-306bf078-188c-4a80-8334-223126097654 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=f7a52a1f2e7f4bf2b011e140727dd116&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6809776 Nov 24 04:12:20.055614 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1824ee18-c142-4b59-946e-653742c8e023 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.056606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60930) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:20.069516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.090856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18cd19b9-be41-49bf-b59c-bebe110c3564 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:20.091340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18cd19b9-be41-49bf-b59c-bebe110c3564 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:20.096155 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-18cd19b9-be41-49bf-b59c-bebe110c3564 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 1594 time: 0.6760089 Nov 24 04:12:20.107791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60932) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:20.182394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.205277 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7294bb1-5eab-4a01-8f4d-1ed1a7842e9e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-15b914c6-fff3-4369-84a1-492a5ab5f7fe', 'network_id': '15b914c6-fff3-4369-84a1-492a5ab5f7fe', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': 'c08f999d-55a2-4bec-9742-1bd26d19ac3f'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:20.208783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7294bb1-5eab-4a01-8f4d-1ed1a7842e9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.250165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event deleted for resources: {'Port': ['ID=a9028d62-c47f-446f-8ed9-f86a2594f26b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:20.286244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c90225cc-22c6-4ef9-a349-0c8c89c6c3f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.338721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c90225cc-22c6-4ef9-a349-0c8c89c6c3f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.399570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.405075 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-deb5b52b-3522-435b-8016-51ef1f6babc5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/ports/a9028d62-c47f-446f-8ed9-f86a2594f26b HTTP/1.1" status: 204 len: 168 time: 0.7411180 Nov 24 04:12:20.406321 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60934) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:20.411702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755', 'external_fixed_ips': [{'subnet_id': 'beae5781-a64e-41fd-a2bc-7b1098a9c7df', 'ip_address': '2001:db8::1ec'}]}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:20.416927 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c90225cc-22c6-4ef9-a349-0c8c89c6c3f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.419422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c90225cc-22c6-4ef9-a349-0c8c89c6c3f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.423094 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c90225cc-22c6-4ef9-a349-0c8c89c6c3f7 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/5b918287-71de-411e-af69-affb06edaedd HTTP/1.1" status: 204 len: 168 time: 0.3612521 Nov 24 04:12:20.437721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90225cc-22c6-4ef9-a349-0c8c89c6c3f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b918287-71de-411e-af69-affb06edaedd,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:20.465977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.466982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.470780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 068a0968-802e-4184-aeb6-5b45930e0ffe up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:20.575999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.691812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.766063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=c08f999d-55a2-4bec-9742-1bd26d19ac3f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:20.767189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6d31508-94c1-4f11-99a0-6ab748bf428f None None] Network 15b914c6-fff3-4369-84a1-492a5ab5f7fe requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:20.900075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.901786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] For port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,segment=NetworkSegment(6bcc484d-8451-4326-bc3a-c89847342164),segment_id=6bcc484d-8451-4326-bc3a-c89847342164)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:20.907339 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a03c77d8-44a7-4470-8a7f-9570dc7a4a39 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=5531718d-5fcd-40c6-82d4-49a2e693f755&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.7970986 Nov 24 04:12:20.930829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.951472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:20.952441 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:20.968499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60940) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:21.040805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 068a0968-802e-4184-aeb6-5b45930e0ffe triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:21.041345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.096821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['15b914c6-fff3-4369-84a1-492a5ab5f7fe']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:21.122477 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0ccb3107-c12d-4afb-8793-156fac063fca tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0957246 Nov 24 04:12:21.125526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.128332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60950) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:21.129915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '071a8e76-29de-4fa6-8096-f6fba9d8ed67') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:21.130185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '071a8e76-29de-4fa6-8096-f6fba9d8ed67') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:21.136101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-531250026', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:21.151117 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.183178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Pushing event updated for resources: {'Port': ['ID=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:21.206887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.256997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 199 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:21.257404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:21.260535 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:21.293344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Provisioning complete for port 068a0968-802e-4184-aeb6-5b45930e0ffe triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:21.293987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d6c7adca-7674-49b1-9947-e5b0a9f4fa34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.304436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:21.309346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.312680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:21.316001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1824ee18-c142-4b59-946e-653742c8e023 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.355947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1824ee18-c142-4b59-946e-653742c8e023 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.389556 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1824ee18-c142-4b59-946e-653742c8e023 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=b477e20f3155458b8cd0e0c3cb8f5392&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3752286 Nov 24 04:12:21.440622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60956) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:21.447351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Allocated IP 172.21.0.2 (07ee17ec-7e98-4e35-a61a-8469c8c8e6d6/df7589cb-718c-4fcd-ba62-6833177081f9/e6f2e70e-d679-4812-999e-624b2453311c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:21.455712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:21.456478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Updating router 0fe6e120-10fd-4f02-8be4-2afcf5422729 port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:21.490833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.516032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.522468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.525111 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/15b914c6-fff3-4369-84a1-492a5ab5f7fe HTTP/1.1" status: 204 len: 168 time: 2.4548738 Nov 24 04:12:21.527825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60962) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:21.544501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1824ee18-c142-4b59-946e-653742c8e023 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=368edeee-76d5-4547-b0a9-ee9f66efa086,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:21.557186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d25d0c9-13b7-4f46-a4c2-58cd7d96b3c0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=15b914c6-fff3-4369-84a1-492a5ab5f7fe,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:21.563304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-291360061'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:21.576226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.636464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60964) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:21.643590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.646746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e79c9abd-aaf1-498a-945c-f32891c861e0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.711411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e79c9abd-aaf1-498a-945c-f32891c861e0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.718227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=c4348623-9729-4d15-a5cf-803eac33880a,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:21.729103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:21.733081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.755566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.778545 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.799018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:21.799599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: becef48c-b834-483b-91dc-0f71ec58e834, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:21.848734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e79c9abd-aaf1-498a-945c-f32891c861e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.852062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e79c9abd-aaf1-498a-945c-f32891c861e0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.853260 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e79c9abd-aaf1-498a-945c-f32891c861e0 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/368edeee-76d5-4547-b0a9-ee9f66efa086 HTTP/1.1" status: 204 len: 168 time: 0.4112358 Nov 24 04:12:21.881684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 169, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:21.906586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e79c9abd-aaf1-498a-945c-f32891c861e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=368edeee-76d5-4547-b0a9-ee9f66efa086,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:21.925026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'networks': [{'name': 'tempest-network--1219235802'}, {'name': 'tempest-network--1187633851'}]} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:21.925353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'network': {'name': 'tempest-network--1219235802'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:21.925829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'network': {'name': 'tempest-network--1187633851'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:21.945489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:21.945841 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 6e2229ce-de0f-4cb5-ba7a-0fc3ccd0c1da of type vlan for network bc24d75d-4d89-46bc-8132-50a5f65c93b4 Nov 24 04:12:21.949087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network becef48c-b834-483b-91dc-0f71ec58e834 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:22.024934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, becef48c-b834-483b-91dc-0f71ec58e834) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:22.038413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e2b40cf-2603-40fa-996c-1ff8c26caa6a None None] Network becef48c-b834-483b-91dc-0f71ec58e834 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:22.044932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:22.045511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.060061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.068165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'network': 2} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:22.072795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.086741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.098706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60970) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:22.098937 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-423254c6-c28a-4d08-acb2-fa040931d176 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.9693458 Nov 24 04:12:22.138748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.170896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.179929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:22.180683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.194628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.217801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0c8cfcbe-9057-4eab-a09e-ad65885e2238 None None] Provisioning complete for port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:22.218087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0c8cfcbe-9057-4eab-a09e-ad65885e2238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.279057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.306059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Allocated IP 2001:db8::1ec (5531718d-5fcd-40c6-82d4-49a2e693f755/beae5781-a64e-41fd-a2bc-7b1098a9c7df/b0010827-a2ae-4d05-b947-9926c92a402b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:22.326233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.21.0.1 (07ee17ec-7e98-4e35-a61a-8469c8c8e6d6/df7589cb-718c-4fcd-ba62-6833177081f9/0c9b8909-e5fb-43f0-ac11-1413609fa26f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:22.326429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:22.344801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.345257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.357222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:22.360205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:22.368343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:22.417802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4a6af1d4-2f7e-48c6-8a25-051499b2a123,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:22.452334 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.9207673 Nov 24 04:12:22.466377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Pushing event updated for resources: {'Port': ['ID=e6f2e70e-d679-4812-999e-624b2453311c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:22.490119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60980) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:22.500749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': 'bc24d75d-4d89-46bc-8132-50a5f65c93b4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:22.509125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-becef48c-b834-483b-91dc-0f71ec58e834', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:22.510710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.549845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Attempting to bind port e6f2e70e-d679-4812-999e-624b2453311c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:22.550254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Attempting to bind port e6f2e70e-d679-4812-999e-624b2453311c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:22.550629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Attempting to bind port e6f2e70e-d679-4812-999e-624b2453311c on network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:22.576091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] vlan segment allocate from pool success with {'vlan_id': 192, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:22.580980 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a2d6111-d1b1-4834-ada3-82e9ea65a0ba tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=bc24d75d-4d89-46bc-8132-50a5f65c93b4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:22.588977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:22.589405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Checking segment: {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:22.589950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.590333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Bound using segment: {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:22.590886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Bound port: e6f2e70e-d679-4812-999e-624b2453311c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:22.591262 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.605982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.606374 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Added segment 7ae9dfa5-7b9e-49b3-a7fd-d2479313b919 of type vlan for network 7b795427-dd2f-4f63-84a9-12255a6679b7 Nov 24 04:12:22.618425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network bc24d75d-4d89-46bc-8132-50a5f65c93b4 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:22.619631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.715005 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.718402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.728468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.780062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:22.781373 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:22.785056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.795727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:22.804148 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:22.857716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.879352 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] vlan segment allocate from pool success with {'vlan_id': 160, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:22.900796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.901250 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Added segment 54c80851-ca3d-4149-9dad-62cf44593158 of type vlan for network 0e1521bf-0c39-484d-8e5e-977e19ebde26 Nov 24 04:12:22.913931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:22.930595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=0c9b8909-e5fb-43f0-ac11-1413609fa26f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:22.980543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network 5531718d-5fcd-40c6-82d4-49a2e693f755 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:22.996788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:22.997173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.011051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:23.028307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:23.046426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.115431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.122729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.127583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.130412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] For port e6f2e70e-d679-4812-999e-624b2453311c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:23.138631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] For port e6f2e70e-d679-4812-999e-624b2453311c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e6f2e70e-d679-4812-999e-624b2453311c,segment=NetworkSegment(8e83a68c-90ac-4187-a0fb-888745040938),segment_id=8e83a68c-90ac-4187-a0fb-888745040938)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:23.139644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.148220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Port': ['ID=b0010827-a2ae-4d05-b947-9926c92a402b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.161209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Allocated IP 172.20.0.2 (becef48c-b834-483b-91dc-0f71ec58e834/c4348623-9729-4d15-a5cf-803eac33880a/b3f44c75-b9b3-42e0-bca5-150a8e0c1df8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:23.192548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.246564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 60992) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:23.248780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48aff19e-7f5f-4c7b-a4e2-dfd53b1f79ca None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:23.267454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.276590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Attempting to bind port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:23.276971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Attempting to bind port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:23.277348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Attempting to bind port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:23.279782 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c045e099-e20f-48cd-a7a2-e194b594b766 None None] Pushing event updated for resources: {'Port': ['ID=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.283455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.284087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.290697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.295976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.296790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.342316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:23.342947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:23.342947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.343447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:23.344127 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Bound port: c28b89a3-39b5-4dd6-a2c6-fa8640fa8153, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:23.344283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.371814 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 1.7310104 Nov 24 04:12:23.375815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 60996) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:23.436294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=269f6028-8d5c-4e69-b6b2-0acda3e08476,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.503301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31af24bf-0c4c-4a6e-8d44-d38d8732e89c None None] Pushing event updated for resources: {'Port': ['ID=e6f2e70e-d679-4812-999e-624b2453311c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.531382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-60dc2176-ea1e-4d53-94ae-b3d640636263 None None] Provisioning complete for port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:23.531795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-60dc2176-ea1e-4d53-94ae-b3d640636263 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.572013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] For port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:23.633820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] For port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:23.636739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Network': ['ID=7b795427-dd2f-4f63-84a9-12255a6679b7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.645957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.656344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-60dc2176-ea1e-4d53-94ae-b3d640636263 None None] Port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:23.686573 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-77528703-6b2b-4b34-9284-796c52f156a2 tempest-AgentManagementNegativeTest-1595707586 tempest-AgentManagementNegativeTest-1595707586-project] 10.222.0.48 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.4370081 Nov 24 04:12:23.689255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 7b795427-dd2f-4f63-84a9-12255a6679b7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:23.717720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fb5983-5a21-4aac-9a3c-4dc14404fbca tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.725535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fb5983-5a21-4aac-9a3c-4dc14404fbca tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.732021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fb5983-5a21-4aac-9a3c-4dc14404fbca tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.736921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.743628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fb5983-5a21-4aac-9a3c-4dc14404fbca tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.750167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fb5983-5a21-4aac-9a3c-4dc14404fbca tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.753329 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-16fb5983-5a21-4aac-9a3c-4dc14404fbca tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3015 time: 0.3769259 Nov 24 04:12:23.758921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-939313a2-b598-4fdc-aee0-c299cf7b1684 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:23.759594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32768) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:23.773507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.826780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '6e2229ce-de0f-4cb5-ba7a-0fc3ccd0c1da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'bc24d75d-4d89-46bc-8132-50a5f65c93b4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:23.828071 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: bc24d75d-4d89-46bc-8132-50a5f65c93b4, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:23.840642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7490224-f46f-4494-8fe3-0af1637e1aee tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Network': ['ID=0e1521bf-0c39-484d-8e5e-977e19ebde26,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.869315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.876525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 0e1521bf-0c39-484d-8e5e-977e19ebde26 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:23.879346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network bc24d75d-4d89-46bc-8132-50a5f65c93b4 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:23.888074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:23.889002 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:23.908552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c045e099-e20f-48cd-a7a2-e194b594b766 None None] Pushing event updated for resources: {'Port': ['ID=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:23.955048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, bc24d75d-4d89-46bc-8132-50a5f65c93b4) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:23.972825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.1 (becef48c-b834-483b-91dc-0f71ec58e834/c4348623-9729-4d15-a5cf-803eac33880a/ae19df28-b4dc-4543-a27d-e26e7c450f42) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:23.975827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:23.976850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:23.999788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Network becef48c-b834-483b-91dc-0f71ec58e834 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:24.004378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00f232de-6efb-4e8d-b1f2-e7a4230c673c None None] Network bc24d75d-4d89-46bc-8132-50a5f65c93b4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:24.038575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:24.041782 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:24.053499 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d426b3e9-c85e-4c2c-8618-3ef46f02d06a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.5616329 Nov 24 04:12:24.056620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32772) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:24.105365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32774) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:24.116084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.179865 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a196bab8-bbb6-4cd2-8b58-300ed1f12b3c None None] Provisioning complete for port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:24.180511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a196bab8-bbb6-4cd2-8b58-300ed1f12b3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.205385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Pushing event updated for resources: {'Port': ['ID=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:24.288543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.360623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:24.365646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Attempting to bind port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:24.366025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Attempting to bind port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:24.366447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Attempting to bind port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 on network becef48c-b834-483b-91dc-0f71ec58e834 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:24.368603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.395619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e6f2e70e-d679-4812-999e-624b2453311c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:24.414861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-79983b23-5a5a-46dc-a781-a87259458811 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.495842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:24.496213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Checking segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:24.496616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.497009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Bound using segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:24.497498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Bound port: b3f44c75-b9b3-42e0-bca5-150a8e0c1df8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:24.497990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.612226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.669224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4920ad45-d317-4560-9d3b-35e34e08d10d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-bc24d75d-4d89-46bc-8132-50a5f65c93b4', 'network_id': 'bc24d75d-4d89-46bc-8132-50a5f65c93b4', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': '269f6028-8d5c-4e69-b6b2-0acda3e08476'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:24.670081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4920ad45-d317-4560-9d3b-35e34e08d10d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.708985 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.719848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a196bab8-bbb6-4cd2-8b58-300ed1f12b3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.757547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=0c9b8909-e5fb-43f0-ac11-1413609fa26f,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:24.786182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.788968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.810394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.839621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca3c87c6-38d0-4c7e-bb05-d7478d67298d None None] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:24.841869 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e6f2e70e-d679-4812-999e-624b2453311c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:24.842264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.845681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a196bab8-bbb6-4cd2-8b58-300ed1f12b3c None None] For port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:24.853358 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] For port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:24.917864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.936942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.977615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:24.985742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=269f6028-8d5c-4e69-b6b2-0acda3e08476,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:24.987417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7b795427-dd2f-4f63-84a9-12255a6679b7']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.016010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-79983b23-5a5a-46dc-a781-a87259458811 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.031235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7ae9dfa5-7b9e-49b3-a7fd-d2479313b919') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.031648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7ae9dfa5-7b9e-49b3-a7fd-d2479313b919') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.033501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-79983b23-5a5a-46dc-a781-a87259458811 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.054315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a196bab8-bbb6-4cd2-8b58-300ed1f12b3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.055032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network becef48c-b834-483b-91dc-0f71ec58e834 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:25.064428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.069924 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:25.083290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:25.089003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:25.089194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] For port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:25.093981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=ae19df28-b4dc-4543-a27d-e26e7c450f42,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.116188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:25.118823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.119229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.132861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.137709 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Releasing vlan 192 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:25.138716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:25.141371 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:25.150286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bc24d75d-4d89-46bc-8132-50a5f65c93b4']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.160633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6e2229ce-de0f-4cb5-ba7a-0fc3ccd0c1da') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.161016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6e2229ce-de0f-4cb5-ba7a-0fc3ccd0c1da') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.173622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.189330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server [None req-4920ad45-d317-4560-9d3b-35e34e08d10d None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 269f6028-8d5c-4e69-b6b2-0acda3e08476: This subnet is being modified by another concurrent operation. Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 295, in create_dhcp_port Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 115, in _port_action Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:25.195819 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exception Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 269f6028-8d5c-4e69-b6b2-0acda3e08476: This subnet is being modified by another concurrent operation. Nov 24 04:12:25.200219 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:12:25.208828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 169 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:25.208828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.209635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.241420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad592c13-ecfa-4058-9012-6efb2ae7384a None None] Network bc24d75d-4d89-46bc-8132-50a5f65c93b4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:25.274762 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:25.286301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a196bab8-bbb6-4cd2-8b58-300ed1f12b3c None None] Pushing event updated for resources: {'Port': ['ID=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.304378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Router 1bbc0b7f-fdd7-45e6-996b-c784681dcd02 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:25.309796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0c126c9e-8d5c-419a-b509-80b956785ff3 None None] Provisioning complete for port e6f2e70e-d679-4812-999e-624b2453311c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:25.310227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0c126c9e-8d5c-419a-b509-80b956785ff3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.315606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.324742 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-79983b23-5a5a-46dc-a781-a87259458811 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=cf5a24510ad543d5b27f84f8f9687491&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2144649 Nov 24 04:12:25.328685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32778) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:25.332407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.337254 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/bc24d75d-4d89-46bc-8132-50a5f65c93b4 HTTP/1.1" status: 204 len: 168 time: 1.2777624 Nov 24 04:12:25.338085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79983b23-5a5a-46dc-a781-a87259458811 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e27082d-50f5-4c6e-902d-1087e8552d30,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.345267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32780) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:25.362588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1017998326'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:25.370191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b588fc76-06e8-45fc-9833-4a3acdd9c015 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=bc24d75d-4d89-46bc-8132-50a5f65c93b4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.393191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.481230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:25.484818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.503444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.527572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:25.557080 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:25.567293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.571729 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/networks/7b795427-dd2f-4f63-84a9-12255a6679b7 HTTP/1.1" status: 204 len: 168 time: 1.8086882 Nov 24 04:12:25.573372 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Sync routers for ids ['1bbc0b7f-fdd7-45e6-996b-c784681dcd02'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:25.583036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32782) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:25.585358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a0673d1f-057d-4a8d-8756-336396cd0dc0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.589345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:25.590244 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Routers {'1bbc0b7f-fdd7-45e6-996b-c784681dcd02'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:25.591024 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1bbc0b7f-fdd7-45e6-996b-c784681dcd02'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:25.595490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.596758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7af4e2-2c9d-40b7-8371-217a1a2ca7ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Network': ['ID=7b795427-dd2f-4f63-84a9-12255a6679b7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.598235 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 1aa9e780-eeac-4d9f-9086-726ba013e1cf of type vlan for network af6d955c-f433-4283-a213-a0a7aaf8812b Nov 24 04:12:25.601642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7466723-843b-4256-9903-52ab4fb52857 None None] Pushing event updated for resources: {'Port': ['ID=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.605019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87527c58-6202-4afe-b05f-842a6fc28dc9 None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:16Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:25.608423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.699505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port e6f2e70e-d679-4812-999e-624b2453311c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e6f2e70e-d679-4812-999e-624b2453311c,segment=NetworkSegment(8e83a68c-90ac-4187-a0fb-888745040938),segment_id=8e83a68c-90ac-4187-a0fb-888745040938)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:25.704556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a0673d1f-057d-4a8d-8756-336396cd0dc0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.708839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.730649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.773968 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.776054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-10efeb81-adbe-44d2-a451-0fc8ef9bea85 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 5.3687131 Nov 24 04:12:25.795773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0c126c9e-8d5c-419a-b509-80b956785ff3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.800467 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32784) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:25.802220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:25.830964 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Set router 1bbc0b7f-fdd7-45e6-996b-c784681dcd02 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:25.872649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=e6f2e70e-d679-4812-999e-624b2453311c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:25.957299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-0c126c9e-8d5c-419a-b509-80b956785ff3 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:25.957570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-0c126c9e-8d5c-419a-b509-80b956785ff3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:25.970987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.resource_extend [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:12:25.999427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.047019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:26.083236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:26.092835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.094577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:26.095345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:26.099214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:26.100536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.120974 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-45be974d-d488-4a9c-a5f9-ad012c23de7f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2875707 Nov 24 04:12:26.129542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32786) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:26.250799 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.8897958 Nov 24 04:12:26.258092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32788) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:26.283831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.304369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': 'af6d955c-f433-4283-a213-a0a7aaf8812b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:26.315467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:26.325970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708f6b71-103a-4450-8ca7-4ccd985eb29f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=af6d955c-f433-4283-a213-a0a7aaf8812b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:26.338067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-80068827'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:26.440046 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bbc0b7f-fdd7-45e6-996b-c784681dcd02', 'name': '', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755', 'external_fixed_ips': [{'subnet_id': 'beae5781-a64e-41fd-a2bc-7b1098a9c7df', 'ip_address': '2001:db8::1ec'}], 'enable_snat': True}, 'gw_port_id': 'b0010827-a2ae-4d05-b947-9926c92a402b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:20Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 3, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port': {'id': 'b0010827-a2ae-4d05-b947-9926c92a402b', 'name': '', 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1b:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bbc0b7f-fdd7-45e6-996b-c784681dcd02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 834, 'fixed_ips': [{'subnet_id': 'beae5781-a64e-41fd-a2bc-7b1098a9c7df', 'ip_address': '2001:db8::1ec', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'beae5781-a64e-41fd-a2bc-7b1098a9c7df', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:26.455547 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network af6d955c-f433-4283-a213-a0a7aaf8812b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:26.477292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:26.483192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.549725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.553733 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Checking router: 1bbc0b7f-fdd7-45e6-996b-c784681dcd02 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:26.554088 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Updating router 1bbc0b7f-fdd7-45e6-996b-c784681dcd02 port b0010827-a2ae-4d05-b947-9926c92a402b binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:26.583603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a0673d1f-057d-4a8d-8756-336396cd0dc0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.593555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a0673d1f-057d-4a8d-8756-336396cd0dc0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.602023 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a0673d1f-057d-4a8d-8756-336396cd0dc0 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/5e27082d-50f5-4c6e-902d-1087e8552d30 HTTP/1.1" status: 204 len: 168 time: 1.2660897 Nov 24 04:12:26.604947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.614789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0e1521bf-0c39-484d-8e5e-977e19ebde26']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:26.617316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0673d1f-057d-4a8d-8756-336396cd0dc0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e27082d-50f5-4c6e-902d-1087e8552d30,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:26.632720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 196, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:26.643358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54c80851-ca3d-4149-9dad-62cf44593158') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:26.643658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54c80851-ca3d-4149-9dad-62cf44593158') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:26.650482 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.666571 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.668459 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment a637e051-f64d-4a8d-ab65-d3888c0c98a0 of type vlan for network db88bd2b-781c-4449-a342-faf837b9a6c2 Nov 24 04:12:26.673270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.678897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e6f2e70e-d679-4812-999e-624b2453311c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:26.708213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.724470 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Releasing vlan 160 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:26.724884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.824733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.880099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e6f2e70e-d679-4812-999e-624b2453311c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:26.881806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:26.884967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:27.014304 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:27.029765 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.032634 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=ae19df28-b4dc-4543-a27d-e26e7c450f42,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:27.036504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.038345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ff24f5f1-9247-488c-8381-903b1f8179ed None None] Provisioning complete for port 0c9b8909-e5fb-43f0-ac11-1413609fa26f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:27.040235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ff24f5f1-9247-488c-8381-903b1f8179ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.047994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:27.048661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.083373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.119819 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 764 time: 0.7873373 Nov 24 04:12:27.133804 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/networks/0e1521bf-0c39-484d-8e5e-977e19ebde26 HTTP/1.1" status: 204 len: 168 time: 1.5490572 Nov 24 04:12:27.135912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32796) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:27.150989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32798) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:27.162583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:27.180662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 3, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:27.244377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.246086 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f802c83-1659-4ccf-82fa-27fad6bb5ce1 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=db88bd2b-781c-4449-a342-faf837b9a6c2,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:27.283829 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6f0bc42-3afd-483b-899d-6308dff554b9 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Network': ['ID=0e1521bf-0c39-484d-8e5e-977e19ebde26,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:27.291425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:27.293434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Updating router af1bca15-198f-4ff7-9729-e777368c7abb port 0c9b8909-e5fb-43f0-ac11-1413609fa26f binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:27.296188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d96b079f-f35f-4691-90db-d2d0e224b011 None None] Network becef48c-b834-483b-91dc-0f71ec58e834 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:27.297820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network db88bd2b-781c-4449-a342-faf837b9a6c2 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:27.375780 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.383371 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.394738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.413844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:27.418297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.445042 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f818a175-bf05-4e2e-b0bd-48d41364b14a None None] Pushing event updated for resources: {'Port': ['ID=b0010827-a2ae-4d05-b947-9926c92a402b,revision_number=2']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:27.452102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ff24f5f1-9247-488c-8381-903b1f8179ed None None] Port 0c9b8909-e5fb-43f0-ac11-1413609fa26f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:27.484099 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Attempting to bind port b0010827-a2ae-4d05-b947-9926c92a402b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:27.485034 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Attempting to bind port b0010827-a2ae-4d05-b947-9926c92a402b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'b52f53bc-a832-4e38-97d0-fd8cd45904f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:27.486242 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Attempting to bind port b0010827-a2ae-4d05-b947-9926c92a402b on network 5531718d-5fcd-40c6-82d4-49a2e693f755 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:27.495336 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:27.496974 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Checking segment: {'id': 'b52f53bc-a832-4e38-97d0-fd8cd45904f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:27.497786 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.498451 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Bound using segment: {'id': 'b52f53bc-a832-4e38-97d0-fd8cd45904f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:27.499285 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Bound port: b0010827-a2ae-4d05-b947-9926c92a402b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b52f53bc-a832-4e38-97d0-fd8cd45904f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': '5531718d-5fcd-40c6-82d4-49a2e693f755'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:27.499956 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.571798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network becef48c-b834-483b-91dc-0f71ec58e834 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:27.575809 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] For port b0010827-a2ae-4d05-b947-9926c92a402b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:27.579773 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] For port b0010827-a2ae-4d05-b947-9926c92a402b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b0010827-a2ae-4d05-b947-9926c92a402b,segment=NetworkSegment(b52f53bc-a832-4e38-97d0-fd8cd45904f7),segment_id=b52f53bc-a832-4e38-97d0-fd8cd45904f7)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:27.582434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:27.601060 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.678399 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f818a175-bf05-4e2e-b0bd-48d41364b14a None None] Pushing event updated for resources: {'Port': ['ID=b0010827-a2ae-4d05-b947-9926c92a402b,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:27.712170 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Routers {'1bbc0b7f-fdd7-45e6-996b-c784681dcd02'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:27.714405 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1bbc0b7f-fdd7-45e6-996b-c784681dcd02'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:27.723738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:27.731420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.743476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Deleting port b0010827-a2ae-4d05-b947-9926c92a402b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:27.743866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.832431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] For port b0010827-a2ae-4d05-b947-9926c92a402b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b0010827-a2ae-4d05-b947-9926c92a402b,segment=NetworkSegment(b52f53bc-a832-4e38-97d0-fd8cd45904f7),segment_id=b52f53bc-a832-4e38-97d0-fd8cd45904f7)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:27.832810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.833850 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] Set router 1bbc0b7f-fdd7-45e6-996b-c784681dcd02 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:27.856707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Calling delete_port for b0010827-a2ae-4d05-b947-9926c92a402b owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:27.914822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.944459 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:27.950120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ff24f5f1-9247-488c-8381-903b1f8179ed None None] Provisioning complete for port e6f2e70e-d679-4812-999e-624b2453311c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:27.950566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ff24f5f1-9247-488c-8381-903b1f8179ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:27.951970 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bbc0b7f-fdd7-45e6-996b-c784681dcd02', 'name': '', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:20Z', 'updated_at': '2021-11-24T04:12:27Z', 'revision_number': 4, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:28.029049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32814) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.031255 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4747c3f7-aecd-4171-ac8b-bb120ed2d1de None None] The sync data for ids ['1bbc0b7f-fdd7-45e6-996b-c784681dcd02'] in dv-neutron-819049-1-hyperv is: [{'id': '1bbc0b7f-fdd7-45e6-996b-c784681dcd02', 'name': '', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:20Z', 'updated_at': '2021-11-24T04:12:27Z', 'revision_number': 4, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:28.054820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.089101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0e90462-e093-455b-9985-ca9be2b55579 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:28.095344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0e90462-e093-455b-9985-ca9be2b55579 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:28.102639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0e90462-e093-455b-9985-ca9be2b55579 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:28.107971 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d0e90462-e093-455b-9985-ca9be2b55579 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1947 time: 0.9487762 Nov 24 04:12:28.108779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32818) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.121407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1990489664'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:28.175110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=eca384a0-ac7f-4e35-8e16-c905722624f0,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:28.191335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:28.191883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: db88bd2b-781c-4449-a342-faf837b9a6c2, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:28.194442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.210579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:28.226945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event deleted for resources: {'Port': ['ID=b0010827-a2ae-4d05-b947-9926c92a402b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:28.228934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:28.232679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.304491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network db88bd2b-781c-4449-a342-faf837b9a6c2 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:28.308276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-b35003c9-8eff-4d6f-8ae0-9ae5275afc1b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.309390 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b35003c9-8eff-4d6f-8ae0-9ae5275afc1b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.2791595 Nov 24 04:12:28.313024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32820) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.316906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-34b3b82c-e661-463a-b0c2-4e754bc74d0b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.317952 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-34b3b82c-e661-463a-b0c2-4e754bc74d0b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0043988 Nov 24 04:12:28.326437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32822) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.330611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-6ac72a1b-b9ac-4215-be54-e0ecedcba42b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.331566 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6ac72a1b-b9ac-4215-be54-e0ecedcba42b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0041938 Nov 24 04:12:28.335308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32824) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.336382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.336888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, db88bd2b-781c-4449-a342-faf837b9a6c2) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:28.345537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-85a67903-cb92-40c2-86ff-9f7f4829d06a tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.346633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-85a67903-cb92-40c2-86ff-9f7f4829d06a tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0047035 Nov 24 04:12:28.387449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b6539d5-24ed-4e9e-9e82-46e51b8e190e None None] Network db88bd2b-781c-4449-a342-faf837b9a6c2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:28.389897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:28.390511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.392603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32826) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.398028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-76d5726b-2dda-4138-958c-8f70f13d64f8 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.399042 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-76d5726b-2dda-4138-958c-8f70f13d64f8 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0052547 Nov 24 04:12:28.405595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32828) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.409690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-72baa601-62c0-4485-9b28-4132b64cc0f7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.410651 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-72baa601-62c0-4485-9b28-4132b64cc0f7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0041275 Nov 24 04:12:28.416075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32830) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.422745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-aa38cfe0-bf14-4cab-ad17-5066a15d952f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.423894 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aa38cfe0-bf14-4cab-ad17-5066a15d952f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0052667 Nov 24 04:12:28.436056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32832) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.440843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-5581bbff-a7de-4b23-8431-a6799b1a1d5f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.441820 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5581bbff-a7de-4b23-8431-a6799b1a1d5f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0047207 Nov 24 04:12:28.456324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32834) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.457566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:28.457953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.463711 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-465892bc-65ec-4711-b26f-e90557508686 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3161821 Nov 24 04:12:28.468730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-bee8ef18-e0c5-464b-9ffd-62952da06ccb tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.469753 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bee8ef18-e0c5-464b-9ffd-62952da06ccb tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0123391 Nov 24 04:12:28.475350 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32836) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.475350 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32838) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.493425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-8f4d31a4-1168-4e2c-9f37-db29ff25704a tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.494592 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8f4d31a4-1168-4e2c-9f37-db29ff25704a tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0176477 Nov 24 04:12:28.499543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32840) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.503269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.507561 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-272a7605-eb1e-4df3-abb4-45602ab4293b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.512213 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-272a7605-eb1e-4df3-abb4-45602ab4293b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0085218 Nov 24 04:12:28.519644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.520948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32842) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.531130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-353f27e1-c42b-438d-888d-d4632f77524c tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.534962 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-353f27e1-c42b-438d-888d-d4632f77524c tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0096962 Nov 24 04:12:28.535315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] vlan segment allocate from pool success with {'vlan_id': 183, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:28.541517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32844) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.541698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.578085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-6e456036-320c-4ae3-9643-c4044d5f5e3f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.582667 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6e456036-320c-4ae3-9643-c4044d5f5e3f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0353336 Nov 24 04:12:28.582864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:28.582864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32846) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.587358 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ee693fff-6e65-4c8f-aaae-00abc7c7c026 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/0fe6e120-10fd-4f02-8be4-2afcf5422729/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4864841 Nov 24 04:12:28.590639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-ab237b50-2c59-490d-a054-c1b84b69be9b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.598759 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ab237b50-2c59-490d-a054-c1b84b69be9b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0086327 Nov 24 04:12:28.598759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32848) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.598759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32850) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.611969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-298d23d1-75c1-4648-9183-5cccb8f946b6 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.615670 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-298d23d1-75c1-4648-9183-5cccb8f946b6 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0162861 Nov 24 04:12:28.623379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32852) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.630053 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-d71314a1-5675-4d1b-8cd4-a203c769c9e8 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.633373 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d71314a1-5675-4d1b-8cd4-a203c769c9e8 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0068176 Nov 24 04:12:28.633526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.633526 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Added segment 609829a6-9e56-45c6-bafb-38740f8157df of type vlan for network dc354c27-c6e5-46c1-b428-5b8b90373752 Nov 24 04:12:28.637221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32854) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.663664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-efb466cd-fba8-4816-84c2-efdc0ce46886 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.663664 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-efb466cd-fba8-4816-84c2-efdc0ce46886 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0059531 Nov 24 04:12:28.665586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32856) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.669860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.670423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 1bbc0b7f-fdd7-45e6-996b-c784681dcd02 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:28.680378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.685222 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:28.685774 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3a038147-0b08-4034-9eed-5423a64b2497 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/routers/1bbc0b7f-fdd7-45e6-996b-c784681dcd02 HTTP/1.1" status: 204 len: 168 time: 2.8800027 Nov 24 04:12:28.689647 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32858) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.702457 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:28.703978 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:28.731577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-5a4d93bb-29cf-49d1-9538-2279c15fcda7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.735027 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a4d93bb-29cf-49d1-9538-2279c15fcda7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0603688 Nov 24 04:12:28.740248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32860) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.753161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-e1ff5b91-7b5f-402c-8450-98a29d5c6eea tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.754215 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e1ff5b91-7b5f-402c-8450-98a29d5c6eea tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0063424 Nov 24 04:12:28.784946 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32862) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.796109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-b0a794d5-61f0-48a9-ace9-3e1321b0536e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.799608 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0a794d5-61f0-48a9-ace9-3e1321b0536e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0080132 Nov 24 04:12:28.799608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.801538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=9349ed60-5646-4279-a727-67eeaa1b372b,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:28.809416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32864) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.814319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-637a0321-070e-432c-8a8a-d97c274f7b7a tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.814979 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-637a0321-070e-432c-8a8a-d97c274f7b7a tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0046351 Nov 24 04:12:28.818215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Provisioning complete for port 0c9b8909-e5fb-43f0-ac11-1413609fa26f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:28.819151 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32866) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.824586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.831255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-07f8493f-a32c-4f0a-ad9a-154799264a35 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.832238 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-07f8493f-a32c-4f0a-ad9a-154799264a35 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0109146 Nov 24 04:12:28.839845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32868) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.845466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-2fde8ba4-d920-499e-9873-ab5b1ec84ad5 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.846727 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2fde8ba4-d920-499e-9873-ab5b1ec84ad5 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0058167 Nov 24 04:12:28.858222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32870) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.865261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-6d2cabc0-e36a-410f-8aa5-c630d14bbbe6 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.867126 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6d2cabc0-e36a-410f-8aa5-c630d14bbbe6 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0065918 Nov 24 04:12:28.870679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32872) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.873123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '1aa9e780-eeac-4d9f-9086-726ba013e1cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': 'af6d955c-f433-4283-a213-a0a7aaf8812b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:28.873483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: af6d955c-f433-4283-a213-a0a7aaf8812b, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:28.877883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-cd52f211-0ca6-45b7-861c-daf18e0afab4 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.878866 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cd52f211-0ca6-45b7-861c-daf18e0afab4 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0067899 Nov 24 04:12:28.883699 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:28.887537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32874) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.892993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-222a1fe5-2b19-4e38-b271-74350594cdcb tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.894182 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-222a1fe5-2b19-4e38-b271-74350594cdcb tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0044780 Nov 24 04:12:28.897452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32876) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.902052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-7c2b5c04-604b-4e2b-bf95-18b302780d2c tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.903013 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7c2b5c04-604b-4e2b-bf95-18b302780d2c tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0044858 Nov 24 04:12:28.906495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32878) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.918316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-bc3f9586-c624-42de-8cee-0dbb5564e307 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.919537 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bc3f9586-c624-42de-8cee-0dbb5564e307 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0093539 Nov 24 04:12:28.923139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32880) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.925734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.932217 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:28.933064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.939083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-bab93f9b-7cfd-4ae1-94d1-b400b48de115 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.940278 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bab93f9b-7cfd-4ae1-94d1-b400b48de115 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0156655 Nov 24 04:12:28.955573 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32882) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.976690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-1d7e5312-49c4-4b85-a93c-25b008f7d7e8 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.978180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1d7e5312-49c4-4b85-a93c-25b008f7d7e8 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0070832 Nov 24 04:12:28.982612 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32884) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:28.987611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:28.995132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:28.998804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-1203b0d9-7176-4142-aaa5-79faf2c5894e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:28.999914 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1203b0d9-7176-4142-aaa5-79faf2c5894e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0065789 Nov 24 04:12:29.004662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32886) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.010674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-db88bd2b-781c-4449-a342-faf837b9a6c2', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:29.012433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.015103 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.9020493 Nov 24 04:12:29.018608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-cd251986-e818-4e0f-86e8-acde3a4d4a50 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.019684 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cd251986-e818-4e0f-86e8-acde3a4d4a50 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0109303 Nov 24 04:12:29.030689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32888) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.031093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32890) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.047259 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Port 0c9b8909-e5fb-43f0-ac11-1413609fa26f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:29.053097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.068212 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-806879827'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:29.074181 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-79f823b5-4712-48c4-872b-50d523a743dc tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.075490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-79f823b5-4712-48c4-872b-50d523a743dc tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0422726 Nov 24 04:12:29.076504 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network af6d955c-f433-4283-a213-a0a7aaf8812b is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:29.083511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32892) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.091584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-cc1b7d6c-dd50-4226-ae63-e772ce3c8ac3 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.092945 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cc1b7d6c-dd50-4226-ae63-e772ce3c8ac3 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0050907 Nov 24 04:12:29.096555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32894) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.102111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da92d3c8-28e9-4b6b-b682-6264c8cd4580 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Network': ['ID=dc354c27-c6e5-46c1-b428-5b8b90373752,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:29.104578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, af6d955c-f433-4283-a213-a0a7aaf8812b) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:29.108661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-ec4aaf1a-9cd7-4d35-9f32-6304b22d4256 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.109964 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ec4aaf1a-9cd7-4d35-9f32-6304b22d4256 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0090215 Nov 24 04:12:29.120110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32896) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.122299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b907d4-2895-4319-840b-d60b740cdcd7 None None] Pushing event updated for resources: {'Port': ['ID=0c9b8909-e5fb-43f0-ac11-1413609fa26f,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:29.124301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-d5208f9a-c681-407b-86cf-02e86ecfd247 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.125243 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d5208f9a-c681-407b-86cf-02e86ecfd247 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0042133 Nov 24 04:12:29.126717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.127306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.130791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32898) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.135780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-edc8cdbd-19ec-4c4c-b711-5a272a661554 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.136732 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-edc8cdbd-19ec-4c4c-b711-5a272a661554 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0041745 Nov 24 04:12:29.140741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc981f1b-c902-49c0-b42f-588e5378abc1 None None] Network af6d955c-f433-4283-a213-a0a7aaf8812b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:29.142789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32900) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.142943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network dc354c27-c6e5-46c1-b428-5b8b90373752 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:29.148210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-534467d2-52cc-4c9f-9dd6-175f14b8cd84 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.149166 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-534467d2-52cc-4c9f-9dd6-175f14b8cd84 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0042892 Nov 24 04:12:29.158993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32902) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.164197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-0473d0df-34ee-4bfe-8ef1-29722040c34d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.165153 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0473d0df-34ee-4bfe-8ef1-29722040c34d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0047374 Nov 24 04:12:29.168354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32904) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.173477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:29.181510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.197730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-c76c7ce2-5cee-4bcc-a2c2-8fbc0c84c40f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.201122 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c76c7ce2-5cee-4bcc-a2c2-8fbc0c84c40f tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0294461 Nov 24 04:12:29.203727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32906) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.225211 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ed5a8db2-7994-47c4-ba0f-bd483178d8c9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.9364166 Nov 24 04:12:29.226323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-de982ce5-35b0-4cdb-b524-f537637ea527 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.230459 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-de982ce5-35b0-4cdb-b524-f537637ea527 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0168197 Nov 24 04:12:29.230459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32908) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.230459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32910) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.253138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-c23b4dab-4cef-469b-adf4-e113ae139f8d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.256989 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c23b4dab-4cef-469b-adf4-e113ae139f8d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0219622 Nov 24 04:12:29.258210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32912) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.289863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-7c1d0f86-f42f-4376-b661-20dd3a64ddb0 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.297816 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7c1d0f86-f42f-4376-b661-20dd3a64ddb0 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0115047 Nov 24 04:12:29.302111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32914) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.309777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Deleting subnet beae5781-a64e-41fd-a2bc-7b1098a9c7df {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:29.318012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-d7f42f0b-2781-4b77-959e-bcf3362ccec2 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.322420 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d7f42f0b-2781-4b77-959e-bcf3362ccec2 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0105414 Nov 24 04:12:29.330257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.346317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32916) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.359528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-84989730-d8f0-481d-a962-ed96eabc1f53 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.360542 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-84989730-d8f0-481d-a962-ed96eabc1f53 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0132761 Nov 24 04:12:29.368172 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:25Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:26Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:29.373395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:29.395224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Provisioning complete for port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:29.395620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.403513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.404753 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Added segment 9e255830-cd1e-487a-9d7a-faae86a65996 of type vlan for network aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d Nov 24 04:12:29.428930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.459375 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:29.459872 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Updating router 0fe6e120-10fd-4f02-8be4-2afcf5422729 port ae19df28-b4dc-4543-a27d-e26e7c450f42 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:29.486195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.514514 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.557862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32918) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.563488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-c2c85319-6d3d-48c4-8d07-f6aa8053ce1b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.564654 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c2c85319-6d3d-48c4-8d07-f6aa8053ce1b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0059593 Nov 24 04:12:29.580115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32920) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.610649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-6a6700be-76cb-48dc-a21f-39cbc554ace3 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.612371 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a6700be-76cb-48dc-a21f-39cbc554ace3 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0163505 Nov 24 04:12:29.626962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32922) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.640349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-c6982fa0-2446-4c3d-b86e-bfb5cc2d382e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.641836 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c6982fa0-2446-4c3d-b86e-bfb5cc2d382e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0135493 Nov 24 04:12:29.653382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32924) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.654890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.673276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-28575297-b95f-4ffd-8703-542b69516800 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.674866 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-28575297-b95f-4ffd-8703-542b69516800 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0096591 Nov 24 04:12:29.687481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32926) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.696311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-cf8d5ac4-8fbb-4873-9c4a-3c9c5aca7dfa tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.697735 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cf8d5ac4-8fbb-4873-9c4a-3c9c5aca7dfa tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0089240 Nov 24 04:12:29.700820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32928) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.733940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.735038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.735038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.735557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.736068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.736573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.737664 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.737664 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.738102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.739178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:29.746723 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f928900f-b41b-4ff0-8cab-8a97c9a6ce1f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 7024 time: 1.1515641 Nov 24 04:12:29.750601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32930) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.754274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-04c57ee1-6fb9-4f47-952f-2c9820087051 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.758427 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-04c57ee1-6fb9-4f47-952f-2c9820087051 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0251083 Nov 24 04:12:29.759259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.768639 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/subnets/beae5781-a64e-41fd-a2bc-7b1098a9c7df HTTP/1.1" status: 204 len: 168 time: 1.0750337 Nov 24 04:12:29.781363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:29.781733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.786229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32932) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.786578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32934) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.787387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6f93c3-c6cf-4e92-82fd-3f12b4e933ed tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=beae5781-a64e-41fd-a2bc-7b1098a9c7df,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:29.795484 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [None req-a4dbf803-c98e-4f42-9d60-a846ac1fe3d2 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.799211 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a4dbf803-c98e-4f42-9d60-a846ac1fe3d2 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0096960 Nov 24 04:12:29.799662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Attempting to bind port 0c9b8909-e5fb-43f0-ac11-1413609fa26f on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:29.800040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Attempting to bind port 0c9b8909-e5fb-43f0-ac11-1413609fa26f by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:29.800409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Attempting to bind port 0c9b8909-e5fb-43f0-ac11-1413609fa26f on network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:29.865385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32936) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.873219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-e32818ad-ef13-40d0-8911-65bd28e0a8f2 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.874628 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e32818ad-ef13-40d0-8911-65bd28e0a8f2 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0072627 Nov 24 04:12:29.883364 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32938) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.897852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:29.898698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Checking segment: {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:29.899053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.900549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Bound using segment: {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:29.901735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Bound port: 0c9b8909-e5fb-43f0-ac11-1413609fa26f, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e83a68c-90ac-4187-a0fb-888745040938', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:29.902406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:29.908044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-54072940-66e2-4701-9290-555c8938dedf tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.909244 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-54072940-66e2-4701-9290-555c8938dedf tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0197623 Nov 24 04:12:29.914338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32940) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.933675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Allocated IP 172.22.0.2 (db88bd2b-781c-4449-a342-faf837b9a6c2/eca384a0-ac7f-4e35-8e16-c905722624f0/6b84891c-e073-40c7-a287-b35f1e020975) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:29.941310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-965f963e-473e-4db4-9335-dd2f2ffdadff tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.944273 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-965f963e-473e-4db4-9335-dd2f2ffdadff tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0267203 Nov 24 04:12:29.974954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32942) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:29.985832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-2970e9f7-6317-460a-85c2-9043a22027c7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:29.987409 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2970e9f7-6317-460a-85c2-9043a22027c7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0085356 Nov 24 04:12:29.997105 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32944) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.009205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-4c1a5abe-8c32-484b-aa97-bf9e76b9b985 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.010770 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4c1a5abe-8c32-484b-aa97-bf9e76b9b985 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0121994 Nov 24 04:12:30.016037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32946) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.018823 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.020392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.027063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-773bbcc8-51a8-47ee-8cfe-479818d8401c tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.027494 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.028119 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-773bbcc8-51a8-47ee-8cfe-479818d8401c tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0107405 Nov 24 04:12:30.031226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32948) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.042435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-3422eb8c-04c3-4164-99cc-4c9838e56197 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.043759 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3422eb8c-04c3-4164-99cc-4c9838e56197 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0094810 Nov 24 04:12:30.043905 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] For port 0c9b8909-e5fb-43f0-ac11-1413609fa26f, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:30.047867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] For port 0c9b8909-e5fb-43f0-ac11-1413609fa26f, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0c9b8909-e5fb-43f0-ac11-1413609fa26f,segment=NetworkSegment(8e83a68c-90ac-4187-a0fb-888745040938),segment_id=8e83a68c-90ac-4187-a0fb-888745040938)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:30.049894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32950) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.057027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-c4e347a4-d8bd-42d1-9578-01921288c861 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.059000 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c4e347a4-d8bd-42d1-9578-01921288c861 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0053375 Nov 24 04:12:30.062849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.070529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32952) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.078626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-a3f07a31-abe4-4a1c-bc1b-3b46e80ac2ae tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.080053 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a3f07a31-abe4-4a1c-bc1b-3b46e80ac2ae tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0076447 Nov 24 04:12:30.089785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32954) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.106431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-c4e53538-1ed2-4f9e-8333-9180844c8fc7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.115782 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c4e53538-1ed2-4f9e-8333-9180844c8fc7 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0229063 Nov 24 04:12:30.117940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32956) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.131031 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-7b06c37a-03c9-4df3-88f5-adacc0101efc tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.135434 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7b06c37a-03c9-4df3-88f5-adacc0101efc tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0125394 Nov 24 04:12:30.136277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32958) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.144939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.151338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-e7720db9-95c5-444d-8562-f0322b17c79b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.152295 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64288a7f-2633-4f57-8590-df80af7e9fc7 None None] Pushing event updated for resources: {'Port': ['ID=ae19df28-b4dc-4543-a27d-e26e7c450f42,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:30.156053 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e7720db9-95c5-444d-8562-f0322b17c79b tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0166683 Nov 24 04:12:30.160861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.167842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.169016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.172530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32960) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.176608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5147cb79-cf55-4e85-9e8b-0479391d41c6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-af6d955c-f433-4283-a213-a0a7aaf8812b', 'network_id': 'af6d955c-f433-4283-a213-a0a7aaf8812b', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': '9349ed60-5646-4279-a727-67eeaa1b372b'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:30.178245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5147cb79-cf55-4e85-9e8b-0479391d41c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.183335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-d5370c98-9d3c-4807-bf15-1a03c3097184 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.187441 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d5370c98-9d3c-4807-bf15-1a03c3097184 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0103691 Nov 24 04:12:30.194925 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Attempting to bind port ae19df28-b4dc-4543-a27d-e26e7c450f42 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:30.195294 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Attempting to bind port ae19df28-b4dc-4543-a27d-e26e7c450f42 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:30.195663 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Attempting to bind port ae19df28-b4dc-4543-a27d-e26e7c450f42 on network becef48c-b834-483b-91dc-0f71ec58e834 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:30.202449 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:30.202823 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Checking segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:30.203224 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.203613 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Bound using segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:30.204079 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Bound port: ae19df28-b4dc-4543-a27d-e26e7c450f42, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:30.204552 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.214129 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32962) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.225015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-e0667a87-e7f1-481e-8f7b-5eabe3e7bbaf tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.229758 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0667a87-e7f1-481e-8f7b-5eabe3e7bbaf tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0133286 Nov 24 04:12:30.245235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32964) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.267179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-ce2ddca4-726e-4ba4-b718-6abd01e11d6d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.273395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.274512 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ce2ddca4-726e-4ba4-b718-6abd01e11d6d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0276871 Nov 24 04:12:30.280587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32966) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.298552 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-ce647d84-c3b3-462d-aea1-ae48b67bc64e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.299570 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ce647d84-c3b3-462d-aea1-ae48b67bc64e tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0057395 Nov 24 04:12:30.317656 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] For port ae19df28-b4dc-4543-a27d-e26e7c450f42, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:30.323625 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] For port ae19df28-b4dc-4543-a27d-e26e7c450f42, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ae19df28-b4dc-4543-a27d-e26e7c450f42,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:30.332565 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.368922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32968) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.390427 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:30.391240 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:30.394179 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.3576608 Nov 24 04:12:30.398385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32970) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.414292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-8b105f00-495e-4e9d-9b5b-2b2151cdcc40 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.415589 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8b105f00-495e-4e9d-9b5b-2b2151cdcc40 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0203815 Nov 24 04:12:30.449019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b907d4-2895-4319-840b-d60b740cdcd7 None None] Pushing event updated for resources: {'Port': ['ID=0c9b8909-e5fb-43f0-ac11-1413609fa26f,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:30.458852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.466967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'ports': [{'network_id': 'dc354c27-c6e5-46c1-b428-5b8b90373752', 'name': 'tempest-port--807590226', 'admin_state_up': True}, {'network_id': 'aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d', 'admin_state_up': False}]} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:30.467353 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'port': {'network_id': 'dc354c27-c6e5-46c1-b428-5b8b90373752', 'name': 'tempest-port--807590226', 'admin_state_up': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:30.467780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'port': {'network_id': 'aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d', 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:30.481290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32972) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.486026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe46d13-95ae-4684-a492-eb3ea21371d2 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Network': ['ID=aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:30.505824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-a8338524-b21a-459b-bd29-5a539623b05d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.506852 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a8338524-b21a-459b-bd29-5a539623b05d tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0182796 Nov 24 04:12:30.534905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32974) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.552208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [None req-6d8eedde-4cbd-4bb5-9b7a-cd63bae05177 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] http://10.222.0.48:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:12:30.553722 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6d8eedde-4cbd-4bb5-9b7a-cd63bae05177 tempest-ExtensionsTestJSON-1824936440 tempest-ExtensionsTestJSON-1824936440-project] 10.222.0.48 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0085316 Nov 24 04:12:30.628493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.696520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.698960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.699422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.701740 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.703617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.705291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.705760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.707850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.713817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:30.719636 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-32dbb572-3c0e-43af-b8ed-1f0439716f3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5702 time: 0.9497015 Nov 24 04:12:30.725003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.734894 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64288a7f-2633-4f57-8590-df80af7e9fc7 None None] Pushing event updated for resources: {'Port': ['ID=ae19df28-b4dc-4543-a27d-e26e7c450f42,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:30.760724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32978) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:30.768445 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:30.771070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:30.772712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:30.897281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.901335 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] For port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:30.913789 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:30.946290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:30.984456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.012998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.023849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5531718d-5fcd-40c6-82d4-49a2e693f755']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.042226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b52f53bc-a832-4e38-97d0-fd8cd45904f7') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.042595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b52f53bc-a832-4e38-97d0-fd8cd45904f7') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.077691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=9349ed60-5646-4279-a727-67eeaa1b372b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:31.145630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:31.159911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32982) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:31.185235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'port': 2} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:31.191285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.191503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.192509 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:25Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:30Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.207340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.214017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Releasing vlan 189 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:31.214514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.227917 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b37bde7c-31d9-42fc-9b87-88743715bf1c None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:25Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:30Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:31.235061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:31.247159 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:31.266016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.306990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.323379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 5531718d-5fcd-40c6-82d4-49a2e693f755 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server [None req-5147cb79-cf55-4e85-9e8b-0479391d41c6 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9349ed60-5646-4279-a727-67eeaa1b372b: This subnet is being modified by another concurrent operation. Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 295, in create_dhcp_port Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 115, in _port_action Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:31.323835 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exception Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9349ed60-5646-4279-a727-67eeaa1b372b: This subnet is being modified by another concurrent operation. Nov 24 04:12:31.327310 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:12:31.329767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.341308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['af6d955c-f433-4283-a213-a0a7aaf8812b']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.341495 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/networks/5531718d-5fcd-40c6-82d4-49a2e693f755 HTTP/1.1" status: 204 len: 168 time: 1.5473104 Nov 24 04:12:31.352983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef675922-c5c4-4abd-8166-1277376ed670 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event deleted for resources: {'Network': ['ID=5531718d-5fcd-40c6-82d4-49a2e693f755,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:31.369331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1aa9e780-eeac-4d9f-9086-726ba013e1cf') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.369725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1aa9e780-eeac-4d9f-9086-726ba013e1cf') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:31.395099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.409858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0873458-beb4-4143-9885-8474ed15bb02 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.526184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0873458-beb4-4143-9885-8474ed15bb02 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.536553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.547262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0873458-beb4-4143-9885-8474ed15bb02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.575797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc834259-b982-426c-9e27-adc52bc26862 None None] Network af6d955c-f433-4283-a213-a0a7aaf8812b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:31.592855 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05c5605-a88f-4dbf-a92d-f6de7439c18a None None] Pushing event updated for resources: {'Port': ['ID=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:31.602753 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 163 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:31.603157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:31.610621 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:31.621856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:31.622368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:31.626139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.641781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32992) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:31.642381 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0873458-beb4-4143-9885-8474ed15bb02 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=594f6833ae9e4493aff66fe287f1aee1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4808257 Nov 24 04:12:31.657651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] device_id is not set on port f7b9a3cc-af90-4bd0-8cca-21e27c55f662 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:31.670292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Provisioning complete for port 0c9b8909-e5fb-43f0-ac11-1413609fa26f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:31.673279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.705477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 32994) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:31.716775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'name': 'tempest-router--1962031629', 'project_id': '1f50dd88b96f4c6182788f3edf7efecd'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:31.717773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0873458-beb4-4143-9885-8474ed15bb02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ee2f7b3-aa49-4756-a42c-b2ce1a36546b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:31.727760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.750207 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a3b197bc-dc45-4cec-987d-600efb1cfa63 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2136 time: 0.9817760 Nov 24 04:12:31.760104 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.766799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.773854 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/af6d955c-f433-4283-a213-a0a7aaf8812b HTTP/1.1" status: 204 len: 168 time: 2.5394578 Nov 24 04:12:31.787776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 32998) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:31.795475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-340384129'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:31.798815 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d694bd-add8-4890-95fa-2292f5026804 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=af6d955c-f433-4283-a213-a0a7aaf8812b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:31.851017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.22.0.1 (db88bd2b-781c-4449-a342-faf837b9a6c2/eca384a0-ac7f-4e35-8e16-c905722624f0/156ac190-86bf-4a9d-9929-0d063229f101) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:31.859122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Network db88bd2b-781c-4449-a342-faf837b9a6c2 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:31.883326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:31.921482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:31.935114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:31.953542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Pushing event updated for resources: {'Port': ['ID=6b84891c-e073-40c7-a287-b35f1e020975,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:31.985423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.007423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] device_id is not set on port a18c5aaf-aa36-4563-8fc6-08053f4be9e4 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:32.025965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.027002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.040294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b14a475-405e-4f10-8456-e612451ed992 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.051910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.052157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:32.054880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.056900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.090709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 189, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:32.136634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] For port 0c9b8909-e5fb-43f0-ac11-1413609fa26f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0c9b8909-e5fb-43f0-ac11-1413609fa26f,segment=NetworkSegment(8e83a68c-90ac-4187-a0fb-888745040938),segment_id=8e83a68c-90ac-4187-a0fb-888745040938)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:32.140837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b14a475-405e-4f10-8456-e612451ed992 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.154566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Attempting to bind port 6b84891c-e073-40c7-a287-b35f1e020975 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:32.155172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Attempting to bind port 6b84891c-e073-40c7-a287-b35f1e020975 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:32.155287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Attempting to bind port 6b84891c-e073-40c7-a287-b35f1e020975 on network db88bd2b-781c-4449-a342-faf837b9a6c2 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:32.159291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 3, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:30Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:32.163856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.169686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.175016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network db88bd2b-781c-4449-a342-faf837b9a6c2 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:32.182787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:32.194374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.197008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:32.198876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.199289 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 3d8f67ce-aeb1-4f0d-8bcf-ed9e1f21852e of type vlan for network f2713fc5-675f-44b2-b65c-0a083f1c207a Nov 24 04:12:32.214990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=156ac190-86bf-4a9d-9929-0d063229f101,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:32.234651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:32.234926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Checking segment: {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:32.235851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.235851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Bound using segment: {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:32.236059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Bound port: 6b84891c-e073-40c7-a287-b35f1e020975, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:32.236410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.258774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.260280 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bcc6be8c-67d9-4c9a-b912-6e9c03cbc10b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.5534015 Nov 24 04:12:32.264142 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.266060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33000) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:32.269142 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.276966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.291657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69c01620-78c0-4a76-8070-a9cc6717f8d6 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:23Z', 'revision_number': 3, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:30Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:32.316792 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.322855 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:32.323576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.356629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Provisioning complete for port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:32.356820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.395471 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.6052144 Nov 24 04:12:32.404852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.411205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33002) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:32.423173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': 'f2713fc5-675f-44b2-b65c-0a083f1c207a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:32.472199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Pushing event updated for resources: {'Port': ['ID=0c9b8909-e5fb-43f0-ac11-1413609fa26f,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:32.537795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] For port 6b84891c-e073-40c7-a287-b35f1e020975, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:32.538027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b14a475-405e-4f10-8456-e612451ed992 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.544553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9b14a475-405e-4f10-8456-e612451ed992 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.547537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] For port 6b84891c-e073-40c7-a287-b35f1e020975, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6b84891c-e073-40c7-a287-b35f1e020975,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:32.550013 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b14a475-405e-4f10-8456-e612451ed992 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/8ee2f7b3-aa49-4756-a42c-b2ce1a36546b HTTP/1.1" status: 204 len: 168 time: 0.9070961 Nov 24 04:12:32.557014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.584609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.670092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b14a475-405e-4f10-8456-e612451ed992 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ee2f7b3-aa49-4756-a42c-b2ce1a36546b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:32.692026 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.696688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:32.700381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:32.782930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f816e9a1-349b-4d73-9518-da1ff368f38a None None] Pushing event updated for resources: {'Port': ['ID=6b84891c-e073-40c7-a287-b35f1e020975,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:32.783395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e203652-4404-4dcb-9ccd-05f55ab79c15 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=f2713fc5-675f-44b2-b65c-0a083f1c207a,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:32.817528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ae19df28-b4dc-4543-a27d-e26e7c450f42 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:32.820962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network f2713fc5-675f-44b2-b65c-0a083f1c207a details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:32.851209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Performing IP validity checks on allocation pools {{(pid=103380) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:12:32.851901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103380) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:12:32.957664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Port': ['ID=f7b9a3cc-af90-4bd0-8cca-21e27c55f662,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:33.018332 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Provisioning complete for port ae19df28-b4dc-4543-a27d-e26e7c450f42 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:33.018718 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.048601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.054743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ae19df28-b4dc-4543-a27d-e26e7c450f42 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:33.055121 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.057903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.091435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Checking segment: {'id': '609829a6-9e56-45c6-bafb-38740f8157df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 183, 'network_id': 'dc354c27-c6e5-46c1-b428-5b8b90373752'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:33.091435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network hostable DHCP agents. Network: dc354c27-c6e5-46c1-b428-5b8b90373752, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:33.240258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network dc354c27-c6e5-46c1-b428-5b8b90373752 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:33.284556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, dc354c27-c6e5-46c1-b428-5b8b90373752) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:33.293475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:33.295023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.328944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.333690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f51400fa-5f6b-45af-938f-8d17a1d64967 None None] Network dc354c27-c6e5-46c1-b428-5b8b90373752 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:33.390215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.394128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Fanout notify agent at l3_agent the message router_deleted on router bdb8904d-db8e-4272-9f63-9e59015a8aeb {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:33.407611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.424396 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5fa91ce4-9c93-450d-a322-49ccc47dfad5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/routers/bdb8904d-db8e-4272-9f63-9e59015a8aeb HTTP/1.1" status: 204 len: 168 time: 1.1486197 Nov 24 04:12:33.426433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33016) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:33.442802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.444902 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1004657829', 'description': 'tempest-secgroup-smoke-1004657829 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:33.554220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port ae19df28-b4dc-4543-a27d-e26e7c450f42, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ae19df28-b4dc-4543-a27d-e26e7c450f42,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:33.575437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.588303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.589189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:33.614100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.644773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Port': ['ID=a18c5aaf-aa36-4563-8fc6-08053f4be9e4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:33.729590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Checking segment: {'id': '9e255830-cd1e-487a-9d7a-faae86a65996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': 'aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:33.730032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network hostable DHCP agents. Network: aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:33.753162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=de8f6d08-3efc-4992-a3ce-4503c1f45205,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:33.792658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:33.799535 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '3d8f67ce-aeb1-4f0d-8bcf-ed9e1f21852e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 189, 'network_id': 'f2713fc5-675f-44b2-b65c-0a083f1c207a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:33.799906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: f2713fc5-675f-44b2-b65c-0a083f1c207a, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:33.821738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:33.832873 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:33.841583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:33.848967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:33.850509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.861997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network f2713fc5-675f-44b2-b65c-0a083f1c207a is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:33.871112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, f2713fc5-675f-44b2-b65c-0a083f1c207a) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:33.875973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:33.876797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.884176 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-48fbc478-f354-4f6f-b9da-2672aa0e3a2f tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1449 time: 3.4674673 Nov 24 04:12:33.888777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33028) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:33.894954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.909264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.948608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=558d0703-e628-4b77-8479-c6f15ad57e5f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:33.950902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33030) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:33.964699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-488d8996-6e05-4d0d-95dd-064a3e5f5003 None None] Network aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:33.967117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9eb2f615-ba9b-4d3b-b289-2ee9cb28828d None None] Network f2713fc5-675f-44b2-b65c-0a083f1c207a requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:33.971772 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2e6bff48-ddd7-4268-872c-1ec12e52c0fd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 1.5579951 Nov 24 04:12:33.972391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33034) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:33.991359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:33.998998 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c135353f-38aa-44a4-a6c7-f4787aabdec0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.5674896 Nov 24 04:12:34.009810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33036) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:34.017165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '558d0703-e628-4b77-8479-c6f15ad57e5f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:34.020882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.028543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.117177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.213976 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=156ac190-86bf-4a9d-9929-0d063229f101,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:34.230725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:34.231088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-38fd3b85-02ce-4617-9ab6-f280c73c7497 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:34.247913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d21e47-2135-40d8-a2bf-d48ef8bcbfb8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:34.269876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d21e47-2135-40d8-a2bf-d48ef8bcbfb8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:34.275795 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-52d21e47-2135-40d8-a2bf-d48ef8bcbfb8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1444 time: 0.3857491 Nov 24 04:12:34.279023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33040) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:34.306411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=ae19df28-b4dc-4543-a27d-e26e7c450f42,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:34.356486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network db88bd2b-781c-4449-a342-faf837b9a6c2 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:34.363898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:34.397271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33042) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:34.443537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.449351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:34.449842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.498673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1662488929', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:34.509645 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-833588258'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:34.520340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.552325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:34.611725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Deleting port f7b9a3cc-af90-4bd0-8cca-21e27c55f662 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:34.612088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.646586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e154c775-302f-4a68-87a6-09fd478f6bcd None None] Network db88bd2b-781c-4449-a342-faf837b9a6c2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:34.650329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.654389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:34.657357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.663764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:34.668647 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cb9eaae5-d2a9-4a98-9226-d8a9314ed7e0 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1927881 Nov 24 04:12:34.675940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33046) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:34.681584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'network': {'name': 'tempest-RoutersTest-1018738392'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:34.683841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.690054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfb77ebe-da1c-48a0-8bdd-133d58a3baa0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-f2713fc5-675f-44b2-b65c-0a083f1c207a', 'network_id': 'f2713fc5-675f-44b2-b65c-0a083f1c207a', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': 'de8f6d08-3efc-4992-a3ce-4503c1f45205'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:34.690949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bfb77ebe-da1c-48a0-8bdd-133d58a3baa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.693857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.704115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:34.745638 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.773429 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:34.777443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.781718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c838ba3-3776-4a2b-ae0f-ecebc3ce2b43,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:34.787652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.792430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.793247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.812427 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] vlan segment allocate from pool success with {'vlan_id': 178, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:34.817930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:34.818608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:34.821588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.825394 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-de9656f3-b0af-470b-a6bc-42ef572bad81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8101728 Nov 24 04:12:34.825779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33048) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:34.832544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Calling delete_port for f7b9a3cc-af90-4bd0-8cca-21e27c55f662 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:34.833187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '558d0703-e628-4b77-8479-c6f15ad57e5f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:34.866023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.866461 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added segment d20f6367-c2a9-4789-87a8-61c4756461d7 of type vlan for network e61bd646-fcd7-4a33-a97e-24f14536e4b7 Nov 24 04:12:34.886510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.951468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.955914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:34.968555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.023661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.030464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:35.031208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.040356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=de8f6d08-3efc-4992-a3ce-4503c1f45205,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.069012 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fb4f7464-8074-4ed2-b681-4f23ed31c912 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.092114 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4147799 Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server [None req-bfb77ebe-da1c-48a0-8bdd-133d58a3baa0 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet de8f6d08-3efc-4992-a3ce-4503c1f45205: This subnet is being modified by another concurrent operation. Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 295, in create_dhcp_port Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 115, in _port_action Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:35.109730 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exception Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet de8f6d08-3efc-4992-a3ce-4503c1f45205: This subnet is being modified by another concurrent operation. Nov 24 04:12:35.113223 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:12:35.120020 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:35.123846 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33050) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:35.145140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.152836 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'subnet': {'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:35.161684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.190886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6b84891c-e073-40c7-a287-b35f1e020975 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:35.193452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df5a08c6-d87b-4c69-a23e-ebc4fb4a7176 None None] Network f2713fc5-675f-44b2-b65c-0a083f1c207a requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:35.222863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b1e82735-6c13-48c6-b525-0a5d0e34f4fc,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.225289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14d37b6e-daff-4775-94e8-a77acac54309 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Network': ['ID=e61bd646-fcd7-4a33-a97e-24f14536e4b7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.234822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.238194 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-be61fb38-5cbd-494d-ba81-66784803bcc0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4089615 Nov 24 04:12:35.240921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33052) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:35.246458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '558d0703-e628-4b77-8479-c6f15ad57e5f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:35.257749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.280188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.287759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:35.318653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-07147045-a7b5-49c8-83d9-671751e14035 None None] Provisioning complete for port 6b84891c-e073-40c7-a287-b35f1e020975 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:35.318940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-07147045-a7b5-49c8-83d9-671751e14035 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.343114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.347357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.371055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.375222 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1304157 Nov 24 04:12:35.375222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33054) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:35.380236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '558d0703-e628-4b77-8479-c6f15ad57e5f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:35.386748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f05d2b-6975-4815-90f5-993ada7761f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba41053c-6087-4f21-a35a-e91cf26ba652,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.413478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.484194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.489260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.515903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e84c91a4-ad4e-4dd3-afd6-a60cb7b51682,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.522974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.527535 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-be1d491c-c7bc-4ff0-b97e-132c39dedc1f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1511497 Nov 24 04:12:35.528220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33056) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:35.532810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '558d0703-e628-4b77-8479-c6f15ad57e5f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:35.560624 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:12:35.567002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.593880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6b84891c-e073-40c7-a287-b35f1e020975 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:35.594478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.619551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.636751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.642137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.667359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=85c56213-1602-4fac-9784-f5d7bbf3962c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.672158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.680107 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.681434 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b0b085bf-4cc6-42de-aaeb-cecabeea148a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1521947 Nov 24 04:12:35.685390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33058) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:35.686880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.690109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '558d0703-e628-4b77-8479-c6f15ad57e5f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:35.724639 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:12:35.730697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Port': ['ID=f7b9a3cc-af90-4bd0-8cca-21e27c55f662,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.730917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.764812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.773303 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f2713fc5-675f-44b2-b65c-0a083f1c207a']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:35.789844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d8f67ce-aeb1-4f0d-8bcf-ed9e1f21852e') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:35.790317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d8f67ce-aeb1-4f0d-8bcf-ed9e1f21852e') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:35.801487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.806823 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f5db9be0-a2f9-4d9c-8aa5-b932503cfd13 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/ports/f7b9a3cc-af90-4bd0-8cca-21e27c55f662 HTTP/1.1" status: 204 len: 168 time: 1.5246446 Nov 24 04:12:35.821143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.822062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33062) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:35.834013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.856009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.871445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Made reservation on behalf of fe0b1da3a1fe4ad9887be34e62b78e30 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:35.878006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.892043 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-07147045-a7b5-49c8-83d9-671751e14035 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.911222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 181, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:35.916132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f418358f-b5b5-4d9a-bb6e-7eef55637afc,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.949826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.950842 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-243730a7-aa35-4514-855c-c85061dc4f5e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2644553 Nov 24 04:12:35.956200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.962676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-07147045-a7b5-49c8-83d9-671751e14035 None None] For port 6b84891c-e073-40c7-a287-b35f1e020975, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6b84891c-e073-40c7-a287-b35f1e020975,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:35.973329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=114d374f-a6bc-4ede-ba64-5820d0a0a2d4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:35.975108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-07147045-a7b5-49c8-83d9-671751e14035 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.994509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:35.994858 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment b386343f-6228-4702-a514-5fe49462e4e7 of type vlan for network 721c2ec6-3abd-47ff-80e2-24b3c8106daa Nov 24 04:12:35.999807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 189 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:36.000469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:36.011893 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:36.024206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Deleting port a18c5aaf-aa36-4563-8fc6-08053f4be9e4 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:36.024837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.092835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:36.153146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:36.153513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Updating router af1bca15-198f-4ff7-9729-e777368c7abb port 156ac190-86bf-4a9d-9929-0d063229f101 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:36.155165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.160998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07147045-a7b5-49c8-83d9-671751e14035 None None] Pushing event updated for resources: {'Port': ['ID=6b84891c-e073-40c7-a287-b35f1e020975,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:36.174828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Calling delete_port for a18c5aaf-aa36-4563-8fc6-08053f4be9e4 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:36.204405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.205896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ae19df28-b4dc-4543-a27d-e26e7c450f42 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:36.226706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.241538 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.243422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-abd719cc-a219-401b-aa1a-ead88161e5bf None None] Provisioning complete for port 6b84891c-e073-40c7-a287-b35f1e020975 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:36.243795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-abd719cc-a219-401b-aa1a-ead88161e5bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.259642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.262885 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/f2713fc5-675f-44b2-b65c-0a083f1c207a HTTP/1.1" status: 204 len: 168 time: 2.2823420 Nov 24 04:12:36.266054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e98070-aced-4296-8b0d-9f1ffe20fad2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=f2713fc5-675f-44b2-b65c-0a083f1c207a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:36.269273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33074) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:36.286615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1570571564'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:36.296322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.302011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:36.303119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.334068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.357730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.361598 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/ports/a18c5aaf-aa36-4563-8fc6-08053f4be9e4 HTTP/1.1" status: 204 len: 168 time: 0.5383439 Nov 24 04:12:36.367820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33082) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:36.438376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ae19df28-b4dc-4543-a27d-e26e7c450f42 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:36.438694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.462484 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-cf874ee6-678a-4353-82f9-7d98a8efa74f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1004657829&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.1511562 Nov 24 04:12:36.480482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:36.482124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48e1e117-6f8c-415c-85cf-d4e93554f157 None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:12:36.484307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.500279 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 2.0891101 Nov 24 04:12:36.500592 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d431b6c9-8110-4db8-9495-01e1cf677f01 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0422041 Nov 24 04:12:36.501207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7685ae9-d0e0-43f4-b328-ad971a556574 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Port': ['ID=a18c5aaf-aa36-4563-8fc6-08053f4be9e4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:36.503052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33084) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:36.503322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33086) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:36.509967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8afc3a3-c25f-4c6b-b509-7291c034e211 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=721c2ec6-3abd-47ff-80e2-24b3c8106daa,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:36.529362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'name': 'tempest-PortsIpV6TestJSON-1710506874'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:36.538063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-59665379'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:36.542172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:36.658860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 162, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:36.661091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.709989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.714607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-abd719cc-a219-401b-aa1a-ead88161e5bf None None] Provisioning complete for port 156ac190-86bf-4a9d-9929-0d063229f101 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:36.715130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-abd719cc-a219-401b-aa1a-ead88161e5bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.715642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Subnet': ['ID=c3fd3c3f-6c82-4a68-b025-36e5ef24fc50,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:36.742882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.749480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.749480 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment f4c75838-5dc1-4694-aa91-a778cd8722c0 of type vlan for network c2c2b239-4c2c-49cf-9332-16f01d392b00 Nov 24 04:12:36.781487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:36.783797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.830047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-abd719cc-a219-401b-aa1a-ead88161e5bf None None] Port 156ac190-86bf-4a9d-9929-0d063229f101 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:36.837093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0c9b8909-e5fb-43f0-ac11-1413609fa26f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:36.841169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-1a1918fb-e1f5-46a5-a8b3-4e5ed03185d6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:36.843170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.848512 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-1a1918fb-e1f5-46a5-a8b3-4e5ed03185d6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 797 time: 0.3512661 Nov 24 04:12:36.858231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:36.862021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.872074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Checking segment: {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:36.872767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network hostable DHCP agents. Network: e61bd646-fcd7-4a33-a97e-24f14536e4b7, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:36.875344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48e1e117-6f8c-415c-85cf-d4e93554f157 None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:12:36.879451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] vlan segment allocate from pool success with {'vlan_id': 185, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:36.887626 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-c62aa7a3-b90b-4dad-a05d-12121028e964 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0381711 Nov 24 04:12:36.926381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.932392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:36.933107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.942101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.954561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.954950 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Added segment d63423fb-10ff-4499-abc3-993b7237aad7 of type vlan for network dc4c6238-6058-4727-b152-d479a9bf13dd Nov 24 04:12:36.973505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port f856284c-e3d7-42b5-b16f-4799edadaa2e yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:36.976308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:36.976974 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7050133 Nov 24 04:12:36.986362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33090) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:37.001808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': 'c2c2b239-4c2c-49cf-9332-16f01d392b00', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:37.031027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:37.045188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Allocated IP 172.26.5.11 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/8f3551b8-985b-4b0b-b06f-81bbca0b9582) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:37.079226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 0c9b8909-e5fb-43f0-ac11-1413609fa26f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:37.079619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.085592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-94054bd6-f486-4a47-bc5c-79b09f0d817c None None] Provisioning complete for port 156ac190-86bf-4a9d-9929-0d063229f101 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:37.085968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-94054bd6-f486-4a47-bc5c-79b09f0d817c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.104796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, e61bd646-fcd7-4a33-a97e-24f14536e4b7) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:37.110270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1780705-50b4-4f63-9233-3b821a20c718 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=c2c2b239-4c2c-49cf-9332-16f01d392b00,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:37.141686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a099e203-f561-425f-99cd-6a9842b0ba7a None None] Pushing event updated for resources: {'Port': ['ID=156ac190-86bf-4a9d-9929-0d063229f101,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:37.149400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network c2c2b239-4c2c-49cf-9332-16f01d392b00 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:37.167180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:37.168237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.256877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-94054bd6-f486-4a47-bc5c-79b09f0d817c None None] Port 156ac190-86bf-4a9d-9929-0d063229f101 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:37.265326 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-204f0429-187b-42d2-9f4f-ea8a747c5058 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1336818 Nov 24 04:12:37.268325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33092) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:37.335096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Attempting to bind port 156ac190-86bf-4a9d-9929-0d063229f101 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:37.335481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Attempting to bind port 156ac190-86bf-4a9d-9929-0d063229f101 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:37.335854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Attempting to bind port 156ac190-86bf-4a9d-9929-0d063229f101 on network db88bd2b-781c-4449-a342-faf837b9a6c2 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:37.346835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:37.346835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Checking segment: {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:37.347194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.347806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Bound using segment: {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:37.348037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Bound port: 156ac190-86bf-4a9d-9929-0d063229f101, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a637e051-f64d-4a8d-ab65-d3888c0c98a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 196, 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:37.348366 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.369594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:37.373801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.414685 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.429787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.441689 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-1e82ef35-c26c-41f0-8feb-3516ab2b82c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5532081 Nov 24 04:12:37.505578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] For port 156ac190-86bf-4a9d-9929-0d063229f101, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:37.508007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] For port 156ac190-86bf-4a9d-9929-0d063229f101, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=156ac190-86bf-4a9d-9929-0d063229f101,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:37.515619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.559014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.566848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:37.567367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baebce9f-ae33-4c2d-8081-ad172570eae9 None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:12:37.568041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.603482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a099e203-f561-425f-99cd-6a9842b0ba7a None None] Pushing event updated for resources: {'Port': ['ID=156ac190-86bf-4a9d-9929-0d063229f101,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:37.610716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:37.611351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:37.622249 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.1149607 Nov 24 04:12:37.630093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33094) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:37.643976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1304002341'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:37.701048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:37.705522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.748249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.751649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.762319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed25ffd1-4499-4b80-8e29-a87f803a1805 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Network': ['ID=dc4c6238-6058-4727-b152-d479a9bf13dd,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:37.776201 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-b5e34cb4-757d-48cd-a9cb-7b5e918aed5c service neutron] 10.222.0.48 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3126843 Nov 24 04:12:37.836421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6b84891c-e073-40c7-a287-b35f1e020975 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:37.838428 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network dc4c6238-6058-4727-b152-d479a9bf13dd details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:37.878717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:37.879655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] vlan segment allocate from pool success with {'vlan_id': 151, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:37.883916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.900813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:37.903324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:37.915972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event updated for resources: {'Port': ['ID=8f3551b8-985b-4b0b-b06f-81bbca0b9582,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:37.934888 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-a50d6451-06f1-4c9c-92b9-337d796d0e0d service neutron] 10.222.0.48 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1578071 Nov 24 04:12:37.965621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=f856284c-e3d7-42b5-b16f-4799edadaa2e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:37.986448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:37.997750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:37.998086 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Added segment ed589798-187b-4d7c-8815-dd5c0a1b7411 of type vlan for network 63a5332b-50a8-4442-a40c-b4de62d102e0 Nov 24 04:12:38.009242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': 'b386343f-6228-4702-a514-5fe49462e4e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:38.009729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: 721c2ec6-3abd-47ff-80e2-24b3c8106daa, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:38.043712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:38.058090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6ab619c7-06e1-4f4e-84ef-fa10ef62cad7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.069134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 721c2ec6-3abd-47ff-80e2-24b3c8106daa) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:38.093347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:38.105491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:38.106338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.126305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.141080 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca3e7db3-a2f2-421f-abb7-7e1ed209cd58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.6355674 Nov 24 04:12:38.144349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33100) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:38.150621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1722806019'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:38.177767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:38.177980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6b84891c-e073-40c7-a287-b35f1e020975 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:38.178401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.181826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baebce9f-ae33-4c2d-8081-ad172570eae9 None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:12:38.182547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.212442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.215871 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-acd8f651-7e50-441a-9ee5-c7f35c513eef req-52b046ab-022b-4d1c-bc6b-da0528ee254c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 210 time: 0.0971293 Nov 24 04:12:38.224422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 170, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:38.240602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.240955 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment f961bf77-b600-4c30-844b-eed3be390210 of type vlan for network 9909b741-33ed-4d17-b722-a1f694779b57 Nov 24 04:12:38.285696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.312893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.319824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:38.321140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.345179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.350732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:38.351475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.373253 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.2271273 Nov 24 04:12:38.373989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33106) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:38.410857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'ports': [{'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'}, {'network_id': '9909b741-33ed-4d17-b722-a1f694779b57'}]} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:38.411254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:38.411855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '9909b741-33ed-4d17-b722-a1f694779b57'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:38.434561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99924179-aab3-4dce-a163-77ac301095b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=9909b741-33ed-4d17-b722-a1f694779b57,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:38.519628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 9909b741-33ed-4d17-b722-a1f694779b57 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:38.600168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 2} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:38.605569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.621941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.719972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.728246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 62504180-e7d4-4b90-a0a1-76a04b89d229 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:38.756882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=21e7a64c-a3cc-4963-ab25-a5f6ffaf3ff3,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:38.784338 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.1508963 Nov 24 04:12:38.788435 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.832799 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:37Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:38.852189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddcb5cd-e39d-4d94-ade6-60d871b8e1a8 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Network': ['ID=63a5332b-50a8-4442-a40c-b4de62d102e0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:38.863951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': 'f4c75838-5dc1-4694-aa91-a778cd8722c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 162, 'network_id': 'c2c2b239-4c2c-49cf-9332-16f01d392b00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:38.865527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: c2c2b239-4c2c-49cf-9332-16f01d392b00, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:38.877048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eefaa92-074d-4619-8c2f-42dff85cebf7 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:37Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:38.879041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:38.880073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:38.902592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 63a5332b-50a8-4442-a40c-b4de62d102e0 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:39.034605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.082089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network c2c2b239-4c2c-49cf-9332-16f01d392b00 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:39.104486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, c2c2b239-4c2c-49cf-9332-16f01d392b00) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:39.118612 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:39.119459 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.161243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port b32a2083-392f-49ee-8e6b-66adfdf1113d yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:39.247002 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cfdbb394-baa3-4f2f-9e5b-6b5c6d0e187b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 2.2592018 Nov 24 04:12:39.252219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33112) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:39.275593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Allocated IP 172.23.0.2 (e61bd646-fcd7-4a33-a97e-24f14536e4b7/c3fd3c3f-6c82-4a68-b025-36e5ef24fc50/8c0f3081-b14f-4a8c-97cb-7080a442f371) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:39.339426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.627228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.645607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.731816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 156ac190-86bf-4a9d-9929-0d063229f101 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:39.770184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-b524ca02-af81-4520-ac1c-c8dfc11aad20 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:39.772903 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-b524ca02-af81-4520-ac1c-c8dfc11aad20 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 797 time: 0.3379960 Nov 24 04:12:39.776553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.812250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.876724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:39.877058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:39.893930 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aa9c1272-54b1-4848-8278-befef3d3d769 req-6b57bb48-61d2-415c-8c7c-1406c167c9a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 210 time: 0.1197283 Nov 24 04:12:39.918234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:39.923836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:39.936291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:39.937314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:39.946090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:39.973278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Pushing event updated for resources: {'Port': ['ID=8c0f3081-b14f-4a8c-97cb-7080a442f371,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.012474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Allocated IP 172.23.0.1 (e61bd646-fcd7-4a33-a97e-24f14536e4b7/c3fd3c3f-6c82-4a68-b025-36e5ef24fc50/95413140-775e-498b-af60-54ee10e12e3b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:40.013935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=62504180-e7d4-4b90-a0a1-76a04b89d229,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.040933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Attempting to bind port 8c0f3081-b14f-4a8c-97cb-7080a442f371 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:40.041318 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Attempting to bind port 8c0f3081-b14f-4a8c-97cb-7080a442f371 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:40.041691 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Attempting to bind port 8c0f3081-b14f-4a8c-97cb-7080a442f371 on network e61bd646-fcd7-4a33-a97e-24f14536e4b7 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:40.052208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:40.052384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Checking segment: {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:40.052738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.053148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Bound using segment: {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:40.053614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Bound port: 8c0f3081-b14f-4a8c-97cb-7080a442f371, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:40.054377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.065677 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-b3884eee-1591-4319-be13-5bb1b2d22d8a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 380 time: 0.2695765 Nov 24 04:12:40.089415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['558d0703-e628-4b77-8479-c6f15ad57e5f']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:40.116668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 156ac190-86bf-4a9d-9929-0d063229f101 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:40.117080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.158541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': 'f961bf77-b600-4c30-844b-eed3be390210', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '9909b741-33ed-4d17-b722-a1f694779b57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:40.159041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: 9909b741-33ed-4d17-b722-a1f694779b57, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:40.166198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=b32a2083-392f-49ee-8e6b-66adfdf1113d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.178025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] For port 8c0f3081-b14f-4a8c-97cb-7080a442f371, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:40.181438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] For port 8c0f3081-b14f-4a8c-97cb-7080a442f371, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c0f3081-b14f-4a8c-97cb-7080a442f371,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:40.185904 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.191357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.239497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.292280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.297937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 9909b741-33ed-4d17-b722-a1f694779b57 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:40.301626 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6df45a-79db-49c5-b390-c6c6e81c3ebc None None] Pushing event updated for resources: {'Port': ['ID=8c0f3081-b14f-4a8c-97cb-7080a442f371,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.322512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 9909b741-33ed-4d17-b722-a1f694779b57) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:40.332806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:40.347188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:40.353352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:40.354583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.365880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.414616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 156ac190-86bf-4a9d-9929-0d063229f101, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=156ac190-86bf-4a9d-9929-0d063229f101,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:40.414960 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-57ff5760-da1d-45c3-84e3-72a21311fa74 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.0338378 Nov 24 04:12:40.419010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33118) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:40.420160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.451562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.494741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=156ac190-86bf-4a9d-9929-0d063229f101,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.527122 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=95413140-775e-498b-af60-54ee10e12e3b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.541449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:40.556779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:40.556779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.581770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:40.605405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:40.628246 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.720559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.757383 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port b32a2083-392f-49ee-8e6b-66adfdf1113d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:40.757989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.792603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=21e7a64c-a3cc-4963-ab25-a5f6ffaf3ff3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:40.815715 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.860629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.872663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.12 (becef48c-b834-483b-91dc-0f71ec58e834/c4348623-9729-4d15-a5cf-803eac33880a/9f1b668f-dd92-42dc-9d4b-55596d7ec904) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:40.884938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:40.907762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for b32a2083-392f-49ee-8e6b-66adfdf1113d owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:41.015500 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.060178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.077611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c2c2b239-4c2c-49cf-9332-16f01d392b00']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:41.102381 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-223e8f7e-1c8a-4a19-baa8-af9358e89715 req-90f08fea-9db5-493d-b8f1-f152c3773731 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 210 time: 0.0661271 Nov 24 04:12:41.121479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.139255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f4c75838-5dc1-4694-aa91-a778cd8722c0') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:41.139255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f4c75838-5dc1-4694-aa91-a778cd8722c0') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:41.142030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.156088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.167435 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.198279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=b32a2083-392f-49ee-8e6b-66adfdf1113d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:41.198486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.208019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.214752 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-85a0575c-1512-41fb-ad90-0547ef8d35e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/b32a2083-392f-49ee-8e6b-66adfdf1113d HTTP/1.1" status: 204 len: 168 time: 0.7888529 Nov 24 04:12:41.216616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33122) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:41.247187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network becef48c-b834-483b-91dc-0f71ec58e834 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:41.250960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.262620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 162 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:41.263381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.266618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:41.276486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:41.314527 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:41.317023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=9f1b668f-dd92-42dc-9d4b-55596d7ec904,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:41.343942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:41.344565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.357185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e14b05a-2c08-4fca-898b-0b1acc246ef8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:41.363690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e14b05a-2c08-4fca-898b-0b1acc246ef8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:41.367988 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0e14b05a-2c08-4fca-898b-0b1acc246ef8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1456 time: 0.1480815 Nov 24 04:12:41.368781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33124) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:41.402062 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-dec63bab-fd67-4498-b704-0aed2e7a0935 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3176148 Nov 24 04:12:41.417426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Request body: {'port': {'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:41.535439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.593720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 62504180-e7d4-4b90-a0a1-76a04b89d229 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:41.594060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.739454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b7754ac-6d5a-42d0-8426-3cfa5d9d6cc0 None None] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:41.772629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2e5d88c-6080-41b4-b9de-1b1432c4f201 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:41.777840 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a782549-93a8-46b8-bf05-d24fd6561bee None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:41.788782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.803109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69076285-aa61-4828-b346-4f4c6176aaf2 None None] Network c2c2b239-4c2c-49cf-9332-16f01d392b00 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:41.812276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08f205d9-86f7-4da3-b6c6-b1379a0b833f None None] Network 9909b741-33ed-4d17-b722-a1f694779b57 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:41.819877 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.832132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:41.837005 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/c2c2b239-4c2c-49cf-9332-16f01d392b00 HTTP/1.1" status: 204 len: 168 time: 2.5824289 Nov 24 04:12:41.837732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Router 8752bfb1-3ff0-4d45-91ca-40435e422682 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:41.840904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33126) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:41.860343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1576577647'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:41.872235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 156ac190-86bf-4a9d-9929-0d063229f101 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:41.872752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 62504180-e7d4-4b90-a0a1-76a04b89d229 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:41.973654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69076285-aa61-4828-b346-4f4c6176aaf2 None None] Network c2c2b239-4c2c-49cf-9332-16f01d392b00 could not be found, it might have been deleted concurrently. {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 24 04:12:42.012260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c1a1061-da71-4f3f-9d36-15d11cffb32f None None] Network c2c2b239-4c2c-49cf-9332-16f01d392b00 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:42.065073 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33128) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:42.073015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'subnets': [{'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--753063612', 'ip_version': 6}, {'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:42.073333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'subnet': {'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--753063612', 'ip_version': 6}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:42.074021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Request body: {'subnet': {'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:42.378832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9f1b668f-dd92-42dc-9d4b-55596d7ec904 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:12:42.397954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.412617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.414887 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c1a1061-da71-4f3f-9d36-15d11cffb32f None None] Network c2c2b239-4c2c-49cf-9332-16f01d392b00 could not be found, it might have been deleted concurrently. {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 24 04:12:42.430635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-68392504-5b9d-4325-ab56-3457b92f9205 None None] Provisioning complete for port 8c0f3081-b14f-4a8c-97cb-7080a442f371 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:42.431483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-68392504-5b9d-4325-ab56-3457b92f9205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.434712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:42.438406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.465400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b4f6b6-674d-4605-a89f-4234626d5bd1 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=c2c2b239-4c2c-49cf-9332-16f01d392b00,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:42.476200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=62504180-e7d4-4b90-a0a1-76a04b89d229,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:42.483879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Transition to ACTIVE for port object 9f1b668f-dd92-42dc-9d4b-55596d7ec904 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:12:42.496739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.540756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 156ac190-86bf-4a9d-9929-0d063229f101 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:42.540756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.542367 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 195, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:42.550248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.564904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.565421 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 6f52c127-52f9-43f4-9e06-d7742a6e53ad of type vlan for network 1bc54576-d6fb-4dd7-9025-7e058230420c Nov 24 04:12:42.568481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.713898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-68392504-5b9d-4325-ab56-3457b92f9205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.733078 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.742966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event updated for resources: {'Port': ['ID=95413140-775e-498b-af60-54ee10e12e3b,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:42.751211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.761602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c0f3081-b14f-4a8c-97cb-7080a442f371 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:42.779152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.785054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.795094 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6b89093d-e6b1-4585-9921-2f9dc6193eb5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/62504180-e7d4-4b90-a0a1-76a04b89d229 HTTP/1.1" status: 204 len: 168 time: 1.4192176 Nov 24 04:12:42.795449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-68392504-5b9d-4325-ab56-3457b92f9205 None None] For port 8c0f3081-b14f-4a8c-97cb-7080a442f371, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c0f3081-b14f-4a8c-97cb-7080a442f371,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:42.800960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33132) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:42.803977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-68392504-5b9d-4325-ab56-3457b92f9205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.841394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:42.852335 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] Sync routers for ids ['8752bfb1-3ff0-4d45-91ca-40435e422682'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:42.876624 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] Routers {'8752bfb1-3ff0-4d45-91ca-40435e422682'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:42.877909 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8752bfb1-3ff0-4d45-91ca-40435e422682'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:42.882467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15df157-e6e2-414b-8ecb-7be7ee4c90b4 req-31117e13-5c48-47d3-8f8c-6fcae2f8d6b0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:42.885194 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.889004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68392504-5b9d-4325-ab56-3457b92f9205 None None] Pushing event updated for resources: {'Port': ['ID=8c0f3081-b14f-4a8c-97cb-7080a442f371,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:42.889159 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d15df157-e6e2-414b-8ecb-7be7ee4c90b4 req-31117e13-5c48-47d3-8f8c-6fcae2f8d6b0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 932 time: 0.6022515 Nov 24 04:12:42.890313 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3e9e104b-759b-45f7-b7e2-a6ca4e13b943 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 8.9363632 Nov 24 04:12:42.891106 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33134) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:42.895504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8c0f3081-b14f-4a8c-97cb-7080a442f371 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:42.896420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.902106 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.908117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:42.909365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:42.967589 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:42.989958 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] Routers {'8752bfb1-3ff0-4d45-91ca-40435e422682'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:42.990779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9e812596-7e61-48a7-b000-2dd111ad0289 None None] Provisioning complete for port 8f3551b8-985b-4b0b-b06f-81bbca0b9582 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:42.991001 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8752bfb1-3ff0-4d45-91ca-40435e422682'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:42.991159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9e812596-7e61-48a7-b000-2dd111ad0289 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.000868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Pushing event updated for resources: {'Port': ['ID=9f1b668f-dd92-42dc-9d4b-55596d7ec904,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:43.073015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9e812596-7e61-48a7-b000-2dd111ad0289 None None] Port 8f3551b8-985b-4b0b-b06f-81bbca0b9582 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:43.090408 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d15df157-e6e2-414b-8ecb-7be7ee4c90b4 req-3273d705-cd8a-427c-8149-d2f9975f48cc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1533713 Nov 24 04:12:43.097768 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:43.098474 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d4fdd59-d508-47db-bdeb-3b0823b50c9e None None] The sync data for ids ['8752bfb1-3ff0-4d45-91ca-40435e422682'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:43.107586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Made reservation on behalf of 6ded641f952546eabaf98ac1479dfec9 for: {'subnet': 2} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:43.117248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.117877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.143946 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.2941599 Nov 24 04:12:43.144638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b13902ec-c922-4d31-b1ac-6ecabbd1a80e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:43.145040 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33136) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.147071 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b13902ec-c922-4d31-b1ac-6ecabbd1a80e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.3200014 Nov 24 04:12:43.148107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:43.155533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9e812596-7e61-48a7-b000-2dd111ad0289 None None] Provisioning complete for port 156ac190-86bf-4a9d-9929-0d063229f101 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:43.156103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9e812596-7e61-48a7-b000-2dd111ad0289 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.164294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33138) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.165699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:43.169115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a75d8b-1e3a-4a7b-91a3-508332c7cdbc tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=1bc54576-d6fb-4dd7-9025-7e058230420c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:43.187189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 1bc54576-d6fb-4dd7-9025-7e058230420c details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:43.221959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:43.233933 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-22cf3c4c-b589-45a9-8ced-d3137f8718d6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:12:43.235780 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-22cf3c4c-b589-45a9-8ced-d3137f8718d6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/b32a2083-392f-49ee-8e6b-66adfdf1113d HTTP/1.1" status: 404 len: 333 time: 0.0693390 Nov 24 04:12:43.242387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33140) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.337883 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-41b9ec9c-aa0a-4d1e-8a0a-f126845b17e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:12:43.339616 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-41b9ec9c-aa0a-4d1e-8a0a-f126845b17e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/62504180-e7d4-4b90-a0a1-76a04b89d229 HTTP/1.1" status: 404 len: 333 time: 0.0959201 Nov 24 04:12:43.345420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33142) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.394958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Attempting to bind port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:43.395412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Attempting to bind port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:43.396515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Attempting to bind port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 on network becef48c-b834-483b-91dc-0f71ec58e834 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:43.436727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 on network becef48c-b834-483b-91dc-0f71ec58e834 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:12:43.437189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Attempting to bind port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 on network becef48c-b834-483b-91dc-0f71ec58e834 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:43.441221 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-88d6efc8-f7c6-4f42-a287-ca1df6055846 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/8752bfb1-3ff0-4d45-91ca-40435e422682 HTTP/1.1" status: 200 len: 924 time: 0.5439937 Nov 24 04:12:43.442304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33144) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.457405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:43.457803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Checking segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:43.458731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Bound using segment: {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:43.459178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Bound port: 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '30f1aa6c-2278-4dd6-a015-c8daf36f40bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:43.459538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.478367 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:43.482713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.487543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.493516 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d7492946-0a48-4e63-936b-5a2a3e003b44 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=8752bfb1-3ff0-4d45-91ca-40435e422682 HTTP/1.1" status: 200 len: 205 time: 0.0432198 Nov 24 04:12:43.505191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33146) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.585745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c0f3081-b14f-4a8c-97cb-7080a442f371 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:43.616120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:43.617283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8f6c6b0-5955-4f8d-93cc-e73323135a7c None None] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:43.724744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8c0f3081-b14f-4a8c-97cb-7080a442f371 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:43.725104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.730482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ec94898b-b434-40bc-ad37-88ff0fc27707 None None] Provisioning complete for port 95413140-775e-498b-af60-54ee10e12e3b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:43.730811 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ec94898b-b434-40bc-ad37-88ff0fc27707 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.734127 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.769295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.777765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9909b741-33ed-4d17-b722-a1f694779b57']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:43.809628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] For port 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:43.813351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f961bf77-b600-4c30-844b-eed3be390210') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:43.813812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f961bf77-b600-4c30-844b-eed3be390210') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:43.833643 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ec94898b-b434-40bc-ad37-88ff0fc27707 None None] Port 95413140-775e-498b-af60-54ee10e12e3b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:43.841858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] For port 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:43.845578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.859830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:43.871973 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-70beea2f-f61e-4dbc-be9c-7e50df485edf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5999808 Nov 24 04:12:43.874094 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33148) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:43.876157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:43.880709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ec94898b-b434-40bc-ad37-88ff0fc27707 None None] Provisioning complete for port 8c0f3081-b14f-4a8c-97cb-7080a442f371 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:43.881192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ec94898b-b434-40bc-ad37-88ff0fc27707 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.887312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:43.910479 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:43.956568 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:43.957385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:43.998498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Pushing event updated for resources: {'Port': ['ID=9f1b668f-dd92-42dc-9d4b-55596d7ec904,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:44.008927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.020517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 170 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:44.021516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:44.033775 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:44.042681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.056738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:44.057381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.059679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.060192 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-5c8d2361-4389-4e1e-b534-26e92ef9dcb5 service neutron] 10.222.0.21 "PUT /v2.0/ports/9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 200 len: 1094 time: 2.6470454 Nov 24 04:12:44.060678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:12:44.065042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ac94c2b-b556-47cb-8aa0-102eac15b87d" -d '{"events": [{"name": "network-changed", "server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:12:44.072973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:44.214455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:12:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89197632-2043-47fa-884b-edd70fad8a58 x-openstack-request-id: req-89197632-2043-47fa-884b-edd70fad8a58 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:12:44.214822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:12:44.215038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-89197632-2043-47fa-884b-edd70fad8a58 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:12:44.215397 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'status': 'completed', 'code': 200} Nov 24 04:12:44.298142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.336321 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.337691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=a2a43892-53f4-43ea-9a62-bf78cb8b2339,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:44.343804 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/9909b741-33ed-4d17-b722-a1f694779b57 HTTP/1.1" status: 204 len: 168 time: 0.9926493 Nov 24 04:12:44.369711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33154) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:44.373510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '6f52c127-52f9-43f4-9e06-d7742a6e53ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:44.374536 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-053d71aa-e595-446e-98da-2d269286f65f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:44.374913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: 1bc54576-d6fb-4dd7-9025-7e058230420c, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:44.375901 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-053d71aa-e595-446e-98da-2d269286f65f service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1097 time: 0.2490509 Nov 24 04:12:44.380592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-565485947'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:44.415850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b54a52d-e48c-4cda-ad94-aaf47af01e5b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=9909b741-33ed-4d17-b722-a1f694779b57,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:44.472484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:41Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '95413140-775e-498b-af60-54ee10e12e3b', 'name': '', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:61:bc:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 914, 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:39Z', 'updated_at': '2021-11-24T04:12:41Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:44.486619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Deleting port 8f3551b8-985b-4b0b-b06f-81bbca0b9582 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:44.486619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.507866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network 1bc54576-d6fb-4dd7-9025-7e058230420c is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:44.529001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 1bc54576-d6fb-4dd7-9025-7e058230420c) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:44.554653 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-039193ae-6ece-4508-a0f0-6b43649a1661 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 200 len: 217 time: 0.1488190 Nov 24 04:12:44.557801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:44.558529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.564277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.597697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d530a411-aec7-4cfc-b5bb-200b7bd4cab4 req-0048a486-8c52-41fa-8bf7-c1cb6a0acb60 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:44.608023 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d530a411-aec7-4cfc-b5bb-200b7bd4cab4 req-0048a486-8c52-41fa-8bf7-c1cb6a0acb60 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 944 time: 0.3663232 Nov 24 04:12:44.635465 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0684291f-21d0-4cda-b4ae-96c186c9b088 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.4815891 Nov 24 04:12:44.652848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33156) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:44.671598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:44.675134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.675856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.685973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b66fced-bff9-493e-be9a-1a250d4c3432 None None] Network 1bc54576-d6fb-4dd7-9025-7e058230420c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:44.691638 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:44.692139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Updating router af1bca15-198f-4ff7-9729-e777368c7abb port 95413140-775e-498b-af60-54ee10e12e3b binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:44.719894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Calling delete_port for 8f3551b8-985b-4b0b-b06f-81bbca0b9582 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:44.763971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:44.776581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Subnet': ['ID=0158adbc-e057-42f3-ae1d-5fba08bb56c4,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:44.789541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-07b99fe7-a55e-465b-9f0e-ea4ef18288cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:44.790995 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-07b99fe7-a55e-465b-9f0e-ea4ef18288cc service neutron] 10.222.0.21 "GET /v2.0/subnets?id=c4348623-9729-4d15-a5cf-803eac33880a HTTP/1.1" status: 200 len: 834 time: 0.2212756 Nov 24 04:12:44.801389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-086d193d-fceb-480d-af91-5d9fd6990b3e None None] Provisioning complete for port 95413140-775e-498b-af60-54ee10e12e3b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:44.801655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-086d193d-fceb-480d-af91-5d9fd6990b3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.829797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.844199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.844199 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment 32776824-7f07-48ac-9d0c-b8db06ee43b9 of type vlan for network cb99ca22-1288-43f7-94f6-8dab93b0491e Nov 24 04:12:44.855746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d530a411-aec7-4cfc-b5bb-200b7bd4cab4 req-5acde2ef-fa4c-4258-941c-dcf3175098c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2462788 Nov 24 04:12:44.878527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added routes are [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 24 04:12:44.885865 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-086d193d-fceb-480d-af91-5d9fd6990b3e None None] Port 95413140-775e-498b-af60-54ee10e12e3b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:44.891381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.929599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-086d193d-fceb-480d-af91-5d9fd6990b3e None None] Provisioning complete for port 8c0f3081-b14f-4a8c-97cb-7080a442f371 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:44.930090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-086d193d-fceb-480d-af91-5d9fd6990b3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.930324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Removed routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 24 04:12:44.930732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.944858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Checking segment: {'id': 'd63423fb-10ff-4499-abc3-993b7237aad7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:44.945523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network hostable DHCP agents. Network: dc4c6238-6058-4727-b152-d479a9bf13dd, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:44.965859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:44.983318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-28df0175-a2a6-4a37-8efb-e44203214f69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:44.984961 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-28df0175-a2a6-4a37-8efb-e44203214f69 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=becef48c-b834-483b-91dc-0f71ec58e834&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1816938 Nov 24 04:12:45.008409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network dc4c6238-6058-4727-b152-d479a9bf13dd is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:45.074033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.084363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, dc4c6238-6058-4727-b152-d479a9bf13dd) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:45.095101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.100206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.106320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.107336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-556596'] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.119182 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-755a4f8a-4e94-48bc-9db9-d54772599d1e None None] Network dc4c6238-6058-4727-b152-d479a9bf13dd requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:45.195681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-1bc54576-d6fb-4dd7-9025-7e058230420c', 'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': 'a2a43892-53f4-43ea-9a62-bf78cb8b2339'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:45.196866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.249361 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-bef8d2c2-f038-425f-8689-c57a5d4a7c91 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2546446 Nov 24 04:12:45.252648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=cb99ca22-1288-43f7-94f6-8dab93b0491e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:45.279087 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-16da5609-67de-483f-a7f5-48c83d8e562b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.9059041 Nov 24 04:12:45.286996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33158) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:45.315371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network cb99ca22-1288-43f7-94f6-8dab93b0491e details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:45.319237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:45.329232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event updated for resources: {'Subnet': ['ID=3fb400a3-a8c8-4bcd-bfc4-4886354a2eeb,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:45.396831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Checking segment: {'id': 'ed589798-187b-4d7c-8815-dd5c0a1b7411', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:45.397191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network hostable DHCP agents. Network: 63a5332b-50a8-4442-a40c-b4de62d102e0, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:45.481048 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9a03c4c-ab47-4ebd-93ee-11c97c94e6f1 req-fe9f0ce0-be3e-40cc-870d-8d75a48cf0d3 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2186000 Nov 24 04:12:45.494764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Network 63a5332b-50a8-4442-a40c-b4de62d102e0 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:45.512514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:45.518280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.555363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.602134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-dc4c6238-6058-4727-b152-d479a9bf13dd', 'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd', 'tenant_id': '6ded641f952546eabaf98ac1479dfec9', 'fixed_ips': [{'subnet_id': '0158adbc-e057-42f3-ae1d-5fba08bb56c4'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:45.603014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.622279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Performing IP validity checks on allocation pools {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:12:45.625507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:12:45.640448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0e40695-8e56-43c9-b7b8-049075d6e2b6 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:45.642942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 63a5332b-50a8-4442-a40c-b4de62d102e0) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:45.648799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.648799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.649534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.655721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Allocated IP 172.20.0.1 (1bc54576-d6fb-4dd7-9025-7e058230420c/a2a43892-53f4-43ea-9a62-bf78cb8b2339/80a6f44d-922c-48a8-99fe-6f2237976b33) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:45.666882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.680435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event deleted for resources: {'Port': ['ID=8f3551b8-985b-4b0b-b06f-81bbca0b9582,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:45.714200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1d08afaa-97e4-46fa-9db6-77eae05f0fdc tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1475 time: 3.6442649 Nov 24 04:12:45.722366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33160) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:45.729195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c98ecce-24ce-42cf-96c6-05534e55d2d1 None None] Network 63a5332b-50a8-4442-a40c-b4de62d102e0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:45.731354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.785428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-f0d2c8d1-ea68-4e0c-b615-068434bec118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.787633 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-f0d2c8d1-ea68-4e0c-b615-068434bec118 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1097 time: 0.1185803 Nov 24 04:12:45.792539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.805227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.810588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.906665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.909075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.945280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c4327d-0fdc-4ed9-b51c-5fd83236ee9f None None] Pushing event updated for resources: {'Port': ['ID=95413140-775e-498b-af60-54ee10e12e3b,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:45.954333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfae25d2-de69-4f1e-a15f-e4b59563820b tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.956478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfae25d2-de69-4f1e-a15f-e4b59563820b tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.959188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfae25d2-de69-4f1e-a15f-e4b59563820b tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:45.961001 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dfae25d2-de69-4f1e-a15f-e4b59563820b tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2101 time: 0.2353699 Nov 24 04:12:45.963773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.964634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Fanout notify agent at l3_agent the message router_deleted on router 8752bfb1-3ff0-4d45-91ca-40435e422682 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:45.972704 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33164) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:45.983925 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:45.991616 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-561d68ef-c95c-4f33-8364-7dee736c99e4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/8752bfb1-3ff0-4d45-91ca-40435e422682 HTTP/1.1" status: 204 len: 168 time: 2.4855700 Nov 24 04:12:45.995329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-50ea1824-79c9-4c29-b0c1-18ea67753221 None None] Provisioning complete for port 95413140-775e-498b-af60-54ee10e12e3b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:45.995703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-50ea1824-79c9-4c29-b0c1-18ea67753221 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.009941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33166) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:46.101355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Allocated IP 2001:db8::1 (dc4c6238-6058-4727-b152-d479a9bf13dd/0158adbc-e057-42f3-ae1d-5fba08bb56c4/653f78a5-adff-407c-a3fd-a52cc22aa849) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:46.148146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1174715920', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': False}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:46.154430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Attempting to bind port 95413140-775e-498b-af60-54ee10e12e3b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:46.154801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Attempting to bind port 95413140-775e-498b-af60-54ee10e12e3b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:46.155361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Attempting to bind port 95413140-775e-498b-af60-54ee10e12e3b on network e61bd646-fcd7-4a33-a97e-24f14536e4b7 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:46.191793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:46.192166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Checking segment: {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:46.193111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.193504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Bound using segment: {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:46.194179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Bound port: 95413140-775e-498b-af60-54ee10e12e3b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd20f6367-c2a9-4789-87a8-61c4756461d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:46.194756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.197566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-50ea1824-79c9-4c29-b0c1-18ea67753221 None None] Port 95413140-775e-498b-af60-54ee10e12e3b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:46.210180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:46.224730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Deleting subnet 0158adbc-e057-42f3-ae1d-5fba08bb56c4 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:46.241124 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.242208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.258857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b976c7-9c43-49f9-bb25-d09799883cac req-613cba13-9920-424e-910e-1261a60aab46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:46.260426 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-58b976c7-9c43-49f9-bb25-d09799883cac req-613cba13-9920-424e-910e-1261a60aab46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 944 time: 0.1328940 Nov 24 04:12:46.320125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.350179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.368076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.368645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-63a5332b-50a8-4442-a40c-b4de62d102e0', 'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0', 'tenant_id': '6ded641f952546eabaf98ac1479dfec9', 'fixed_ips': [{'subnet_id': '3fb400a3-a8c8-4bcd-bfc4-4886354a2eeb'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:46.369667 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.400882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-bc6be3c6-abb7-4b5e-a5c4-82d49626bc63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:46.402534 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-bc6be3c6-abb7-4b5e-a5c4-82d49626bc63 service neutron] 10.222.0.21 "GET /v2.0/networks?id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 898 time: 0.6007845 Nov 24 04:12:46.422456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.447893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.456849 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-58b976c7-9c43-49f9-bb25-d09799883cac req-7b35f24f-1cc6-47d3-ad1d-5b4e20e32e09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1865861 Nov 24 04:12:46.468857 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-02766a31-221c-4eca-8824-13cc13d3472b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 200 len: 217 time: 0.0566521 Nov 24 04:12:46.470063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:46.492745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:46.533682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': '32776824-7f07-48ac-9d0c-b8db06ee43b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:46.534236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: cb99ca22-1288-43f7-94f6-8dab93b0491e, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:46.544525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.550183 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-77f75f2a-f948-4f63-b8ad-f90c0707d5ef tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 933 time: 2.6422439 Nov 24 04:12:46.550358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33168) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:46.550876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=a2a43892-53f4-43ea-9a62-bf78cb8b2339,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:46.585590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] For port 95413140-775e-498b-af60-54ee10e12e3b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:46.593439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-94a2d332-5daa-41b9-90f2-71466a92d5dd None None] Provisioning complete for port 95413140-775e-498b-af60-54ee10e12e3b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:46.593804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-94a2d332-5daa-41b9-90f2-71466a92d5dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.603653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-4376fc95-d3cc-40e0-b6c0-4103da8334b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:46.605357 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-4376fc95-d3cc-40e0-b6c0-4103da8334b8 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=c4348623-9729-4d15-a5cf-803eac33880a HTTP/1.1" status: 200 len: 834 time: 0.1287353 Nov 24 04:12:46.633203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network cb99ca22-1288-43f7-94f6-8dab93b0491e is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:46.634360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Network 1bc54576-d6fb-4dd7-9025-7e058230420c is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:46.655671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] For port 95413140-775e-498b-af60-54ee10e12e3b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=95413140-775e-498b-af60-54ee10e12e3b,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:46.659450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:46.665997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Pushing event updated for resources: {'Port': ['ID=80a6f44d-922c-48a8-99fe-6f2237976b33,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:46.673400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, cb99ca22-1288-43f7-94f6-8dab93b0491e) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:46.677536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:46.684635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:46.685406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.689277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.693425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.722320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1bc54576-d6fb-4dd7-9025-7e058230420c']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:46.726105 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-714963d7-3b91-4fd7-a5b4-c016cdf442b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 933 time: 0.1736667 Nov 24 04:12:46.732278 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-851178f0-5d47-4d0b-94eb-8cce97965cc1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4259930 Nov 24 04:12:46.733769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33170) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:46.734602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33172) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:46.741104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e', 'name': 'tempest-PortsIpV6TestJSON-217065591'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:46.744956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cc49016-55a8-4c1a-8847-0fba937d46e6 None None] Network cb99ca22-1288-43f7-94f6-8dab93b0491e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:46.745623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f52c127-52f9-43f4-9e06-d7742a6e53ad') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:46.745935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f52c127-52f9-43f4-9e06-d7742a6e53ad') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:46.747437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'routes': None}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:46.747587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.751973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-74841df8-b8ba-4e3a-a6d5-4617b7d63da4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:46.753729 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-74841df8-b8ba-4e3a-a6d5-4617b7d63da4 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=becef48c-b834-483b-91dc-0f71ec58e834&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1179669 Nov 24 04:12:46.763613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.784890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.795221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 195 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:46.795682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:46.798778 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:46.805005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-94a2d332-5daa-41b9-90f2-71466a92d5dd None None] Port 95413140-775e-498b-af60-54ee10e12e3b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:46.892774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:12:46.892774 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:12:46.892774 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'id': '1bc54576-d6fb-4dd7-9025-7e058230420c'}] Nov 24 04:12:46.892774 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:46.894655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:46.951970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:46.997490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.047273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.049384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:47.050382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:47.059242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c4327d-0fdc-4ed9-b51c-5fd83236ee9f None None] Pushing event updated for resources: {'Port': ['ID=95413140-775e-498b-af60-54ee10e12e3b,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:47.070997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Attempting to bind port 80a6f44d-922c-48a8-99fe-6f2237976b33 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:47.075102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Attempting to bind port 80a6f44d-922c-48a8-99fe-6f2237976b33 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '6f52c127-52f9-43f4-9e06-d7742a6e53ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:47.080189 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-f8a6697a-6634-4f5e-90ac-2aa8f89eada3 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3122385 Nov 24 04:12:47.082421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Attempting to bind port 80a6f44d-922c-48a8-99fe-6f2237976b33 on network 1bc54576-d6fb-4dd7-9025-7e058230420c {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:47.109832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.159985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.188089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.188532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Allocated IP 2001:db8:0:1::1 (63a5332b-50a8-4442-a40c-b4de62d102e0/3fb400a3-a8c8-4bcd-bfc4-4886354a2eeb/48d03331-d22b-4dc2-a708-c32d4cc2c39f) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:47.209723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:47.213938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.221335 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:47.221725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Checking segment: {'id': '6f52c127-52f9-43f4-9e06-d7742a6e53ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:47.222132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.222758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Bound using segment: {'id': '6f52c127-52f9-43f4-9e06-d7742a6e53ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:47.223254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Bound port: 80a6f44d-922c-48a8-99fe-6f2237976b33, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f52c127-52f9-43f4-9e06-d7742a6e53ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '1bc54576-d6fb-4dd7-9025-7e058230420c'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:47.224143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.251183 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Network dc4c6238-6058-4727-b152-d479a9bf13dd is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:47.290314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.290939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:47.293849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 14a9eba0-dd23-4e20-ac1f-179579c845a7 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:47.297210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:47.383886 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3ac94c2b-b556-47cb-8aa0-102eac15b87d req-f850776c-38ee-486d-9802-e4a023b83cc4 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2694850 Nov 24 04:12:47.394474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Pushing event updated for resources: {'Port': ['ID=653f78a5-adff-407c-a3fd-a52cc22aa849,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:47.396870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.408960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:47.416953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Allocated IP 172.26.5.73 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/16dd5218-f127-4c56-9f21-00fc842ff8a4) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:47.419127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.456191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Subnet': ['ID=0158adbc-e057-42f3-ae1d-5fba08bb56c4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:47.465520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.473110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33174) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:47.482598 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0e4be88a-8631-422e-8513-e2aa45a813ba tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/subnets/0158adbc-e057-42f3-ae1d-5fba08bb56c4 HTTP/1.1" status: 204 len: 168 time: 1.4823070 Nov 24 04:12:47.510419 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-29663e55-10af-4ce8-a8a3-760d674499fe None None] Provisioning complete for port 95413140-775e-498b-af60-54ee10e12e3b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:47.510801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-29663e55-10af-4ce8-a8a3-760d674499fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.572300 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 9f1b668f-dd92-42dc-9d4b-55596d7ec904 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:12:47.588547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::1a4 (cb99ca22-1288-43f7-94f6-8dab93b0491e/95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd/14a9eba0-dd23-4e20-ac1f-179579c845a7) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:47.658644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting port 80a6f44d-922c-48a8-99fe-6f2237976b33 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:47.659316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.674031 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-cb99ca22-1288-43f7-94f6-8dab93b0491e', 'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': '95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:47.674835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.678203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Deleting subnet 3fb400a3-a8c8-4bcd-bfc4-4886354a2eeb {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:47.699660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] For port 80a6f44d-922c-48a8-99fe-6f2237976b33, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:47.704081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Attempting to bind port 653f78a5-adff-407c-a3fd-a52cc22aa849 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:47.704081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Attempting to bind port 653f78a5-adff-407c-a3fd-a52cc22aa849 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd63423fb-10ff-4499-abc3-993b7237aad7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:47.704564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Attempting to bind port 653f78a5-adff-407c-a3fd-a52cc22aa849 on network dc4c6238-6058-4727-b152-d479a9bf13dd {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:47.729354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.extraroute_db [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added routes are [] {{(pid=103381) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 24 04:12:47.729699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.extraroute_db [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Removed routes are [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}] {{(pid=103381) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 24 04:12:47.750793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] For port 80a6f44d-922c-48a8-99fe-6f2237976b33, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=80a6f44d-922c-48a8-99fe-6f2237976b33,segment=NetworkSegment(6f52c127-52f9-43f4-9e06-d7742a6e53ad),segment_id=6f52c127-52f9-43f4-9e06-d7742a6e53ad)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:47.766274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:47.766654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Checking segment: {'id': 'd63423fb-10ff-4499-abc3-993b7237aad7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:47.767067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.767470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Bound using segment: {'id': 'd63423fb-10ff-4499-abc3-993b7237aad7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:47.767978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Bound port: 653f78a5-adff-407c-a3fd-a52cc22aa849, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd63423fb-10ff-4499-abc3-993b7237aad7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': 'dc4c6238-6058-4727-b152-d479a9bf13dd'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:47.768345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.771330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] For port 80a6f44d-922c-48a8-99fe-6f2237976b33, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:47.771696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.774032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d733ad97-feea-4e1d-9412-9f2bf8a6bf52 req-444688ec-2788-4633-affc-0ca369eb44e0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:47.775720 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d733ad97-feea-4e1d-9412-9f2bf8a6bf52 req-444688ec-2788-4633-affc-0ca369eb44e0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 944 time: 0.1696007 Nov 24 04:12:47.788276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Calling delete_port for 80a6f44d-922c-48a8-99fe-6f2237976b33 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:47.813009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.861349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.903525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:47.955400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No DVR routers for this DVR port 80a6f44d-922c-48a8-99fe-6f2237976b33 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:47.958746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Port': ['ID=80a6f44d-922c-48a8-99fe-6f2237976b33,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:47.976449 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d733ad97-feea-4e1d-9412-9f2bf8a6bf52 req-425ba7fd-8b23-418f-a735-010c8c625590 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1499174 Nov 24 04:12:47.995972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.058607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.090457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.116856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1bc54576-d6fb-4dd7-9025-7e058230420c']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:48.129166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.136931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f52c127-52f9-43f4-9e06-d7742a6e53ad') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:48.137261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f52c127-52f9-43f4-9e06-d7742a6e53ad') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:48.139902 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.149320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.155640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.166694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.169314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.173416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.178528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.207474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 195 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:48.207827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:48.210892 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server [None req-7392e0fd-c9f1-4561-ad19-cccf335fa233 None None] Exception during message handling: neutron_lib.exceptions.PortNotFound: Port 80a6f44d-922c-48a8-99fe-6f2237976b33 could not be found. Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_common.py", line 289, in _get_port Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port = model_query.get_by_id(context, models_v2.Port, id, Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py", line 169, in get_by_id Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return query.filter(model.id == object_id).one() Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2856, in one Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._iter().one() Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1407, in one Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._only_one_row( Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 561, in _only_one_row Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exc.NoResultFound( Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server sqlalchemy.exc.NoResultFound: No row was found when one was required Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in get_dhcp_port Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return plugin.get_port(context, port_id) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:48.219470 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise self.value Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1559, in get_port Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server port = self._get_port(context, id, lazy_fields=lazy_fields) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_common.py", line 292, in _get_port Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server raise exceptions.PortNotFound(port_id=id) Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.PortNotFound: Port 80a6f44d-922c-48a8-99fe-6f2237976b33 could not be found. Nov 24 04:12:48.224841 dv-neutron-819049-1-hyperv neutron-server[103382]: ERROR oslo_messaging.rpc.server Nov 24 04:12:48.227393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network cb99ca22-1288-43f7-94f6-8dab93b0491e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:48.255731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.257490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2090de-9695-4fe8-a0da-8f31df22fb77 None None] Pushing event updated for resources: {'Port': ['ID=80a6f44d-922c-48a8-99fe-6f2237976b33,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:48.266733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:48.290382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c1f9d2b-1d04-45cc-b1d5-061d22a51673 None None] Network 1bc54576-d6fb-4dd7-9025-7e058230420c requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:48.297812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:48.303947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:48.304597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.307367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=14a9eba0-dd23-4e20-ac1f-179579c845a7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:48.330228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.547963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] For port 653f78a5-adff-407c-a3fd-a52cc22aa849, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:48.565839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-29663e55-10af-4ce8-a8a3-760d674499fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.577384 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:48.584658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:48.602011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:48.613084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Network 63a5332b-50a8-4442-a40c-b4de62d102e0 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:48.613825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:48.622332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Port': ['ID=16dd5218-f127-4c56-9f21-00fc842ff8a4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:48.650827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] For port 653f78a5-adff-407c-a3fd-a52cc22aa849, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=653f78a5-adff-407c-a3fd-a52cc22aa849,segment=NetworkSegment(d63423fb-10ff-4499-abc3-993b7237aad7),segment_id=d63423fb-10ff-4499-abc3-993b7237aad7)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:48.654834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8e1ba26-1b5e-4e77-bc22-bd5dff29fe4e None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:48.656720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.665910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.672591 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/1bc54576-d6fb-4dd7-9025-7e058230420c HTTP/1.1" status: 204 len: 168 time: 4.0122330 Nov 24 04:12:48.672780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:48.674532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33180) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:48.680329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1186380949'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:48.687344 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c0419d74-4b8c-4870-9114-89bc81eeaf41 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.9481158 Nov 24 04:12:48.690966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33182) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:48.691114 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:48.695917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19970c72-884d-4843-a03d-c2cde97145af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=1bc54576-d6fb-4dd7-9025-7e058230420c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:48.700236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Allocated IP 2001:db8::2 (cb99ca22-1288-43f7-94f6-8dab93b0491e/95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd/70d00a86-d377-4261-a9a4-d5e3a452a763) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:48.705076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.714271 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 156, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:12:48.715772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Pushing event updated for resources: {'Port': ['ID=48d03331-d22b-4dc2-a708-c32d4cc2c39f,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:48.748855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:48.800139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-29663e55-10af-4ce8-a8a3-760d674499fe None None] For port 95413140-775e-498b-af60-54ee10e12e3b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=95413140-775e-498b-af60-54ee10e12e3b,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:48.805009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:48.808619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.839374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.850644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 190, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:48.876592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-29663e55-10af-4ce8-a8a3-760d674499fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.898203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.898203 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 23fe78d1-f621-4fad-bb8d-4de1ae6654a2 of type vlan for network 26acdcb7-a599-403a-86ab-8693d58c45f0 Nov 24 04:12:48.983508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 14a9eba0-dd23-4e20-ac1f-179579c845a7 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:48.983978 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:48.996658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.001778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:49.010803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.015174 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a721066c-0124-4529-9756-4cfe02a6a705 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 699 time: 2.2797940 Nov 24 04:12:49.015859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8399e75-72e1-466a-8822-47447b3b0e26 None None] Pushing event updated for resources: {'Port': ['ID=653f78a5-adff-407c-a3fd-a52cc22aa849,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:49.016161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33186) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:49.022942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Attempting to bind port 48d03331-d22b-4dc2-a708-c32d4cc2c39f on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:49.023555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Attempting to bind port 48d03331-d22b-4dc2-a708-c32d4cc2c39f by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'ed589798-187b-4d7c-8815-dd5c0a1b7411', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:49.024094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Attempting to bind port 48d03331-d22b-4dc2-a708-c32d4cc2c39f on network 63a5332b-50a8-4442-a40c-b4de62d102e0 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:49.035593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:44Z', 'revision_number': 6, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '95413140-775e-498b-af60-54ee10e12e3b', 'name': '', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:61:bc:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 914, 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:39Z', 'updated_at': '2021-11-24T04:12:46Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:49.039402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.073427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.081214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.087348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:49.087941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.109109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-793e29df-b56e-45b3-9eea-975ba64027d5 None None] Network dc4c6238-6058-4727-b152-d479a9bf13dd requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:49.111421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:49.111798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Checking segment: {'id': 'ed589798-187b-4d7c-8815-dd5c0a1b7411', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:49.112205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.112605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Bound using segment: {'id': 'ed589798-187b-4d7c-8815-dd5c0a1b7411', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:49.113097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Bound port: 48d03331-d22b-4dc2-a708-c32d4cc2c39f, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed589798-187b-4d7c-8815-dd5c0a1b7411', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '63a5332b-50a8-4442-a40c-b4de62d102e0'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:49.113750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.122593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-496fd017-c5c9-4f64-98b9-6d6d92ffec22 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:44Z', 'revision_number': 6, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '95413140-775e-498b-af60-54ee10e12e3b', 'name': '', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:61:bc:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 914, 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:39Z', 'updated_at': '2021-11-24T04:12:46Z', 'revision_number': 4, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:49.167936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.233544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Subnet': ['ID=3fb400a3-a8c8-4bcd-bfc4-4886354a2eeb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:49.250011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.252258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9f1b668f-dd92-42dc-9d4b-55596d7ec904 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:12:49.259746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-369857d7-9415-4a77-954d-bfd518fea13a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/subnets/3fb400a3-a8c8-4bcd-bfc4-4886354a2eeb HTTP/1.1" status: 204 len: 168 time: 1.7825985 Nov 24 04:12:49.262005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33188) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:49.266777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.270128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e408b716-a810-4002-8155-8f317f4fbcbf None None] Provisioning complete for port 16dd5218-f127-4c56-9f21-00fc842ff8a4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:49.271597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e408b716-a810-4002-8155-8f317f4fbcbf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.282308 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.6066453 Nov 24 04:12:49.290598 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3734cfc8-461a-49c9-b7e9-bed7cd8b32da tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 699 time: 0.2677410 Nov 24 04:12:49.291173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33190) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:49.312554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33192) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:49.322901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'New_network'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:49.329823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 14a9eba0-dd23-4e20-ac1f-179579c845a7 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:49.385573 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:12:49.441720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37faf00-be19-46f1-b515-18077d00f434 req-3cd27ef5-1443-44fc-b2a9-0b4a2f8c2e5a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:49.442173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97df0daa-1469-46a2-adc7-861fe2149c7c tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:49.447720 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-97df0daa-1469-46a2-adc7-861fe2149c7c tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1797132 Nov 24 04:12:49.449889 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f37faf00-be19-46f1-b515-18077d00f434 req-3cd27ef5-1443-44fc-b2a9-0b4a2f8c2e5a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 944 time: 0.3055561 Nov 24 04:12:49.452062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69d7eab-2b56-4f1d-8517-985ea01c4879 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=26acdcb7-a599-403a-86ab-8693d58c45f0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:49.452470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33194) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:49.511119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:49.573478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29663e55-10af-4ce8-a8a3-760d674499fe None None] Pushing event updated for resources: {'Port': ['ID=95413140-775e-498b-af60-54ee10e12e3b,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:49.593784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:49.615553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e408b716-a810-4002-8155-8f317f4fbcbf None None] Port 16dd5218-f127-4c56-9f21-00fc842ff8a4 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:49.649441 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.667143 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f37faf00-be19-46f1-b515-18077d00f434 req-ed9b13d0-0f94-439e-9ff4-4d0beb19d87a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2147319 Nov 24 04:12:49.677976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 95413140-775e-498b-af60-54ee10e12e3b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:49.686603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] For port 48d03331-d22b-4dc2-a708-c32d4cc2c39f, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:49.756984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.761844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] For port 48d03331-d22b-4dc2-a708-c32d4cc2c39f, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=48d03331-d22b-4dc2-a708-c32d4cc2c39f,segment=NetworkSegment(ed589798-187b-4d7c-8815-dd5c0a1b7411),segment_id=ed589798-187b-4d7c-8815-dd5c0a1b7411)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:49.780152 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.800268 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.805572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.815731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=9f1b668f-dd92-42dc-9d4b-55596d7ec904,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:49.841272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.845950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.880768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.893890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=14a9eba0-dd23-4e20-ac1f-179579c845a7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:49.920483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3eec4555-832f-4b68-bf29-87e06adaac2f None None] Network 63a5332b-50a8-4442-a40c-b4de62d102e0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:49.957192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.966105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Network cb99ca22-1288-43f7-94f6-8dab93b0491e is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:49.976652 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['9f1b668f-dd92-42dc-9d4b-55596d7ec904'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:12:49.985387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:49.994397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:49.998106 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fbe90619-7a6d-4701-83ca-7e325e3e5550 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/14a9eba0-dd23-4e20-ac1f-179579c845a7 HTTP/1.1" status: 204 len: 168 time: 1.3058558 Nov 24 04:12:50.012633 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33196) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:50.014528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:50.017659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 is not hosted by any dhcp agent {{(pid=103381) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:12:50.024100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2caada-52dd-4ffe-b263-ae950c7e14f4 None None] Pushing event updated for resources: {'Port': ['ID=48d03331-d22b-4dc2-a708-c32d4cc2c39f,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:50.024586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:50.025351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.030001 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "PUT /v2.0/networks/26acdcb7-a599-403a-86ab-8693d58c45f0 HTTP/1.1" status: 200 len: 723 time: 0.7125242 Nov 24 04:12:50.033401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33198) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:50.043414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:50.069032 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-efe442cb-427e-48b3-b11c-d3bf228c227a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:50.069749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-efe442cb-427e-48b3-b11c-d3bf228c227a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:50.075747 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-efe442cb-427e-48b3-b11c-d3bf228c227a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/14a9eba0-dd23-4e20-ac1f-179579c845a7 HTTP/1.1" status: 404 len: 333 time: 0.0566692 Nov 24 04:12:50.084452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33200) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:50.108619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4208a8-4229-4465-a823-e38b099c230a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=26acdcb7-a599-403a-86ab-8693d58c45f0,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:50.121029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Deleting port 48d03331-d22b-4dc2-a708-c32d4cc2c39f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:50.121442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.136826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:50.164620 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-590bfca2-87ae-4250-9d93-183f8e1760cf tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:12:50.168934 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-590bfca2-87ae-4250-9d93-183f8e1760cf tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/14a9eba0-dd23-4e20-ac1f-179579c845a7 HTTP/1.1" status: 404 len: 333 time: 0.0795474 Nov 24 04:12:50.172650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33202) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:50.178135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 95413140-775e-498b-af60-54ee10e12e3b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:50.178561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.194654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.209696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] For port 48d03331-d22b-4dc2-a708-c32d4cc2c39f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=48d03331-d22b-4dc2-a708-c32d4cc2c39f,segment=NetworkSegment(ed589798-187b-4d7c-8815-dd5c0a1b7411),segment_id=ed589798-187b-4d7c-8815-dd5c0a1b7411)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:50.210469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.227468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Calling delete_port for 48d03331-d22b-4dc2-a708-c32d4cc2c39f owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:50.296327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Attempting to bind port 70d00a86-d377-4261-a9a4-d5e3a452a763 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:50.296893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Attempting to bind port 70d00a86-d377-4261-a9a4-d5e3a452a763 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '32776824-7f07-48ac-9d0c-b8db06ee43b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:50.297048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Attempting to bind port 70d00a86-d377-4261-a9a4-d5e3a452a763 on network cb99ca22-1288-43f7-94f6-8dab93b0491e {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:50.306890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Pushing event updated for resources: {'Port': ['ID=70d00a86-d377-4261-a9a4-d5e3a452a763,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:50.327106 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:50.331337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.331486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.339352 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:50.352387 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:50.353015 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:50.369344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] No DVR routers for this DVR port 48d03331-d22b-4dc2-a708-c32d4cc2c39f on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:50.376019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Port': ['ID=48d03331-d22b-4dc2-a708-c32d4cc2c39f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:50.386991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:50.395880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.423723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:50.424609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Checking segment: {'id': '32776824-7f07-48ac-9d0c-b8db06ee43b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:50.425233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.425871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Bound using segment: {'id': '32776824-7f07-48ac-9d0c-b8db06ee43b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:50.427196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Bound port: 70d00a86-d377-4261-a9a4-d5e3a452a763, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32776824-7f07-48ac-9d0c-b8db06ee43b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': 'cb99ca22-1288-43f7-94f6-8dab93b0491e'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:50.427831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.465865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.479050 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:50.495538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['63a5332b-50a8-4442-a40c-b4de62d102e0']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:50.511474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed589798-187b-4d7c-8815-dd5c0a1b7411') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:50.512038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed589798-187b-4d7c-8815-dd5c0a1b7411') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:50.517676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Router 98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:50.527627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.534889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.547800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.557174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Releasing vlan 151 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:50.558284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:50.562757 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:50.651680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.665111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.673299 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/networks/63a5332b-50a8-4442-a40c-b4de62d102e0 HTTP/1.1" status: 204 len: 168 time: 1.2197757 Nov 24 04:12:50.682274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33204) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:50.711921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34274f12-e9e6-4d8e-8c5c-9036f29d546a tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Network': ['ID=63a5332b-50a8-4442-a40c-b4de62d102e0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:50.778918 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:47Z', 'revision_number': 7, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '95413140-775e-498b-af60-54ee10e12e3b', 'name': '', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:61:bc:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 914, 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:39Z', 'updated_at': '2021-11-24T04:12:48Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:50.821190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] For port 70d00a86-d377-4261-a9a4-d5e3a452a763, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:50.827754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] For port 70d00a86-d377-4261-a9a4-d5e3a452a763, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70d00a86-d377-4261-a9a4-d5e3a452a763,segment=NetworkSegment(32776824-7f07-48ac-9d0c-b8db06ee43b9),segment_id=32776824-7f07-48ac-9d0c-b8db06ee43b9)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:50.842014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.847233 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:50.859660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:50.865128 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:50.866712 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:50.891525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-746fd871-8675-45cb-b033-7a6d7ff4fd5c req-04f49dc7-2caf-45d7-84f0-4a864239ca6c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:50.893336 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-746fd871-8675-45cb-b033-7a6d7ff4fd5c req-04f49dc7-2caf-45d7-84f0-4a864239ca6c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 945 time: 0.1327283 Nov 24 04:12:50.948519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84007c83-7733-47eb-9a4b-17b949b3a5ad None None] Pushing event updated for resources: {'Port': ['ID=70d00a86-d377-4261-a9a4-d5e3a452a763,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:51.015243 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-746fd871-8675-45cb-b033-7a6d7ff4fd5c req-d0e9475a-e491-458c-b7b4-55b575965278 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1101606 Nov 24 04:12:51.022860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Deleting port 653f78a5-adff-407c-a3fd-a52cc22aa849 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:51.023827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.072191 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:51.106469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] For port 653f78a5-adff-407c-a3fd-a52cc22aa849, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=653f78a5-adff-407c-a3fd-a52cc22aa849,segment=NetworkSegment(d63423fb-10ff-4499-abc3-993b7237aad7),segment_id=d63423fb-10ff-4499-abc3-993b7237aad7)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:51.107231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.132130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Calling delete_port for 653f78a5-adff-407c-a3fd-a52cc22aa849 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:51.191082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.251503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:51.270917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Sync routers for ids ['98f237e9-7725-4aaa-b797-e4c0c4b7c4c5'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:51.283093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Routers {'98f237e9-7725-4aaa-b797-e4c0c4b7c4c5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:51.284061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['98f237e9-7725-4aaa-b797-e4c0c4b7c4c5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:51.288412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.312256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.334819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Port': ['ID=653f78a5-adff-407c-a3fd-a52cc22aa849,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:51.344363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] No DVR routers for this DVR port 653f78a5-adff-407c-a3fd-a52cc22aa849 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:51.368912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.373378 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e9957357-fd72-4a1d-8485-80b7a2fc8c7b tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 5.2484317 Nov 24 04:12:51.374406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33208) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:51.405693 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:47Z', 'revision_number': 7, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '95413140-775e-498b-af60-54ee10e12e3b', 'name': '', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:61:bc:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 914, 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:39Z', 'updated_at': '2021-11-24T04:12:48Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:51.448338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.448591 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61cb4735-8d67-46a9-ba6e-579a2b11403b None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:47Z', 'revision_number': 7, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '95413140-775e-498b-af60-54ee10e12e3b', 'name': '', 'network_id': 'e61bd646-fcd7-4a33-a97e-24f14536e4b7', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:61:bc:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 914, 'fixed_ips': [{'subnet_id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:39Z', 'updated_at': '2021-11-24T04:12:48Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'c3fd3c3f-6c82-4a68-b025-36e5ef24fc50', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:51.465249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Set router 98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:51.472191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dc4c6238-6058-4727-b152-d479a9bf13dd']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:51.483554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd63423fb-10ff-4499-abc3-993b7237aad7') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:51.483918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd63423fb-10ff-4499-abc3-993b7237aad7') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:51.496851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.513454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.514383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=36269490-865c-4eba-9673-710bb7e18ad6,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:51.519627 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.522606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Releasing vlan 185 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:51.523160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:51.527124 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:51.624159 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:51.631327 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.632670 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6916098e-2dc7-4338-baa9-d67693562fc6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd HTTP/1.1" status: 204 len: 168 time: 1.4530754 Nov 24 04:12:51.636667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33210) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:51.637893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '23fe78d1-f621-4fad-bb8d-4de1ae6654a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:51.638337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: 26acdcb7-a599-403a-86ab-8693d58c45f0, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:51.649719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.673505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 9f1b668f-dd92-42dc-9d4b-55596d7ec904 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:51.700432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.706512 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/networks/dc4c6238-6058-4727-b152-d479a9bf13dd HTTP/1.1" status: 204 len: 168 time: 1.0224686 Nov 24 04:12:51.707705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9972bba-ce5a-4c0e-96cf-195fff2c05be tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Network': ['ID=dc4c6238-6058-4727-b152-d479a9bf13dd,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:51.710077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33212) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:51.729008 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-964bdc9a-46df-424b-bfd4-32613401ba52 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 HTTP/1.1" status: 200 len: 908 time: 0.3421893 Nov 24 04:12:51.730646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33214) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:51.733236 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 95413140-775e-498b-af60-54ee10e12e3b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:51.733583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.737131 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1174715920', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': True}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:51.754812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:51.779848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70d00a86-d377-4261-a9a4-d5e3a452a763 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:51.783084 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 26acdcb7-a599-403a-86ab-8693d58c45f0) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:51.791895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:51.792515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.823957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b510a15-416b-48b1-b06d-5e56ae9489f6 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:51.870796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 95413140-775e-498b-af60-54ee10e12e3b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=95413140-775e-498b-af60-54ee10e12e3b,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:51.871169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.876088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.885395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 95413140-775e-498b-af60-54ee10e12e3b owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:51.966442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.969358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.970671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:51.996995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:12:52.004933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:52.005319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.042350 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1d82221f-40f2-42ea-83cf-0231d443ed36 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0007958 Nov 24 04:12:52.042562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33216) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:52.053427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 70d00a86-d377-4261-a9a4-d5e3a452a763 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:52.053809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.056545 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:52.147943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.161729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-26acdcb7-a599-403a-86ab-8693d58c45f0', 'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': '36269490-865c-4eba-9673-710bb7e18ad6'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:52.162850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.189209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98f237e9-7725-4aaa-b797-e4c0c4b7c4c5', 'name': 'tempest-snat-router-1174715920', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.73'}], 'enable_snat': False}, 'gw_port_id': '16dd5218-f127-4c56-9f21-00fc842ff8a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:46Z', 'updated_at': '2021-11-24T04:12:48Z', 'revision_number': 3, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port': {'id': '16dd5218-f127-4c56-9f21-00fc842ff8a4', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:36:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98f237e9-7725-4aaa-b797-e4c0c4b7c4c5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 928, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:47Z', 'updated_at': '2021-11-24T04:12:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:52.207110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.229656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Checking router: 98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:52.230016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Updating router 98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 port 16dd5218-f127-4c56-9f21-00fc842ff8a4 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:52.241541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.264438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.268051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 70d00a86-d377-4261-a9a4-d5e3a452a763 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:52.268466 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.287763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=95413140-775e-498b-af60-54ee10e12e3b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:52.312962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:52.329503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9e255830-cd1e-487a-9d7a-faae86a65996') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:52.330319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9e255830-cd1e-487a-9d7a-faae86a65996') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:52.349865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.369133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.376968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5738b189-8ba2-4bc9-8d8a-e85740a8cd88 None None] Network cb99ca22-1288-43f7-94f6-8dab93b0491e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:52.390096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:12:52.390995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45c5091e-71a9-46c0-8467-9c71e7f97803" -d '{"events": [{"server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "name": "network-vif-plugged", "status": "completed", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:12:52.427505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86695002-885b-41e8-8a2a-454f1cea9a3d req-1dd3d2b3-c567-4672-9d67-d1fd0cd84b89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:52.429232 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-86695002-885b-41e8-8a2a-454f1cea9a3d req-1dd3d2b3-c567-4672-9d67-d1fd0cd84b89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 945 time: 0.2451029 Nov 24 04:12:52.433646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-4111412'] for subnet, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.451330 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:52.480442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.483946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.487293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] For port 70d00a86-d377-4261-a9a4-d5e3a452a763, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70d00a86-d377-4261-a9a4-d5e3a452a763,segment=NetworkSegment(32776824-7f07-48ac-9d0c-b8db06ee43b9),segment_id=32776824-7f07-48ac-9d0c-b8db06ee43b9)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:52.487951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.502882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Releasing vlan 182 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:52.503625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:52.512903 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:52.526539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.536483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:12:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9632a3a1-557e-4b61-92a0-b24bb86d75e1 x-openstack-request-id: req-9632a3a1-557e-4b61-92a0-b24bb86d75e1 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:12:52.536962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "name": "network-vif-plugged", "status": "completed", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:12:52.537231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-9632a3a1-557e-4b61-92a0-b24bb86d75e1 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:12:52.541340 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'code': 200} Nov 24 04:12:52.547588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.557748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 70d00a86-d377-4261-a9a4-d5e3a452a763 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:52.601583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.615767 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-86695002-885b-41e8-8a2a-454f1cea9a3d req-eab64803-8b45-4035-a04d-c8a65790a2b3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1278300 Nov 24 04:12:52.719037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.728697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f4a25e39-ecd6-458a-b7af-8b4531cd7632 None None] Provisioning complete for port 70d00a86-d377-4261-a9a4-d5e3a452a763 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:52.729067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f4a25e39-ecd6-458a-b7af-8b4531cd7632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.735798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Allocated IP 172.20.0.2 (26acdcb7-a599-403a-86ab-8693d58c45f0/36269490-865c-4eba-9673-710bb7e18ad6/26127f58-6127-4262-9b29-a3be9994ac89) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:52.809511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 70d00a86-d377-4261-a9a4-d5e3a452a763, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=70d00a86-d377-4261-a9a4-d5e3a452a763,segment=NetworkSegment(32776824-7f07-48ac-9d0c-b8db06ee43b9),segment_id=32776824-7f07-48ac-9d0c-b8db06ee43b9)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:52.822372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=9f1b668f-dd92-42dc-9d4b-55596d7ec904,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:52.837158 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.838093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 95413140-775e-498b-af60-54ee10e12e3b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:52.854116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.861613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33222) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:52.863001 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/networks/aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d HTTP/1.1" status: 204 len: 168 time: 1.1448762 Nov 24 04:12:52.876660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:12:52.894392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:52.912984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event deleted for resources: {'Port': ['ID=70d00a86-d377-4261-a9a4-d5e3a452a763,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:52.936307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 95413140-775e-498b-af60-54ee10e12e3b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:52.936785 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 95413140-775e-498b-af60-54ee10e12e3b not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:12:52.955154 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbec304c-2eac-4af3-beb0-33bc0db68f33 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Network': ['ID=aba0f1a1-099f-4f8e-a8a4-e9abe320ab8d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:52.956938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=70d00a86-d377-4261-a9a4-d5e3a452a763,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:52.967951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No DVR routers for this DVR port 70d00a86-d377-4261-a9a4-d5e3a452a763 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:53.031800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.064418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:53.069927 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-451b518b-915d-4bb7-be45-33dd4f05600f tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7563753 Nov 24 04:12:53.072575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33224) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:53.078019 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:53.091111 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:53.092056 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.197123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.198772 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:53.204352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port 95413140-775e-498b-af60-54ee10e12e3b not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:12:53.205732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f4a25e39-ecd6-458a-b7af-8b4531cd7632 None None] Could not find standard attr ID for object 70d00a86-d377-4261-a9a4-d5e3a452a763. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:12:53.220625 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.plugins.ml2.db [None req-f4a25e39-ecd6-458a-b7af-8b4531cd7632 None None] No ports have port_id starting with 70d00a86-d377-4261-a9a4-d5e3a452a763 Nov 24 04:12:53.278564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dc354c27-c6e5-46c1-b428-5b8b90373752']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.298536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '609829a6-9e56-45c6-bafb-38740f8157df') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.298775 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '609829a6-9e56-45c6-bafb-38740f8157df') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.305944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet c3fd3c3f-6c82-4a68-b025-36e5ef24fc50 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:12:53.310854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d78d3c8-6a20-4964-8760-db8675b3c435 req-9bdb89b8-0ceb-44de-a6d3-fba5bf45612b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:53.312349 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1d78d3c8-6a20-4964-8760-db8675b3c435 req-9bdb89b8-0ceb-44de-a6d3-fba5bf45612b service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1099 time: 0.5374587 Nov 24 04:12:53.315556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.318375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff7fe0af-de4c-42ef-87b5-dbe705900e6e None None] DHCP port deletion for cb99ca22-1288-43f7-94f6-8dab93b0491e request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:53.367959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.386721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.388728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.397923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.401659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.413978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.433211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Releasing vlan 183 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:53.433773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.434356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cb99ca22-1288-43f7-94f6-8dab93b0491e']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:53.438302 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:53.451600 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1d78d3c8-6a20-4964-8760-db8675b3c435 req-f3a578b4-5278-474a-94fb-281e99bb9a7e service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1264083 Nov 24 04:12:53.454346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32776824-7f07-48ac-9d0c-b8db06ee43b9') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.454852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32776824-7f07-48ac-9d0c-b8db06ee43b9') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.483976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.525239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.530933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Pushing event updated for resources: {'Port': ['ID=26127f58-6127-4262-9b29-a3be9994ac89,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:53.546219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.558578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:53.562469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:53.580709 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.590538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.599206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 199 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:53.599873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:53.603246 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:53.639008 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:52Z', 'revision_number': 8, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.644279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4d12895-8ae7-49cf-a44b-4d5771fd03f8 None None] Pushing event updated for resources: {'Port': ['ID=16dd5218-f127-4c56-9f21-00fc842ff8a4,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:53.646684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.654925 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] 10.222.0.48 "DELETE /v2.0/networks/dc354c27-c6e5-46c1-b428-5b8b90373752 HTTP/1.1" status: 204 len: 168 time: 0.7920730 Nov 24 04:12:53.670477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:53.684964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b74a914a-1bd6-4a0e-bc2a-3fb5ab96962e None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:53.689008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.692009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70d00a86-d377-4261-a9a4-d5e3a452a763 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:53.701502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa98c75-e859-49a3-83ca-9be363bfc691 tempest-BulkNetworkOpsIpV6Test-734980499 tempest-BulkNetworkOpsIpV6Test-734980499-project] Pushing event deleted for resources: {'Network': ['ID=dc354c27-c6e5-46c1-b428-5b8b90373752,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:53.735534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.741532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.745553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8769089902457', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-3452072'] for subnet, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.758611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.762967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 70d00a86-d377-4261-a9a4-d5e3a452a763 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:53.763319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 70d00a86-d377-4261-a9a4-d5e3a452a763 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:53.809395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Attempting to bind port 16dd5218-f127-4c56-9f21-00fc842ff8a4 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:53.810208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Attempting to bind port 16dd5218-f127-4c56-9f21-00fc842ff8a4 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:53.811349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Attempting to bind port 16dd5218-f127-4c56-9f21-00fc842ff8a4 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:53.834876 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:53.836023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.839876 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "PUT /v2.0/subnets/36269490-865c-4eba-9673-710bb7e18ad6 HTTP/1.1" status: 200 len: 806 time: 1.7928445 Nov 24 04:12:53.841042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33230) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:53.854214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:53.854984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:53.856689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.857535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:53.858230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Bound port: 16dd5218-f127-4c56-9f21-00fc842ff8a4, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:53.859951 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.869307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.880278 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/cb99ca22-1288-43f7-94f6-8dab93b0491e HTTP/1.1" status: 204 len: 168 time: 2.2390974 Nov 24 04:12:53.882180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33232) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:53.887680 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:53.892504 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdca2ecb-10b0-4e9e-a57a-6d67c193b4b3 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=36269490-865c-4eba-9673-710bb7e18ad6,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:53.902312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-114316145'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:53.914195 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:53.914794 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:53.941246 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-fae4f110-3e74-4849-9789-d8d697fb155f None None] Provisioning complete for port 16dd5218-f127-4c56-9f21-00fc842ff8a4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:53.941727 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fae4f110-3e74-4849-9789-d8d697fb155f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.955441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4a3306-3d14-4ce7-a61d-20a938f6b9c0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=cb99ca22-1288-43f7-94f6-8dab93b0491e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:53.962810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:53.999074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Attempting to bind port 26127f58-6127-4262-9b29-a3be9994ac89 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:53.999600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Attempting to bind port 26127f58-6127-4262-9b29-a3be9994ac89 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '23fe78d1-f621-4fad-bb8d-4de1ae6654a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:54.000525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Attempting to bind port 26127f58-6127-4262-9b29-a3be9994ac89 on network 26acdcb7-a599-403a-86ab-8693d58c45f0 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:54.004472 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=c3fd3c3f-6c82-4a68-b025-36e5ef24fc50,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:54.013802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:54.018024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.022456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.029306 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7d9c83ce-70d4-4a78-9f41-0bf4fdca7bee tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/c3fd3c3f-6c82-4a68-b025-36e5ef24fc50 HTTP/1.1" status: 204 len: 168 time: 0.9557025 Nov 24 04:12:54.035618 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33234) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:54.042806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cd4c47-19ed-4d7b-9217-720d0ff1fe10 req-800f0b32-25eb-416d-a03d-92ffac5a9fca tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:54.044580 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44cd4c47-19ed-4d7b-9217-720d0ff1fe10 req-800f0b32-25eb-416d-a03d-92ffac5a9fca tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 946 time: 0.2670987 Nov 24 04:12:54.085430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.086000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] For port 16dd5218-f127-4c56-9f21-00fc842ff8a4, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:54.090349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] For port 16dd5218-f127-4c56-9f21-00fc842ff8a4, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=16dd5218-f127-4c56-9f21-00fc842ff8a4,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:54.091517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fae4f110-3e74-4849-9789-d8d697fb155f None None] Port 16dd5218-f127-4c56-9f21-00fc842ff8a4 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:54.093710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a585c18-93d9-4ed1-8452-b5f4a5aeb198 None None] Network e61bd646-fcd7-4a33-a97e-24f14536e4b7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:54.112312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Allocated IP 172.26.5.95 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/455b52e8-4718-4092-9f90-a8175c32c051) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:54.123744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.128748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:54.129126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Checking segment: {'id': '23fe78d1-f621-4fad-bb8d-4de1ae6654a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:54.129548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.130731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Bound using segment: {'id': '23fe78d1-f621-4fad-bb8d-4de1ae6654a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:54.130992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Bound port: 26127f58-6127-4262-9b29-a3be9994ac89, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '23fe78d1-f621-4fad-bb8d-4de1ae6654a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '26acdcb7-a599-403a-86ab-8693d58c45f0'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:54.131379 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.137215 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44cd4c47-19ed-4d7b-9217-720d0ff1fe10 req-3be4508d-e2fb-429a-a977-5c4d17e78e82 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0807898 Nov 24 04:12:54.163025 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:54.167081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 176, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:54.210365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.210817 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment 32f5dc19-cc1b-4482-86fd-0fcbd594d46e of type vlan for network 340b0d89-3868-4035-92e8-6cf8cee12cb2 Nov 24 04:12:54.212301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33238) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:54.224802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.236703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4d12895-8ae7-49cf-a44b-4d5771fd03f8 None None] Pushing event updated for resources: {'Port': ['ID=16dd5218-f127-4c56-9f21-00fc842ff8a4,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:54.291577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.297805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a99777bf-3d48-4b36-92a7-78c343680b27 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:54.298698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.353775 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting port 26127f58-6127-4262-9b29-a3be9994ac89 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:54.354005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Routers {'98f237e9-7725-4aaa-b797-e4c0c4b7c4c5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:54.354524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.354679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['98f237e9-7725-4aaa-b797-e4c0c4b7c4c5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:54.356508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.368388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.374247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:54.375074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.436386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:54.441287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:54.447404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:54.482688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Port': ['ID=455b52e8-4718-4092-9f90-a8175c32c051,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:54.512236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ab78d3e-90e7-4c0e-8f6c-463d796af143 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:54.576683 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:52Z', 'revision_number': 8, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:54.583633 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8973ab7f-2914-40e9-9ddd-c94b8cbdbef1 None None] Provisioning complete for port 16dd5218-f127-4c56-9f21-00fc842ff8a4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:54.584210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8973ab7f-2914-40e9-9ddd-c94b8cbdbef1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.620566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] For port 26127f58-6127-4262-9b29-a3be9994ac89, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:54.647344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-263d88bc-0f59-426e-8269-cf1f54b346c1 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:52Z', 'revision_number': 8, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '156ac190-86bf-4a9d-9929-0d063229f101', 'name': '', 'network_id': 'db88bd2b-781c-4449-a342-faf837b9a6c2', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:45:97:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 867, 'fixed_ips': [{'subnet_id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:31Z', 'updated_at': '2021-11-24T04:12:40Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'eca384a0-ac7f-4e35-8e16-c905722624f0', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:54.672662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] For port 26127f58-6127-4262-9b29-a3be9994ac89, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=26127f58-6127-4262-9b29-a3be9994ac89,segment=NetworkSegment(23fe78d1-f621-4fad-bb8d-4de1ae6654a2),segment_id=23fe78d1-f621-4fad-bb8d-4de1ae6654a2)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:54.691334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.736966 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] Set router 98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:54.803055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:54.884797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae99a977-ab27-424c-96c0-9f55eb147977 None None] Pushing event updated for resources: {'Port': ['ID=26127f58-6127-4262-9b29-a3be9994ac89,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:54.921064 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.0370469 Nov 24 04:12:54.924433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33242) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:54.929969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:54.965224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8973ab7f-2914-40e9-9ddd-c94b8cbdbef1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.000830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8973ab7f-2914-40e9-9ddd-c94b8cbdbef1 None None] For port 16dd5218-f127-4c56-9f21-00fc842ff8a4, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=16dd5218-f127-4c56-9f21-00fc842ff8a4,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:55.005892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee4a1d0-6066-4309-9afe-03e7dc4914b8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=340b0d89-3868-4035-92e8-6cf8cee12cb2,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:55.018292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8973ab7f-2914-40e9-9ddd-c94b8cbdbef1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.081667 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e69955fd-0240-4549-8def-f1a59834247e admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=6ded641f952546eabaf98ac1479dfec9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8614323 Nov 24 04:12:55.086362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33244) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:55.102333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 8c0f3081-b14f-4a8c-97cb-7080a442f371 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:55.102333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.128483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] DHCP port deletion for e61bd646-fcd7-4a33-a97e-24f14536e4b7 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:55.134687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:55.168763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] For port 26127f58-6127-4262-9b29-a3be9994ac89, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:55.169132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.243010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.262404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:55.268283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.279137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 8c0f3081-b14f-4a8c-97cb-7080a442f371, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c0f3081-b14f-4a8c-97cb-7080a442f371,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:55.279817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.291996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Calling delete_port for 26127f58-6127-4262-9b29-a3be9994ac89 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:55.340776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 8c0f3081-b14f-4a8c-97cb-7080a442f371 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:55.359481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bb1b6930-3374-4ff4-8ae8-f38aa2afd464 None None] Provisioning complete for port 455b52e8-4718-4092-9f90-a8175c32c051 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:55.359937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bb1b6930-3374-4ff4-8ae8-f38aa2afd464 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.364541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8973ab7f-2914-40e9-9ddd-c94b8cbdbef1 None None] Pushing event updated for resources: {'Port': ['ID=16dd5218-f127-4c56-9f21-00fc842ff8a4,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:55.398831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c6b5905-0203-436a-8f50-5790568a372e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.410679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bb1b6930-3374-4ff4-8ae8-f38aa2afd464 None None] Port 455b52e8-4718-4092-9f90-a8175c32c051 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:55.414223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] Deleting port 8c0f3081-b14f-4a8c-97cb-7080a442f371 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:55.414630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.432174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98f237e9-7725-4aaa-b797-e4c0c4b7c4c5', 'name': 'tempest-snat-router-1174715920', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.73'}], 'enable_snat': False}, 'gw_port_id': '16dd5218-f127-4c56-9f21-00fc842ff8a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:46Z', 'updated_at': '2021-11-24T04:12:48Z', 'revision_number': 3, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port': {'id': '16dd5218-f127-4c56-9f21-00fc842ff8a4', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:36:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98f237e9-7725-4aaa-b797-e4c0c4b7c4c5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 928, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:47Z', 'updated_at': '2021-11-24T04:12:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:55.468887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c6b5905-0203-436a-8f50-5790568a372e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.471278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcf4ec9d-3a10-416e-a7aa-e4e7b5e1d329 None None] The sync data for ids ['98f237e9-7725-4aaa-b797-e4c0c4b7c4c5'] in dv-neutron-819049-1-hyperv is: [{'id': '98f237e9-7725-4aaa-b797-e4c0c4b7c4c5', 'name': 'tempest-snat-router-1174715920', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.73'}], 'enable_snat': False}, 'gw_port_id': '16dd5218-f127-4c56-9f21-00fc842ff8a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:46Z', 'updated_at': '2021-11-24T04:12:48Z', 'revision_number': 3, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port': {'id': '16dd5218-f127-4c56-9f21-00fc842ff8a4', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:36:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98f237e9-7725-4aaa-b797-e4c0c4b7c4c5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 928, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:47Z', 'updated_at': '2021-11-24T04:12:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:55.496026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53e2957-5f85-48b1-83ef-5c3ccf22f43e req-b04b5f7e-ea57-4fcc-821b-25b7184d42c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:55.503309 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d53e2957-5f85-48b1-83ef-5c3ccf22f43e req-b04b5f7e-ea57-4fcc-821b-25b7184d42c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 946 time: 0.2156510 Nov 24 04:12:55.531092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] For port 8c0f3081-b14f-4a8c-97cb-7080a442f371, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c0f3081-b14f-4a8c-97cb-7080a442f371,segment=NetworkSegment(d20f6367-c2a9-4789-87a8-61c4756461d7),segment_id=d20f6367-c2a9-4789-87a8-61c4756461d7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:55.531092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.544605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] Calling delete_port for 8c0f3081-b14f-4a8c-97cb-7080a442f371 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:55.579901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Router 15b14e9a-de93-4269-8506-a6c7c12ab464 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:12:55.617731 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d53e2957-5f85-48b1-83ef-5c3ccf22f43e req-bb144da1-eb62-417f-a656-835cfd9d18dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1134169 Nov 24 04:12:55.729882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.740423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c6b5905-0203-436a-8f50-5790568a372e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.743580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c6b5905-0203-436a-8f50-5790568a372e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.744483 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2c6b5905-0203-436a-8f50-5790568a372e admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/4a6af1d4-2f7e-48c6-8a25-051499b2a123 HTTP/1.1" status: 204 len: 168 time: 0.6559622 Nov 24 04:12:55.788956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 26127f58-6127-4262-9b29-a3be9994ac89 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:55.808469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=8c0f3081-b14f-4a8c-97cb-7080a442f371,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:55.812520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c6b5905-0203-436a-8f50-5790568a372e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a6af1d4-2f7e-48c6-8a25-051499b2a123,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:55.816030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port 8c0f3081-b14f-4a8c-97cb-7080a442f371 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:55.873092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.873363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No active binding found for port 26127f58-6127-4262-9b29-a3be9994ac89 {{(pid=103382) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 24 04:12:55.873669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 26127f58-6127-4262-9b29-a3be9994ac89 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 24 04:12:55.897444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Port 26127f58-6127-4262-9b29-a3be9994ac89 not found, will not notify nova. {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 24 04:12:55.899642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.937656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:55.952301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] No DVR routers for this DVR port 8c0f3081-b14f-4a8c-97cb-7080a442f371 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:55.953947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00748c1e-605a-46e7-a6fe-4df991a504b5 None None] Pushing event deleted for resources: {'Port': ['ID=8c0f3081-b14f-4a8c-97cb-7080a442f371,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:55.982192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e61bd646-fcd7-4a33-a97e-24f14536e4b7']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:55.992035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.002218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd20f6367-c2a9-4789-87a8-61c4756461d7') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:56.002568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd20f6367-c2a9-4789-87a8-61c4756461d7') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:56.059129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ef7685-d396-44f2-9a62-c7151f59df05 req-9f57fd2a-cc86-46e1-a0e9-47f3ac370e78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:56.060685 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a0ef7685-d396-44f2-9a62-c7151f59df05 req-9f57fd2a-cc86-46e1-a0e9-47f3ac370e78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 946 time: 0.3254790 Nov 24 04:12:56.071904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.075363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 95413140-775e-498b-af60-54ee10e12e3b no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:56.078468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:12:56.104793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Port': ['ID=26127f58-6127-4262-9b29-a3be9994ac89,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:56.124259 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Sync routers for ids ['15b14e9a-de93-4269-8506-a6c7c12ab464'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:12:56.132917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 95413140-775e-498b-af60-54ee10e12e3b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:56.133943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 95413140-775e-498b-af60-54ee10e12e3b not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:56.134509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c0f3081-b14f-4a8c-97cb-7080a442f371 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:56.136334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=4a352f55-f9a2-464c-85c5-c0cc336109ae,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:56.177158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.180094 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.183712 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-673fc268-d636-4938-93cc-58c9befbdda8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 4.4518285 Nov 24 04:12:56.187125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': '32f5dc19-cc1b-4482-86fd-0fcbd594d46e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:56.187435 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: 340b0d89-3868-4035-92e8-6cf8cee12cb2, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:12:56.193312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33254) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:56.216407 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 8c0f3081-b14f-4a8c-97cb-7080a442f371 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:56.216876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c0f3081-b14f-4a8c-97cb-7080a442f371 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:56.221543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Routers {'15b14e9a-de93-4269-8506-a6c7c12ab464'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:56.222319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['15b14e9a-de93-4269-8506-a6c7c12ab464'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:56.243579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No DVR routers for this DVR port 26127f58-6127-4262-9b29-a3be9994ac89 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:12:56.302482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 178 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:56.303077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.306387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:56.309658 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:56.378771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a0ef7685-d396-44f2-9a62-c7151f59df05 req-093ef46d-d57e-4194-90b7-f4fe8eb39512 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3086858 Nov 24 04:12:56.390580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33260) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:56.421005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Set router 15b14e9a-de93-4269-8506-a6c7c12ab464 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:12:56.457593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.472230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.478490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/e61bd646-fcd7-4a33-a97e-24f14536e4b7 HTTP/1.1" status: 204 len: 168 time: 2.4339399 Nov 24 04:12:56.490415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33264) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:56.518521 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-85ec325e-b7c5-4c5b-9dde-22ebf3d57bb5 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/15b14e9a-de93-4269-8506-a6c7c12ab464 HTTP/1.1" status: 200 len: 907 time: 0.3227336 Nov 24 04:12:56.519879 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:12:56.550577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33266) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:56.558920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8270f1-6c14-4b4f-8b93-e5978dee29b8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=e61bd646-fcd7-4a33-a97e-24f14536e4b7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:56.671753 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.678500 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bcda45a-be8a-41e6-8d39-87aa50417276 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:56.713930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15b14e9a-de93-4269-8506-a6c7c12ab464', 'name': 'tempest-snat-router-1174715920', 'tenant_id': 'e9d040c743724e29897c8fd842f0d888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.95'}], 'enable_snat': True}, 'gw_port_id': '455b52e8-4718-4092-9f90-a8175c32c051', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:51Z', 'updated_at': '2021-11-24T04:12:54Z', 'revision_number': 3, 'project_id': 'e9d040c743724e29897c8fd842f0d888', 'gw_port': {'id': '455b52e8-4718-4092-9f90-a8175c32c051', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:07:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15b14e9a-de93-4269-8506-a6c7c12ab464', 'device_owner': 'network:router_gateway', 'standard_attr_id': 936, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:53Z', 'updated_at': '2021-11-24T04:12:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:56.729271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=36269490-865c-4eba-9673-710bb7e18ad6,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:56.750122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Checking router: 15b14e9a-de93-4269-8506-a6c7c12ab464 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:12:56.750497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Updating router 15b14e9a-de93-4269-8506-a6c7c12ab464 port 455b52e8-4718-4092-9f90-a8175c32c051 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:12:56.781857 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.804477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6b43757d-fcc3-4861-997a-4f74459f796e None None] Could not find standard attr ID for object 26127f58-6127-4262-9b29-a3be9994ac89. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:12:56.815991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.819707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 340b0d89-3868-4035-92e8-6cf8cee12cb2) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:56.853454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25c65c24-9bfa-43ec-8be3-707bf479a7eb None None] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:56.880439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:56.881191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.891054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:56.900399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43f3ec0b-5dd4-4565-8795-eac5c2a6a05e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:56.904743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-43f3ec0b-5dd4-4565-8795-eac5c2a6a05e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1094 time: 0.5089104 Nov 24 04:12:56.915109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33276) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:56.918881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['26acdcb7-a599-403a-86ab-8693d58c45f0']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:56.932305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:56.943403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '23fe78d1-f621-4fad-bb8d-4de1ae6654a2') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:56.943403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '23fe78d1-f621-4fad-bb8d-4de1ae6654a2') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:12:57.002808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33280) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.003855 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f5205b77-f71c-4722-bb81-9d215dfcb414 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0783367 Nov 24 04:12:57.005825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.025576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-1446179138'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:57.055156 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.067710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.078797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.162487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33282) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.167336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 190 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:12:57.167776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:12:57.247667 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:12:57.267891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Deleting port 455b52e8-4718-4092-9f90-a8175c32c051 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:57.268430 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.279161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.284801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.289095 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/26acdcb7-a599-403a-86ab-8693d58c45f0 HTTP/1.1" status: 204 len: 168 time: 3.4432266 Nov 24 04:12:57.297396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33286) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.311320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-340b0d89-3868-4035-92e8-6cf8cee12cb2', 'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': '4a352f55-f9a2-464c-85c5-c0cc336109ae'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:12:57.312267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.318927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0da13deb-aa29-4159-a63b-b4f838d0b5a7 None None] DHCP port deletion for 26acdcb7-a599-403a-86ab-8693d58c45f0 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:57.324483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d962974-0f02-402b-a65f-1b4b29477996 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=26acdcb7-a599-403a-86ab-8693d58c45f0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:57.326291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-34cf85a7-d2a7-47bc-b17c-f638769abd59 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] Request body: {'port': {'network_id': 'e786d5d0-8350-48ae-9d8b-0b841d399c46', 'name': 'tempest-NetworksNegativeTestJSON-1195709307'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:57.343950 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-34cf85a7-d2a7-47bc-b17c-f638769abd59 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] POST failed (client error): The resource could not be found. Nov 24 04:12:57.344708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-34cf85a7-d2a7-47bc-b17c-f638769abd59 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.347108 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-34cf85a7-d2a7-47bc-b17c-f638769abd59 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.1828096 Nov 24 04:12:57.359178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33288) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.371717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3dc3b08-7b05-418f-a012-97507a5e5919 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:57.379113 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-e0572f67-22dd-401f-bb34-5f8a1cf25fa2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:57.380181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e0572f67-22dd-401f-bb34-5f8a1cf25fa2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.383373 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e0572f67-22dd-401f-bb34-5f8a1cf25fa2 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/26acdcb7-a599-403a-86ab-8693d58c45f0 HTTP/1.1" status: 404 len: 339 time: 0.0850327 Nov 24 04:12:57.389855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33290) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.397798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1447827495', 'description': 'd1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:57.413348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3dc3b08-7b05-418f-a012-97507a5e5919 None None] Network 26acdcb7-a599-403a-86ab-8693d58c45f0 could not be found, it might have been deleted concurrently. {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:225}} Nov 24 04:12:57.416754 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-a5f3cceb-04ce-4e1d-b7b9-feff3745d114 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:57.417717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a5f3cceb-04ce-4e1d-b7b9-feff3745d114 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.427034 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a5f3cceb-04ce-4e1d-b7b9-feff3745d114 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "DELETE /v2.0/networks/b3213fcd-9595-4cdd-89ec-3ad803ac80e0 HTTP/1.1" status: 404 len: 339 time: 0.0636997 Nov 24 04:12:57.427793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33292) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.435328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.438069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.462181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Calling delete_port for 455b52e8-4718-4092-9f90-a8175c32c051 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:57.463220 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:12:57.463220 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 24 04:12:57.463220 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'project_id_1': '372dd3329b1c46059a975406a09b4bcc', 'expiration_1': datetime.datetime(2021, 11, 24, 4, 12, 37, 428739)}] Nov 24 04:12:57.463220 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:57.463950 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:57.464939 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-b44d4d85-08a7-48d0-83b8-b90bae30762b tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:57.466083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b44d4d85-08a7-48d0-83b8-b90bae30762b tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.474514 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b44d4d85-08a7-48d0-83b8-b90bae30762b tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "DELETE /v2.0/ports/e35b3b51-6812-42c9-a5bd-a762db3242eb HTTP/1.1" status: 404 len: 333 time: 0.0428202 Nov 24 04:12:57.484530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33294) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.499469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.501147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:57.504666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.518537 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-102ccff6-fda7-4330-a230-da0dab7246f7 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] DELETE failed (client error): The resource could not be found. Nov 24 04:12:57.519007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-102ccff6-fda7-4330-a230-da0dab7246f7 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.525578 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-102ccff6-fda7-4330-a230-da0dab7246f7 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "DELETE /v2.0/subnets/0405f522-f31b-4591-9145-00ad8a410bd9 HTTP/1.1" status: 404 len: 337 time: 0.0358577 Nov 24 04:12:57.526773 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33296) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.526898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.557205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-61ec7477-7209-4d44-ad77-61eca262ff31 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] GET failed (client error): The resource could not be found. Nov 24 04:12:57.562091 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-61ec7477-7209-4d44-ad77-61eca262ff31 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "GET /v2.0/networks/208d20d5-5963-4a4c-90ff-e5b12dcff3d2 HTTP/1.1" status: 404 len: 339 time: 0.0318773 Nov 24 04:12:57.571618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33298) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.616148 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 171, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:57.643579 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-63c61816-ab6b-4bc2-8e7c-13854bf32d23 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] GET failed (client error): The resource could not be found. Nov 24 04:12:57.645918 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-63c61816-ab6b-4bc2-8e7c-13854bf32d23 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "GET /v2.0/ports/e8181ab5-e909-45db-8454-19372cab11af HTTP/1.1" status: 404 len: 333 time: 0.0709140 Nov 24 04:12:57.650819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33300) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.654028 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.672041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb20ad45-3f30-42d6-a644-1764997ddfcb None None] Pushing event updated for resources: {'Port': ['ID=455b52e8-4718-4092-9f90-a8175c32c051,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:57.678266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.678662 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 080b57ee-c55b-4ba8-a821-67592292142f of type vlan for network ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 Nov 24 04:12:57.683009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3244a0f-57c1-4b97-8913-09f0969a6d69 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:57.686827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 16dd5218-f127-4c56-9f21-00fc842ff8a4 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:57.749864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Attempting to bind port 455b52e8-4718-4092-9f90-a8175c32c051 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:57.751225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Attempting to bind port 455b52e8-4718-4092-9f90-a8175c32c051 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:57.751838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Attempting to bind port 455b52e8-4718-4092-9f90-a8175c32c051 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:57.760694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:57.761365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:57.761953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.762548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:57.763761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Bound port: 455b52e8-4718-4092-9f90-a8175c32c051, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:57.764496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.764860 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-1bac2964-3a42-47a6-ba57-286b3424c075 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] GET failed (client error): The resource could not be found. Nov 24 04:12:57.769926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.772461 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1bac2964-3a42-47a6-ba57-286b3424c075 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "GET /v2.0/subnets/c840f234-80ae-4bb2-853c-1b7c9b8c5bb0 HTTP/1.1" status: 404 len: 337 time: 0.1151285 Nov 24 04:12:57.772627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33302) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.785282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.143 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/fc244ada-be12-4593-a3c6-dcb3cae0ded0) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:57.790467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e3231f62-c674-43f0-b9f4-9c7f36cbfc12 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] Request body: {'network': {'name': 'new_name'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:57.804287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 16dd5218-f127-4c56-9f21-00fc842ff8a4 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:57.804652 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.815612 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-e3231f62-c674-43f0-b9f4-9c7f36cbfc12 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] PUT failed (client error): The resource could not be found. Nov 24 04:12:57.816054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e3231f62-c674-43f0-b9f4-9c7f36cbfc12 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.817835 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e3231f62-c674-43f0-b9f4-9c7f36cbfc12 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "PUT /v2.0/networks/08da3379-9d22-4077-b5b0-f6570ce248f1 HTTP/1.1" status: 404 len: 339 time: 0.0334854 Nov 24 04:12:57.827282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33304) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.840281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Allocated IP 2001:db8::2 (340b0d89-3868-4035-92e8-6cf8cee12cb2/4a352f55-f9a2-464c-85c5-c0cc336109ae/c31360a6-a8e5-4908-b155-400ec93700c5) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:57.848234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2414f8da-0c87-4027-be1c-9b12f053af71 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] Request body: {'port': {'name': 'new_name'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:57.903890 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-2414f8da-0c87-4027-be1c-9b12f053af71 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] PUT failed (client error): The resource could not be found. Nov 24 04:12:57.909596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2414f8da-0c87-4027-be1c-9b12f053af71 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.910854 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2414f8da-0c87-4027-be1c-9b12f053af71 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "PUT /v2.0/ports/82c041cf-07c2-48eb-bfc3-058493d1c778 HTTP/1.1" status: 404 len: 333 time: 0.0819194 Nov 24 04:12:57.913927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bcd64140-79ea-442b-927a-058e084a1e15 None None] Provisioning complete for port 455b52e8-4718-4092-9f90-a8175c32c051 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:57.913927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bcd64140-79ea-442b-927a-058e084a1e15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.915111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33306) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:57.923778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d0670e6b-1d6d-4aad-a92a-3f0c1c8e6f94 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:57.930613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.936160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:57.936807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:57.953894 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d0670e6b-1d6d-4aad-a92a-3f0c1c8e6f94 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] PUT failed (client error): The resource could not be found. Nov 24 04:12:57.954116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bcd64140-79ea-442b-927a-058e084a1e15 None None] Port 455b52e8-4718-4092-9f90-a8175c32c051 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:12:57.954269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d0670e6b-1d6d-4aad-a92a-3f0c1c8e6f94 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:12:57.958484 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d0670e6b-1d6d-4aad-a92a-3f0c1c8e6f94 tempest-NetworksNegativeTestJSON-267291474 tempest-NetworksNegativeTestJSON-267291474-project] 10.222.0.48 "PUT /v2.0/subnets/cef9f00a-07ba-480f-8bb8-698921ffef82 HTTP/1.1" status: 404 len: 337 time: 0.0354056 Nov 24 04:12:58.102205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:58.106081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.141869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 0631f15d-b540-4bf7-a8f5-2997891cc257 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:12:58.229343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.232750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 156ac190-86bf-4a9d-9929-0d063229f101 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:58.233099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.235941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 26127f58-6127-4262-9b29-a3be9994ac89 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:12:58.279100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.291236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 26127f58-6127-4262-9b29-a3be9994ac89 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:12:58.292054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 26127f58-6127-4262-9b29-a3be9994ac89 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:12:58.328671 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 0.9374769 Nov 24 04:12:58.348653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33312) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:58.357498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:58.367175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:58.371994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0aea8ff-50fe-4c70-8e53-45b328f076fb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:58.376338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:58.376789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.395291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:58.411819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.415930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33314) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:58.424110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event deleted for resources: {'Port': ['ID=455b52e8-4718-4092-9f90-a8175c32c051,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:58.473743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Retry wrapper got retriable exception: UPDATE statement on table 'ml2_port_bindings' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:12:58.474140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin._bind_port_if_needed {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:12:58.475675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::21b (340b0d89-3868-4035-92e8-6cf8cee12cb2/4a352f55-f9a2-464c-85c5-c0cc336109ae/0631f15d-b540-4bf7-a8f5-2997891cc257) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:12:58.492519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0305be49-43ba-4d0e-bd32-36e3cf120a06 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:12:58.497840 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Attempting to bind port c31360a6-a8e5-4908-b155-400ec93700c5 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:58.498253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Attempting to bind port c31360a6-a8e5-4908-b155-400ec93700c5 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '32f5dc19-cc1b-4482-86fd-0fcbd594d46e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:58.498631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Attempting to bind port c31360a6-a8e5-4908-b155-400ec93700c5 on network 340b0d89-3868-4035-92e8-6cf8cee12cb2 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:58.501131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Pushing event updated for resources: {'Port': ['ID=c31360a6-a8e5-4908-b155-400ec93700c5,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:58.543096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.544591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:58.544968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Checking segment: {'id': '32f5dc19-cc1b-4482-86fd-0fcbd594d46e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:58.545339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 156ac190-86bf-4a9d-9929-0d063229f101, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=156ac190-86bf-4a9d-9929-0d063229f101,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:58.545529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.545758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Bound using segment: {'id': '32f5dc19-cc1b-4482-86fd-0fcbd594d46e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:58.546307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.546444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Bound port: c31360a6-a8e5-4908-b155-400ec93700c5, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32f5dc19-cc1b-4482-86fd-0fcbd594d46e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '340b0d89-3868-4035-92e8-6cf8cee12cb2'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:58.546734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.555828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.564132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-807e574c-9236-42eb-bd4f-6b64d81d8359 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:58.569101 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-807e574c-9236-42eb-bd4f-6b64d81d8359 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks?id=ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 HTTP/1.1" status: 200 len: 761 time: 0.2166426 Nov 24 04:12:58.570119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33318) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:58.583008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'description': 'd2'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:58.603123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 156ac190-86bf-4a9d-9929-0d063229f101 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:58.629091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] For port c31360a6-a8e5-4908-b155-400ec93700c5, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:12:58.633778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] For port c31360a6-a8e5-4908-b155-400ec93700c5, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c31360a6-a8e5-4908-b155-400ec93700c5,segment=NetworkSegment(32f5dc19-cc1b-4482-86fd-0fcbd594d46e),segment_id=32f5dc19-cc1b-4482-86fd-0fcbd594d46e)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:12:58.640327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.703443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-754bb6fe-7aba-45ca-9523-7c939a895bd6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.706756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ac08ad-1a55-4547-b1b3-61b2f5a2f4d3 None None] Pushing event updated for resources: {'Port': ['ID=c31360a6-a8e5-4908-b155-400ec93700c5,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:58.707084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:58.710202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.728554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.734604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:58.745595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:58.808637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=fc244ada-be12-4593-a3c6-dcb3cae0ded0,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:58.839321 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.839873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 15b14e9a-de93-4269-8506-a6c7c12ab464 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:12:58.865681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:58.865681 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9e99cb63-92df-404b-bcfb-3d4e44f18a1e tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/routers/15b14e9a-de93-4269-8506-a6c7c12ab464 HTTP/1.1" status: 204 len: 168 time: 2.2952223 Nov 24 04:12:58.870016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33320) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:58.995331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Attempting to bind port 455b52e8-4718-4092-9f90-a8175c32c051 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:12:58.996493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Attempting to bind port 455b52e8-4718-4092-9f90-a8175c32c051 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:12:58.997077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Attempting to bind port 455b52e8-4718-4092-9f90-a8175c32c051 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:12:59.005862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:12:59.006592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:12:59.007250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.007827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:12:59.008477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Bound port: 455b52e8-4718-4092-9f90-a8175c32c051, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:12:59.009067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.038119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Port 455b52e8-4718-4092-9f90-a8175c32c051 has been deleted concurrently {{(pid=103382) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Nov 24 04:12:59.051537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Routers set() bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:12:59.053275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Router IDs set() for agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 04:12:59.055959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_agentschedulers_db [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'15b14e9a-de93-4269-8506-a6c7c12ab464'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent'). {{(pid=103382) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Nov 24 04:12:59.057870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bebf844-69be-4d06-b1c4-176dcee964ea None None] The sync data for ids ['15b14e9a-de93-4269-8506-a6c7c12ab464'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:12:59.139938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-754bb6fe-7aba-45ca-9523-7c939a895bd6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.151635 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.190283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-754bb6fe-7aba-45ca-9523-7c939a895bd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.231418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.296468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.317903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754bb6fe-7aba-45ca-9523-7c939a895bd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6709baca-760c-4c40-abc4-4fa15a852559,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:59.327310 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-754bb6fe-7aba-45ca-9523-7c939a895bd6 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=38fd8c5c5a77433597ea4bb31d1f79b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9101205 Nov 24 04:12:59.328368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.330243 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33322) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:59.360893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 is not hosted by any dhcp agent {{(pid=103380) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:12:59.367138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:59.367733 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.367942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.369008 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "PUT /v2.0/networks/ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 HTTP/1.1" status: 200 len: 758 time: 0.7940307 Nov 24 04:12:59.371908 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33324) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:59.432237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.489730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1c1fc6-c30b-4dee-9848-f32fc424f994 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:59.494268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6a33cdf-1ddc-4759-88ec-5b24254eeecf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:59.495779 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c6a33cdf-1ddc-4759-88ec-5b24254eeecf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks?id=ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 HTTP/1.1" status: 200 len: 761 time: 0.1225734 Nov 24 04:12:59.500723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33326) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:59.506017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-59509448'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:12:59.519956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:12:59.536313 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:12:59.548308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:12:59.559800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:12:59.574081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:12:59.574854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.579606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.599571 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=0631f15d-b540-4bf7-a8f5-2997891cc257,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:59.609065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f72b9784-2928-469c-a1cc-aa715634499c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.648833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Deleting port 16dd5218-f127-4c56-9f21-00fc842ff8a4 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:12:59.649418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.662054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e715e6c3-a970-4d74-b7db-2d5be2539c19 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 893 time: 2.6535025 Nov 24 04:12:59.668313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c31360a6-a8e5-4908-b155-400ec93700c5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:12:59.685312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33328) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:12:59.690556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=156ac190-86bf-4a9d-9929-0d063229f101,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:12:59.746108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port c31360a6-a8e5-4908-b155-400ec93700c5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:12:59.746660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.755507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:12:59.759922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.786565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f72b9784-2928-469c-a1cc-aa715634499c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.815626 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] For port 16dd5218-f127-4c56-9f21-00fc842ff8a4, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=16dd5218-f127-4c56-9f21-00fc842ff8a4,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:59.815984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.879231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.919900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 164, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:12:59.944294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port c31360a6-a8e5-4908-b155-400ec93700c5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c31360a6-a8e5-4908-b155-400ec93700c5,segment=NetworkSegment(32f5dc19-cc1b-4482-86fd-0fcbd594d46e),segment_id=32f5dc19-cc1b-4482-86fd-0fcbd594d46e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:12:59.950908 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.959764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Calling delete_port for 16dd5218-f127-4c56-9f21-00fc842ff8a4 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:12:59.960759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b1b6107-dcac-449f-8092-a575a3c6b4ce None None] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:12:59.969738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:12:59.970259 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment cae496b9-6fe6-4c20-8903-aa8426687088 of type vlan for network b4a86686-cdc2-4b1b-acb3-f8c21c252122 Nov 24 04:13:00.007975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 0631f15d-b540-4bf7-a8f5-2997891cc257 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:00.008356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.075849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9141387c-0a4e-4110-8d95-9f8a755dbba6 None None] Provisioning complete for port c31360a6-a8e5-4908-b155-400ec93700c5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:00.076507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9141387c-0a4e-4110-8d95-9f8a755dbba6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.079279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=c31360a6-a8e5-4908-b155-400ec93700c5,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:00.118714 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.132337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 0631f15d-b540-4bf7-a8f5-2997891cc257 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:00.141460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.223815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.229465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:00.230238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.246968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.264928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.275966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.304640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=0631f15d-b540-4bf7-a8f5-2997891cc257,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:00.311663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f72b9784-2928-469c-a1cc-aa715634499c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.313039 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f72b9784-2928-469c-a1cc-aa715634499c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.317718 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f72b9784-2928-469c-a1cc-aa715634499c admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/6709baca-760c-4c40-abc4-4fa15a852559 HTTP/1.1" status: 204 len: 168 time: 0.9824314 Nov 24 04:13:00.393212 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.8913963 Nov 24 04:13:00.398511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33332) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:00.407799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:00.427197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-311df11c-5cba-4105-81d8-16ebd3586f02 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=b4a86686-cdc2-4b1b-acb3-f8c21c252122,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:00.434726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f72b9784-2928-469c-a1cc-aa715634499c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6709baca-760c-4c40-abc4-4fa15a852559,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:00.458611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network b4a86686-cdc2-4b1b-acb3-f8c21c252122 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:00.461684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.481636 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-55914d3b-aa91-41e9-ba92-7118911b77a5 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/0631f15d-b540-4bf7-a8f5-2997891cc257 HTTP/1.1" status: 204 len: 168 time: 0.7872343 Nov 24 04:13:00.484544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33334) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:00.533214 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-758c105b-1030-41cb-8697-407b05cbe4ed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:00.539031 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-758c105b-1030-41cb-8697-407b05cbe4ed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/0631f15d-b540-4bf7-a8f5-2997891cc257 HTTP/1.1" status: 404 len: 333 time: 0.0461545 Nov 24 04:13:00.562945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33338) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:00.701867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:00.705770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.865397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d820e128-301f-49f6-8de6-165839020c7c None None] Provisioning complete for port c31360a6-a8e5-4908-b155-400ec93700c5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:00.865779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d820e128-301f-49f6-8de6-165839020c7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:00.997936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.060328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 4a352f55-f9a2-464c-85c5-c0cc336109ae {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:01.065221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.071450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:01.105386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=fabf123a-8e02-41ad-befb-7dc8438c01a5,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:01.142061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.153163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.193236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-393afcb2-8002-41a2-ab52-1e572addf143 None None] Could not find standard attr ID for object 0631f15d-b540-4bf7-a8f5-2997891cc257. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:13:01.208390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': 'cae496b9-6fe6-4c20-8903-aa8426687088', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:01.208700 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: b4a86686-cdc2-4b1b-acb3-f8c21c252122, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:01.244687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:01.253627 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a7cfc3e5-fcc7-4bf9-a26a-2fa3db19d8cd tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7566967 Nov 24 04:13:01.255205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33352) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:01.260334 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966530db-0258-4860-96b7-9c4229423e32 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:01.263831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network b4a86686-cdc2-4b1b-acb3-f8c21c252122 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:01.280651 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:01.281709 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:01.286212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.313011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, b4a86686-cdc2-4b1b-acb3-f8c21c252122) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:01.321941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:01.322618 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.328086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-751b7770-a063-441e-8e5e-1f92f2955a4d None None] Network b4a86686-cdc2-4b1b-acb3-f8c21c252122 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:01.361322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet eca384a0-ac7f-4e35-8e16-c905722624f0 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:01.366290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.400039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event deleted for resources: {'Port': ['ID=16dd5218-f127-4c56-9f21-00fc842ff8a4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:01.415419 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d61172b3-1b6f-4f49-878e-bf11a078e258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0120211 Nov 24 04:13:01.418769 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33358) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:01.476333 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:01.503401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fb82f06-63e1-4040-b47c-9892e6ee22ba None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:01.537050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.641598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33360) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:01.656274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-b4a86686-cdc2-4b1b-acb3-f8c21c252122', 'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': 'fabf123a-8e02-41ad-befb-7dc8438c01a5'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:01.657333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.663385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.793956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.824384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.859563 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:59Z', 'revision_number': 9, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:01.860616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:01.893081 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966530db-0258-4860-96b7-9c4229423e32 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:01.913405 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:01.914453 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:01.936669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Allocated IP 172.20.0.2 (b4a86686-cdc2-4b1b-acb3-f8c21c252122/fabf123a-8e02-41ad-befb-7dc8438c01a5/7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:02.016019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.030013 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:02.037207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c665fc82-8a87-4251-919f-ac4e07416e46 tempest-DvrRoutersNegativeTest-133423146 tempest-DvrRoutersNegativeTest-133423146-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-1634572677', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:02.040333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.policy [None req-c665fc82-8a87-4251-919f-ac4e07416e46 tempest-DvrRoutersNegativeTest-133423146 tempest-DvrRoutersNegativeTest-133423146-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=103381) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Nov 24 04:13:02.040632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.policy [None req-c665fc82-8a87-4251-919f-ac4e07416e46 tempest-DvrRoutersNegativeTest-133423146 tempest-DvrRoutersNegativeTest-133423146-project] Failed policy check for 'create_router' {{(pid=103381) enforce /opt/stack/neutron/neutron/policy.py:524}} Nov 24 04:13:02.041163 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-c665fc82-8a87-4251-919f-ac4e07416e46 tempest-DvrRoutersNegativeTest-133423146 tempest-DvrRoutersNegativeTest-133423146-project] create failed (client error): Access was denied to this resource. Nov 24 04:13:02.058335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c665fc82-8a87-4251-919f-ac4e07416e46 tempest-DvrRoutersNegativeTest-133423146 tempest-DvrRoutersNegativeTest-133423146-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.3933001 Nov 24 04:13:02.060922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.072313 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.083877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.086737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.087034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c31360a6-a8e5-4908-b155-400ec93700c5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:02.089413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.116474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.117903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.140984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.170513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Network b4a86686-cdc2-4b1b-acb3-f8c21c252122 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:02.175417 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:02.182776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:02.211204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=eca384a0-ac7f-4e35-8e16-c905722624f0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:02.216311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.224427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Pushing event updated for resources: {'Port': ['ID=7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:02.232695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.235983 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5f791612-9e07-469e-8aee-ee6f9c3c9223 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/eca384a0-ac7f-4e35-8e16-c905722624f0 HTTP/1.1" status: 204 len: 168 time: 0.9798417 Nov 24 04:13:02.239929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33366) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:02.251168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beb525be-f71c-48ae-b8de-c6590ad7fab4 None None] Network db88bd2b-781c-4449-a342-faf837b9a6c2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:02.272662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port c31360a6-a8e5-4908-b155-400ec93700c5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:02.272989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.297842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=fabf123a-8e02-41ad-befb-7dc8438c01a5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:02.333984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=4a352f55-f9a2-464c-85c5-c0cc336109ae,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:02.345993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Attempting to bind port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:02.346342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Attempting to bind port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'cae496b9-6fe6-4c20-8903-aa8426687088', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:02.346601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Attempting to bind port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7 on network b4a86686-cdc2-4b1b-acb3-f8c21c252122 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:02.359486 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:02.359868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Checking segment: {'id': 'cae496b9-6fe6-4c20-8903-aa8426687088', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:02.360273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.360665 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Bound using segment: {'id': 'cae496b9-6fe6-4c20-8903-aa8426687088', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:02.361146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Bound port: 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cae496b9-6fe6-4c20-8903-aa8426687088', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:02.361524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.422599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.441259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33368) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:02.442488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] For port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:02.444639 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-31c65fc3-45c2-4799-9c21-a40128f2f462 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/4a352f55-f9a2-464c-85c5-c0cc336109ae HTTP/1.1" status: 204 len: 168 time: 1.8805728 Nov 24 04:13:02.445948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] For port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7,segment=NetworkSegment(cae496b9-6fe6-4c20-8903-aa8426687088),segment_id=cae496b9-6fe6-4c20-8903-aa8426687088)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:02.449540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=fc244ada-be12-4593-a3c6-dcb3cae0ded0,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:02.454565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.454989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7435401d-5d04-4765-bd03-ac73fe7fd292 None None] Network 340b0d89-3868-4035-92e8-6cf8cee12cb2 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:02.461424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.462347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:02.470304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.472452 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e880b470-a758-4329-99c8-29593812fc39 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "DELETE /v2.0/routers/98f237e9-7725-4aaa-b797-e4c0c4b7c4c5 HTTP/1.1" status: 204 len: 168 time: 3.6014454 Nov 24 04:13:02.473703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.476578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33372) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:02.488240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-294978662', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:02.491551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.504644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.506021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4a86686-cdc2-4b1b-acb3-f8c21c252122']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:02.519428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cae496b9-6fe6-4c20-8903-aa8426687088') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:02.519785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cae496b9-6fe6-4c20-8903-aa8426687088') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:02.620109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.648165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.650066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.662447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.668618 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-966530db-0258-4860-96b7-9c4229423e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:59Z', 'revision_number': 9, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:02.686357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.732418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 164 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:02.732841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.734139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33374) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:02.735202 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966530db-0258-4860-96b7-9c4229423e32 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:12:59Z', 'revision_number': 9, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '0c9b8909-e5fb-43f0-ac11-1413609fa26f', 'name': '', 'network_id': '07ee17ec-7e98-4e35-a61a-8469c8c8e6d6', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:5e:f5:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 833, 'fixed_ips': [{'subnet_id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:21Z', 'updated_at': '2021-11-24T04:12:32Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': 'df7589cb-718c-4fcd-ba62-6833177081f9', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:02.737014 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:02.778422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.781483 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP 69d31bd4-9fe6-491e-8c03-a04773e3f2d2 associated. External IP: 172.26.5.143, port: 9f1b668f-dd92-42dc-9d4b-55596d7ec904. Nov 24 04:13:02.802066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd94a74e-2e30-49f3-9c57-de9f488cab8c None None] Network b4a86686-cdc2-4b1b-acb3-f8c21c252122 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:02.844018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 04:13:02.844018 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 04:13:02.844018 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'id': 'b4a86686-cdc2-4b1b-acb3-f8c21c252122'}] Nov 24 04:13:02.844018 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:13:02.844406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:13:02.870835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 6b84891c-e073-40c7-a287-b35f1e020975 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:02.871283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.898563 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port c31360a6-a8e5-4908-b155-400ec93700c5 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:02.898822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.951548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d295dd84-9f75-4a72-a3fe-f2e299f920e0 None None] Pushing event updated for resources: {'Port': ['ID=7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:02.963621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 6b84891c-e073-40c7-a287-b35f1e020975, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6b84891c-e073-40c7-a287-b35f1e020975,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:02.963994 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:02.966369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d622799a-329f-4bda-9750-3f5baecda91f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.012102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 6b84891c-e073-40c7-a287-b35f1e020975 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:03.020468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] For port c31360a6-a8e5-4908-b155-400ec93700c5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c31360a6-a8e5-4908-b155-400ec93700c5,segment=NetworkSegment(32f5dc19-cc1b-4482-86fd-0fcbd594d46e),segment_id=32f5dc19-cc1b-4482-86fd-0fcbd594d46e)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:03.020856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.042655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for c31360a6-a8e5-4908-b155-400ec93700c5 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:03.122274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.125952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-825270e3-714e-41a2-9934-08f464496589 None None] DHCP port deletion for db88bd2b-781c-4449-a342-faf837b9a6c2 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:03.213155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-825270e3-714e-41a2-9934-08f464496589 None None] Deleting port 6b84891c-e073-40c7-a287-b35f1e020975 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:03.213684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-825270e3-714e-41a2-9934-08f464496589 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.262900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d622799a-329f-4bda-9750-3f5baecda91f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.283302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-825270e3-714e-41a2-9934-08f464496589 None None] For port 6b84891c-e073-40c7-a287-b35f1e020975, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6b84891c-e073-40c7-a287-b35f1e020975,segment=NetworkSegment(a637e051-f64d-4a8d-ab65-d3888c0c98a0),segment_id=a637e051-f64d-4a8d-ab65-d3888c0c98a0)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:03.284382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-825270e3-714e-41a2-9934-08f464496589 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.295353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d622799a-329f-4bda-9750-3f5baecda91f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.299740 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-825270e3-714e-41a2-9934-08f464496589 None None] Calling delete_port for 6b84891c-e073-40c7-a287-b35f1e020975 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:03.382225 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d622799a-329f-4bda-9750-3f5baecda91f admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=b9a92e91bb354a2f834327d0087a1983&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6415870 Nov 24 04:13:03.388375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33378) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:03.396402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-825270e3-714e-41a2-9934-08f464496589 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.402456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d622799a-329f-4bda-9750-3f5baecda91f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd07b32d-f7b2-455c-8f42-fe9fa02b3e90,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:03.423658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-825270e3-714e-41a2-9934-08f464496589 None None] Pushing event deleted for resources: {'Port': ['ID=6b84891c-e073-40c7-a287-b35f1e020975,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:03.427884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-825270e3-714e-41a2-9934-08f464496589 None None] No DVR routers for this DVR port 6b84891c-e073-40c7-a287-b35f1e020975 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:03.448401 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:03.481112 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] DHCP port deletion for 340b0d89-3868-4035-92e8-6cf8cee12cb2 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:03.486747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.526789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.558422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] Deleting port c31360a6-a8e5-4908-b155-400ec93700c5 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:03.561055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.602750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=6b84891c-e073-40c7-a287-b35f1e020975,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:03.607995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e8b637b-e1f6-4df6-ae35-c663444f9d9f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.613337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port 6b84891c-e073-40c7-a287-b35f1e020975 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:03.630458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.653595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e8b637b-e1f6-4df6-ae35-c663444f9d9f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.665311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] For port c31360a6-a8e5-4908-b155-400ec93700c5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c31360a6-a8e5-4908-b155-400ec93700c5,segment=NetworkSegment(32f5dc19-cc1b-4482-86fd-0fcbd594d46e),segment_id=32f5dc19-cc1b-4482-86fd-0fcbd594d46e)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:03.665807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.668795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 16dd5218-f127-4c56-9f21-00fc842ff8a4 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:03.702497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 16dd5218-f127-4c56-9f21-00fc842ff8a4 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:03.702822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 16dd5218-f127-4c56-9f21-00fc842ff8a4 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:03.703320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 156ac190-86bf-4a9d-9929-0d063229f101 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:03.705682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] Calling delete_port for c31360a6-a8e5-4908-b155-400ec93700c5 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:03.708413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No DVR routers for this DVR port c31360a6-a8e5-4908-b155-400ec93700c5 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:03.717293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=c31360a6-a8e5-4908-b155-400ec93700c5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:03.723447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.744154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 156ac190-86bf-4a9d-9929-0d063229f101 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:03.745154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 156ac190-86bf-4a9d-9929-0d063229f101 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:03.745154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c31360a6-a8e5-4908-b155-400ec93700c5 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:03.745707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:03.746061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.755189 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.789099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.806774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: c31360a6-a8e5-4908-b155-400ec93700c5 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:03.807647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c31360a6-a8e5-4908-b155-400ec93700c5 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:03.808393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6b84891c-e073-40c7-a287-b35f1e020975 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:03.825989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:03.833346 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6b84891c-e073-40c7-a287-b35f1e020975 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:03.833778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6b84891c-e073-40c7-a287-b35f1e020975 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:03.853452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['db88bd2b-781c-4449-a342-faf837b9a6c2']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:03.863912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.868169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:03.886344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e8b637b-e1f6-4df6-ae35-c663444f9d9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.888839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e8b637b-e1f6-4df6-ae35-c663444f9d9f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.889966 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8e8b637b-e1f6-4df6-ae35-c663444f9d9f admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/bd07b32d-f7b2-455c-8f42-fe9fa02b3e90 HTTP/1.1" status: 204 len: 168 time: 0.4989421 Nov 24 04:13:03.896861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.900362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a637e051-f64d-4a8d-ab65-d3888c0c98a0') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:03.900720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a637e051-f64d-4a8d-ab65-d3888c0c98a0') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:03.922519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:03.923251 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:03.925876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.926539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e8b637b-e1f6-4df6-ae35-c663444f9d9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd07b32d-f7b2-455c-8f42-fe9fa02b3e90,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:03.933787 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-45b8b97a-1fdf-400c-975d-fac74e08f88b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 7.0028603 Nov 24 04:13:03.933787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:13:03.936069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-accb81b4-7314-45ab-a13a-2ff1230d4a7f" -d '{"events": [{"name": "network-changed", "server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:13:03.938499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33382) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:03.975887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:03.999703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] Pushing event deleted for resources: {'Port': ['ID=c31360a6-a8e5-4908-b155-400ec93700c5,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:04.010895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['340b0d89-3868-4035-92e8-6cf8cee12cb2']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:04.014222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] For port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7,segment=NetworkSegment(cae496b9-6fe6-4c20-8903-aa8426687088),segment_id=cae496b9-6fe6-4c20-8903-aa8426687088)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:04.014602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.017326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.037552 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32f5dc19-cc1b-4482-86fd-0fcbd594d46e') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:04.037853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32f5dc19-cc1b-4482-86fd-0fcbd594d46e') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:04.040275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9baf7dc4-6066-492b-a62e-f1544f908a42 None None] No DVR routers for this DVR port c31360a6-a8e5-4908-b155-400ec93700c5 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:04.056583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 196 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:04.057002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.060917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Calling delete_port for 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:04.062191 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:04.079097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.096329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-110e646e-ed8d-47fd-9c5a-537bea863a63 None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:13:04.161444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.185187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:04.224538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 176 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:04.224956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:04.258193 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:04.260721 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.349021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.355223 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/db88bd2b-781c-4449-a342-faf837b9a6c2 HTTP/1.1" status: 204 len: 168 time: 2.0786479 Nov 24 04:13:04.365033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33394) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:04.459433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.466426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e15e1b98-1811-41f0-a6b2-02f6b7d78274 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=db88bd2b-781c-4449-a342-faf837b9a6c2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:04.482513 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-821f52ab-b63a-439d-9ad1-5ed13583ab3a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/69d31bd4-9fe6-491e-8c03-a04773e3f2d2 HTTP/1.1" status: 200 len: 992 time: 0.5290639 Nov 24 04:13:04.484447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:13:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1dfd686f-977a-4513-965f-3528916cf719 x-openstack-request-id: req-1dfd686f-977a-4513-965f-3528916cf719 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:13:04.484896 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:13:04.485357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-1dfd686f-977a-4513-965f-3528916cf719 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:13:04.485809 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'status': 'completed', 'code': 200} Nov 24 04:13:04.500772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Allocated IP 172.26.5.179 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:04.507494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Port': ['ID=7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:04.511920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.521690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No DVR routers for this DVR port 7422dcbc-6e9c-4576-9e4a-dfbfb2f86dd7 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:04.525505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.539529 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/340b0d89-3868-4035-92e8-6cf8cee12cb2 HTTP/1.1" status: 204 len: 168 time: 2.0971131 Nov 24 04:13:04.545806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33400) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:04.552017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'name': 'tempest-PortsIpV6TestJSON-927440457'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:04.552579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-110e646e-ed8d-47fd-9c5a-537bea863a63 None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:13:04.648434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.657079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-c5cdd098-b201-47fa-b929-13a63d9e7aed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:04.659315 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-c5cdd098-b201-47fa-b929-13a63d9e7aed service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1099 time: 0.1670418 Nov 24 04:13:04.672678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4a86686-cdc2-4b1b-acb3-f8c21c252122']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:04.684174 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cae496b9-6fe6-4c20-8903-aa8426687088') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:04.684529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cae496b9-6fe6-4c20-8903-aa8426687088') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:04.701159 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.719257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b76ae1-7923-46c1-a5c2-fde2d609cb71 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=340b0d89-3868-4035-92e8-6cf8cee12cb2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:04.733790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:04.737496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.756251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.791141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 164 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:04.791875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:04.795194 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:04.814366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port f1075ff8-a312-43c8-9c4a-85e3160507c9 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:04.820960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.875654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-5d8425b2-5644-4059-badc-6134d9957cd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:04.877279 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-5d8425b2-5644-4059-badc-6134d9957cd8 service neutron] 10.222.0.21 "GET /v2.0/networks?id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 898 time: 0.2050824 Nov 24 04:13:04.900618 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.932925 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:04.939546 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/b4a86686-cdc2-4b1b-acb3-f8c21c252122 HTTP/1.1" status: 204 len: 168 time: 3.5201783 Nov 24 04:13:04.945144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33410) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:04.995537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0aa8cee-5372-44ce-a765-3a3430718bf9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=b4a86686-cdc2-4b1b-acb3-f8c21c252122,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:05.000713 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-0bec8396-5a34-4851-9359-8f96531189e6 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] GET failed (client error): The resource could not be found. Nov 24 04:13:05.005700 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0bec8396-5a34-4851-9359-8f96531189e6 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/subnets/fabf123a-8e02-41ad-befb-7dc8438c01a5 HTTP/1.1" status: 404 len: 337 time: 0.0594697 Nov 24 04:13:05.008509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33412) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.041811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.052753 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:25Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:12:59Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:05.059564 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-e083c9e5-9541-4b32-bcd2-8f8a6d74447b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 200 len: 1000 time: 0.1738319 Nov 24 04:13:05.087123 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-a3363afa-f937-42c6-8e3a-02e4e4b9d45f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:05.087679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a3363afa-f937-42c6-8e3a-02e4e4b9d45f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:05.090746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3363afa-f937-42c6-8e3a-02e4e4b9d45f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/b4a86686-cdc2-4b1b-acb3-f8c21c252122 HTTP/1.1" status: 404 len: 339 time: 0.0733960 Nov 24 04:13:05.091427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-557304b7-5272-4a3a-9b65-2f09338441da None None] get_active_networks_info from dv-neutron-819049-1-hyperv {{(pid=103382) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 04:13:05.094114 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:05.095447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c3163968-8916-47dd-830d-c94b9336e4f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.096486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33416) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.129911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:05.130565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:05.148559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-e1aebc13-40a4-486a-a01a-a4f0d3514d37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.149626 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-e1aebc13-40a4-486a-a01a-a4f0d3514d37 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=c4348623-9729-4d15-a5cf-803eac33880a HTTP/1.1" status: 200 len: 834 time: 0.0481694 Nov 24 04:13:05.184394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:05.231455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:05.245936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:05.255061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event updated for resources: {'Port': ['ID=8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:05.279892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-557304b7-5272-4a3a-9b65-2f09338441da None None] Resources bound (agent type, host, resource id): {{(pid=103382) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 04:13:05.302487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.311609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-324d156f-faa1-4194-bb9c-9b9d017e7b40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.313127 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-324d156f-faa1-4194-bb9c-9b9d017e7b40 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=becef48c-b834-483b-91dc-0f71ec58e834&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1473396 Nov 24 04:13:05.352679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:05.409892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92f0641f-e280-4e57-bf0e-bd1160ac18af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.412278 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-92f0641f-e280-4e57-bf0e-bd1160ac18af tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.3113723 Nov 24 04:13:05.416333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33424) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.464601 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7cc12ce7-793b-4853-8a67-2d4f9b362caf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 207 time: 0.0465186 Nov 24 04:13:05.470107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33428) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.493174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33430) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.548613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.620759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.722003 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5fe2981-9589-420c-8dcc-81b55366b864 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.728553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5fe2981-9589-420c-8dcc-81b55366b864 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.732739 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-75a7ee2b-b92b-4963-a7cf-f88021b9b9da service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4092703 Nov 24 04:13:05.733297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.734365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5fe2981-9589-420c-8dcc-81b55366b864 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.741494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5fe2981-9589-420c-8dcc-81b55366b864 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.743214 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d5fe2981-9589-420c-8dcc-81b55366b864 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2487 time: 0.2711265 Nov 24 04:13:05.748587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33438) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.783913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b15e4a3-8d95-42ad-bb1e-e0134dcd512b None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:05.812221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:05.816754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:05.825306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:25Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:12:59Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:05.884143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e3b33cb-bffc-4dca-8372-633e7eed4247 None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:12:25Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:12:59Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:05.893225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0279b6b6-b83f-4aa1-b512-754fb6b4976d None None] Provisioning complete for port 8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:05.893749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0279b6b6-b83f-4aa1-b512-754fb6b4976d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.915093 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-accb81b4-7314-45ab-a13a-2ff1230d4a7f req-3b302834-1d24-4af1-84a7-74d5184afa25 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1013196 Nov 24 04:13:05.915916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:05.921573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:05.922255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:05.934966 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a1dad080-5b83-42e5-bcc0-25da81761f6b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/69d31bd4-9fe6-491e-8c03-a04773e3f2d2 HTTP/1.1" status: 200 len: 992 time: 0.4404287 Nov 24 04:13:05.957006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0279b6b6-b83f-4aa1-b512-754fb6b4976d None None] Port 8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:05.979597 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.4302573 Nov 24 04:13:05.992651 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5bec049b-fdd7-455f-81c0-0bcdd99e0a43 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 576 time: 0.2375836 Nov 24 04:13:05.992651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33440) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:05.998676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33442) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.013038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5fe9541-e39d-48a9-bf8e-29bf1c750ed0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=f1075ff8-a312-43c8-9c4a-85e3160507c9,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:06.148600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.227779 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-176290ab-38b6-4815-9cdc-07046456e545 None None] New status for floating IP 69d31bd4-9fe6-491e-8c03-a04773e3f2d2: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:13:06.245042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33444) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.249487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1226514769', 'description': 'tempest-secgroup-smoke-1226514769 description', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:06.287874 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.301363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.343413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Router 5be0625b-048a-4d37-8c2e-e83f3b3a8c57 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:06.437446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a30c5de-953e-4a52-82a2-a4b7ab989fdd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:06.439111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a30c5de-953e-4a52-82a2-a4b7ab989fdd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:06.440792 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a30c5de-953e-4a52-82a2-a4b7ab989fdd tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.4391670 Nov 24 04:13:06.457861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33446) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.502859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.512079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port f1075ff8-a312-43c8-9c4a-85e3160507c9 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:06.512427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.514663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.555314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2825954-d4a4-47e9-a308-8c80b5006528 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:06.556731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2825954-d4a4-47e9-a308-8c80b5006528 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:06.558252 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b2825954-d4a4-47e9-a308-8c80b5006528 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.0992908 Nov 24 04:13:06.559402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:06.571802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33448) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.574097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] Sync routers for ids ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:06.593777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 0c9b8909-e5fb-43f0-ac11-1413609fa26f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:06.594180 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.598593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] Routers {'5be0625b-048a-4d37-8c2e-e83f3b3a8c57'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:06.599490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:06.601679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.610090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ab5a44f3-7d32-48f2-9fee-89a71fafd065,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:06.635400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for f1075ff8-a312-43c8-9c4a-85e3160507c9 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:06.636927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.638293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c7aed300-d749-40ca-8195-630a0df0d826 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 4.1598649 Nov 24 04:13:06.643393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33450) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.644806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:06.655907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] Routers {'5be0625b-048a-4d37-8c2e-e83f3b3a8c57'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:06.656778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:12:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:06.675034 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': False}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:06.697958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:06.699005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d63dc3e-81fe-49e1-b1a4-1947f3615324 None None] The sync data for ids ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:06.754548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 0c9b8909-e5fb-43f0-ac11-1413609fa26f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0c9b8909-e5fb-43f0-ac11-1413609fa26f,segment=NetworkSegment(8e83a68c-90ac-4187-a0fb-888745040938),segment_id=8e83a68c-90ac-4187-a0fb-888745040938)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:06.754920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.771183 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 0c9b8909-e5fb-43f0-ac11-1413609fa26f owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:06.783897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.796321 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.825154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.829214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f4ff876-66bc-4825-bcbd-b8456c6d8539 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:06.834600 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9f4ff876-66bc-4825-bcbd-b8456c6d8539 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks/c62f8a24-132b-4a75-9aa8-b8366a6c2c14 HTTP/1.1" status: 200 len: 800 time: 0.2578955 Nov 24 04:13:06.839466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33452) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.849185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.853037 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.6043727 Nov 24 04:13:06.855681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33454) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.860092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group_rule': {'security_group_id': 'e24375a3-c4f9-4455-8a33-cc4587a3c8fa', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:06.870331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5623d478-ce14-4722-816b-8b928d0aa42e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e24375a3-c4f9-4455-8a33-cc4587a3c8fa,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:06.897189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:06.902973 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/f1075ff8-a312-43c8-9c4a-85e3160507c9 HTTP/1.1" status: 204 len: 168 time: 0.9086404 Nov 24 04:13:06.905851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d94d47b-ef20-44f7-a4c8-31ed5c8dbde6 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=f1075ff8-a312-43c8-9c4a-85e3160507c9,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:06.908961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33456) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:06.924219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'mac_address': 'fa:16:3e:89:3c:ab', 'name': 'tempest-PortsIpV6TestJSON-128965520'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:06.946807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33458) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:07.159004 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fa4e80a6-9cae-4cfb-a529-96d795251887 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/69d31bd4-9fe6-491e-8c03-a04773e3f2d2 HTTP/1.1" status: 200 len: 994 time: 0.2111640 Nov 24 04:13:07.179626 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-58926f42-38f6-40e8-a6af-e612ea392295 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/networks/c62f8a24-132b-4a75-9aa8-b8366a6c2c14?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.3380518 Nov 24 04:13:07.184026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33460) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:07.263549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.282033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:07.298810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88c37394-8d01-4251-acba-734699b0332f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:07.300371 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-88c37394-8d01-4251-acba-734699b0332f tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/subnets/99e91869-c724-430f-9652-ac006fab3f8a HTTP/1.1" status: 200 len: 811 time: 0.1155784 Nov 24 04:13:07.300927 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.305066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33462) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:07.337936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=0c9b8909-e5fb-43f0-ac11-1413609fa26f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:07.427144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.449602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3588ad3f-cf6d-4fd6-b5e9-0e1f93e48d84 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['shared'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:07.451065 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3588ad3f-cf6d-4fd6-b5e9-0e1f93e48d84 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "GET /v2.0/subnets/99e91869-c724-430f-9652-ac006fab3f8a?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.1439912 Nov 24 04:13:07.455178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33464) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:07.459684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.463205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-368079705'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:07.470767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 1ce0bd08-9d02-4a74-9573-7ee6fabf8667 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:07.470959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.496455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.516529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=049fd967-975e-4a17-8c86-ed5cb21dd11a,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:07.611750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:07.615599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.616203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.619208 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a5a85c98-36ae-4380-a2da-f064423c67cb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7601519 Nov 24 04:13:07.620296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33466) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:07.624565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group_rule': {'security_group_id': 'e24375a3-c4f9-4455-8a33-cc4587a3c8fa', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:07.662414 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.662751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.683881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] vlan segment allocate from pool success with {'vlan_id': 167, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:07.778815 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.779085 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Added segment 21654aad-2d09-4bc2-b5a8-6bbbc51f43a7 of type vlan for network 66648f13-a35c-4875-8fcb-9c060d33a011 Nov 24 04:13:07.786550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.791290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.818424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=357efa5c-225b-453e-8e97-cc0f68a1af3f,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:07.857976 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.859270 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dab1b385-612d-454b-b76d-114f6f4f0aa4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2379942 Nov 24 04:13:07.862231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33468) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:07.868075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group_rule': {'security_group_id': 'e24375a3-c4f9-4455-8a33-cc4587a3c8fa', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:07.875598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.919034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.943721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8c5bdbd6-39bd-48ad-89b0-e895c58d7cd8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:07.965788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.058837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.068864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:08.069800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.189476 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.7307374 Nov 24 04:13:08.190706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33470) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.202749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:08.225093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25f6ce1-bd6e-4634-90a4-3426b398ceac tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Network': ['ID=66648f13-a35c-4875-8fcb-9c060d33a011,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:08.227346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.233630 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.240274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:08.241254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.244871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 66648f13-a35c-4875-8fcb-9c060d33a011 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:08.255947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.300596 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:08.306789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=055b5355-ec6a-48c0-b3c1-a4460267cd55,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:08.307814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:08.309013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.310875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:08.324580 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:08.325331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.325937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.329645 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-222a6d37-4292-433b-b35a-a6ad819d05ca tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4627590 Nov 24 04:13:08.330242 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33472) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.335278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group_rule': {'security_group_id': 'e24375a3-c4f9-4455-8a33-cc4587a3c8fa', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:08.370287 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=1ce0bd08-9d02-4a74-9573-7ee6fabf8667,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:08.414781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Made reservation on behalf of fe4291b8f221492d8b81baaa02df346a for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:08.418301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.452313 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-44afccc7-ce1e-4c4e-a7da-46a63d1807f7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.5336387 Nov 24 04:13:08.452313 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:08.454411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33474) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.456572 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-942e0f2c-1e95-40be-85b8-968cb21aa7c8 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0814164 Nov 24 04:13:08.457625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.461883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33476) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.468328 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:08.483167 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:08.483951 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.518588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Performing IP validity checks on allocation pools {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:13:08.519110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103381) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:13:08.541155 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet df7589cb-718c-4fcd-ba62-6833177081f9 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:08.546072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccdec3ff-5cef-4b81-a49c-5e97bf9aab3e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:08.547487 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ccdec3ff-5cef-4b81-a49c-5e97bf9aab3e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/1ce0bd08-9d02-4a74-9573-7ee6fabf8667 HTTP/1.1" status: 200 len: 844 time: 0.0920851 Nov 24 04:13:08.548082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.550302 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33478) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.556890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Router 5be0625b-048a-4d37-8c2e-e83f3b3a8c57 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:08.578602 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:08.582348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.607270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.657958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.697918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8d96cc9-5522-4668-af07-f3e08ddf71aa,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:08.705628 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.709426 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-03863d2f-368c-4945-a9a7-cf415b413a1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3756797 Nov 24 04:13:08.710936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33480) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.717377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group_rule': {'security_group_id': 'e24375a3-c4f9-4455-8a33-cc4587a3c8fa', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:08.759799 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.778912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:08.786631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 1ce0bd08-9d02-4a74-9573-7ee6fabf8667 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:08.786998 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.791622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.792141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] Sync routers for ids ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:08.795377 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-62a753b8-cd4a-4b29-aadf-c5ae2c57d6b8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "PUT /v2.0/routers/5be0625b-048a-4d37-8c2e-e83f3b3a8c57 HTTP/1.1" status: 200 len: 925 time: 2.1462321 Nov 24 04:13:08.795947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33482) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:08.804938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.806578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] Routers {'5be0625b-048a-4d37-8c2e-e83f3b3a8c57'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:08.807558 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Project aef2575f68e0468dbefaa9800a1007e9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:13:08.807712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.819897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.845768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.858711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] Routers {'5be0625b-048a-4d37-8c2e-e83f3b3a8c57'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:08.859775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.874637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:08.910120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.912000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-091e32a8-41e2-4bec-9b8c-8af682a884b4 None None] The sync data for ids ['5be0625b-048a-4d37-8c2e-e83f3b3a8c57'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:08.933265 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:07Z', 'revision_number': 10, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.960351 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:08.969346 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:08.969964 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:08.991974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=eb1120d7-3717-431e-88dc-2bf30052dfc7,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:09.040380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Checking segment: {'id': '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:09.040744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network hostable DHCP agents. Network: 66648f13-a35c-4875-8fcb-9c060d33a011, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:09.055303 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-df527bc6-90bf-4fa3-882f-61845e3d7a83 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/5be0625b-048a-4d37-8c2e-e83f3b3a8c57 HTTP/1.1" status: 200 len: 925 time: 0.2582519 Nov 24 04:13:09.057250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.058974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33484) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.082841 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:09.094219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.142644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3217656d-070d-4722-a8b6-601f2736dcbf,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:09.145951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Network 66648f13-a35c-4875-8fcb-9c060d33a011 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:09.162793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.166878 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1b0c86c2-c9a2-4a38-bc86-3304a226625e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4503977 Nov 24 04:13:09.169570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33486) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.170009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 66648f13-a35c-4875-8fcb-9c060d33a011) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:09.176444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'security_group_rule': {'security_group_id': 'e24375a3-c4f9-4455-8a33-cc4587a3c8fa', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:09.182668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c6f06db-9a7d-43b1-ae37-67071d3d2b60 None None] Network 66648f13-a35c-4875-8fcb-9c060d33a011 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:09.184361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:09.184957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.204553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3fdbc5b2-ca2c-4a9b-bf57-c761ac8c45cd tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:09.209200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3fdbc5b2-ca2c-4a9b-bf57-c761ac8c45cd tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=5be0625b-048a-4d37-8c2e-e83f3b3a8c57&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1461165 Nov 24 04:13:09.210296 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33488) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.223948 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Project aef2575f68e0468dbefaa9800a1007e9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:13:09.224189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.241618 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d8678505-b766-482b-bb2e-8699525af3ae tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 1.0473738 Nov 24 04:13:09.242486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.245174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33490) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.250040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:09.259986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 1ce0bd08-9d02-4a74-9573-7ee6fabf8667 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:09.344340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.352943 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:07Z', 'revision_number': 10, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:09.376936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=df7589cb-718c-4fcd-ba62-6833177081f9,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:09.378778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.384957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.391321 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.393582 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3948371-1493-45ec-b04a-6265956b19d6 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:07Z', 'revision_number': 10, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None, '_interfaces': [{'id': '6368baaf-36f9-4a6f-9950-2cd5c1f3d14e', 'name': '', 'network_id': 'bfb31842-b19b-4567-8e79-11d158d17b4d', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'mac_address': 'fa:16:3e:ba:f7:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'device_owner': 'network:router_interface', 'standard_attr_id': 801, 'fixed_ips': [{'subnet_id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:14Z', 'updated_at': '2021-11-24T04:12:20Z', 'revision_number': 5, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'subnets': [{'id': '2fd90e2e-d7be-46b0-b347-1ae9291266ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:09.395443 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-156ed23f-2403-4845-80a5-6d2bc0341dae tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/df7589cb-718c-4fcd-ba62-6833177081f9 HTTP/1.1" status: 204 len: 168 time: 0.9315031 Nov 24 04:13:09.398183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-3980030'] for subnet, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.399625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33492) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.409860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5654bd83-ff3c-47ae-a4ae-4859f21c9b1f None None] Network 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:09.432378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=354594ee-7832-4c59-9480-ae3319922925,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:09.447125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.448463 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0adf95d5-c23a-4fb2-8c87-ea2cef1f06e4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2765102 Nov 24 04:13:09.452251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33494) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.461707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4662767-041c-485f-8401-0f0d0fffde48 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:09.463752 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b4662767-041c-485f-8401-0f0d0fffde48 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.2510965 Nov 24 04:13:09.464121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'network': {'name': 'tempest-network-smoke--1163267873', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'port_security_enabled': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:09.472869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33496) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.515685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Made reservation on behalf of aef2575f68e0468dbefaa9800a1007e9 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:09.519069 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5584707d-c461-402b-86dc-48f266e4266b tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=5be0625b-048a-4d37-8c2e-e83f3b3a8c57 HTTP/1.1" status: 200 len: 205 time: 0.0424514 Nov 24 04:13:09.520341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.522421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33498) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.561895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.567697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.604613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=1ce0bd08-9d02-4a74-9573-7ee6fabf8667,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:09.611026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.615105 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-96b8bafd-4b0a-49a7-86e0-b44263365ae0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/1ce0bd08-9d02-4a74-9573-7ee6fabf8667 HTTP/1.1" status: 204 len: 168 time: 1.0633173 Nov 24 04:13:09.636048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33500) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.671982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port e6f2e70e-d679-4812-999e-624b2453311c {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:09.672304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.713420 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-ad0b543d-2009-4cfc-a951-c359735ec532 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:09.717721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-66648f13-a35c-4875-8fcb-9c060d33a011', 'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011', 'tenant_id': 'fe4291b8f221492d8b81baaa02df346a', 'fixed_ips': [{'subnet_id': 'eb1120d7-3717-431e-88dc-2bf30052dfc7'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:09.718808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.720148 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ad0b543d-2009-4cfc-a951-c359735ec532 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/1ce0bd08-9d02-4a74-9573-7ee6fabf8667 HTTP/1.1" status: 404 len: 333 time: 0.0808671 Nov 24 04:13:09.721928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33502) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:09.724640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] vlan segment allocate from pool success with {'vlan_id': 191, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:09.727422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'name': 'tempest-PortsIpV6TestJSON-77779920'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:09.773398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.774571 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Added segment 406a0578-0cd2-4d3f-a92a-c22ae9bd3b75 of type vlan for network 5056a387-4f26-43bd-ad60-c8135c9a7757 Nov 24 04:13:09.775234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port e6f2e70e-d679-4812-999e-624b2453311c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e6f2e70e-d679-4812-999e-624b2453311c,segment=NetworkSegment(8e83a68c-90ac-4187-a0fb-888745040938),segment_id=8e83a68c-90ac-4187-a0fb-888745040938)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:09.775609 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.822628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0c9b8909-e5fb-43f0-ac11-1413609fa26f no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:09.835468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.840924 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for e6f2e70e-d679-4812-999e-624b2453311c owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:09.866449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 0c9b8909-e5fb-43f0-ac11-1413609fa26f {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:09.866961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0c9b8909-e5fb-43f0-ac11-1413609fa26f not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:09.900812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.903060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8769089902457', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-3285233'] for subnet, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.942365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:09.947185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:09.978597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port ce1ebdef-0653-4a30-b465-96f983b93af2 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:09.999964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea21d9ae-81ad-4565-ad44-c2b691eb62b2 None None] DHCP port deletion for 07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:10.020644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Allocated IP 172.20.0.3 (66648f13-a35c-4875-8fcb-9c060d33a011/eb1120d7-3717-431e-88dc-2bf30052dfc7/23b8f60b-9b0a-446c-b107-bdc6834faf82) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:10.028518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.030820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:10.031409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.032744 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "PUT /v2.0/subnets/eb1120d7-3717-431e-88dc-2bf30052dfc7 HTTP/1.1" status: 200 len: 877 time: 0.7868967 Nov 24 04:13:10.038335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33504) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:10.053141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.058655 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:10.059332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.079035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=e6f2e70e-d679-4812-999e-624b2453311c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.084221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port e6f2e70e-d679-4812-999e-624b2453311c on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:10.087686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57a445f-0224-4b07-8f17-6c724307789c tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event updated for resources: {'Subnet': ['ID=eb1120d7-3717-431e-88dc-2bf30052dfc7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.105314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.116691 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.135721 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6823919 Nov 24 04:13:10.142954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33506) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:10.148132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'admin_state_up': True, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:10.226099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.251219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.258631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.290795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07ee17ec-7e98-4e35-a61a-8469c8c8e6d6']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:10.303096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Network 66648f13-a35c-4875-8fcb-9c060d33a011 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:10.309208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e83a68c-90ac-4187-a0fb-888745040938') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:10.309887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e83a68c-90ac-4187-a0fb-888745040938') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:10.311146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:10.313433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:10.313913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.323693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Pushing event updated for resources: {'Port': ['ID=23b8f60b-9b0a-446c-b107-bdc6834faf82,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.325638 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.346785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.361824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 155 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:10.362333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:10.366231 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:10.385499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Attempting to bind port 23b8f60b-9b0a-446c-b107-bdc6834faf82 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:10.385881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Attempting to bind port 23b8f60b-9b0a-446c-b107-bdc6834faf82 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:10.386282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Attempting to bind port 23b8f60b-9b0a-446c-b107-bdc6834faf82 on network 66648f13-a35c-4875-8fcb-9c060d33a011 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:10.391880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:10.392962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Checking segment: {'id': '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:10.392962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.393220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Bound using segment: {'id': '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:10.393675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Bound port: 23b8f60b-9b0a-446c-b107-bdc6834faf82, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '66648f13-a35c-4875-8fcb-9c060d33a011'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:10.393933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.434900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.462617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] For port 23b8f60b-9b0a-446c-b107-bdc6834faf82, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:10.466440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] For port 23b8f60b-9b0a-446c-b107-bdc6834faf82, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=23b8f60b-9b0a-446c-b107-bdc6834faf82,segment=NetworkSegment(21654aad-2d09-4bc2-b5a8-6bbbc51f43a7),segment_id=21654aad-2d09-4bc2-b5a8-6bbbc51f43a7)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:10.466631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.472062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.478208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.481340 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/07ee17ec-7e98-4e35-a61a-8469c8c8e6d6 HTTP/1.1" status: 204 len: 168 time: 1.0790346 Nov 24 04:13:10.496269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33508) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:10.512571 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52de20e7-ea7d-449d-b301-dda2e82a2f58 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=07ee17ec-7e98-4e35-a61a-8469c8c8e6d6,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.547986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ead4a5-d2a3-49c5-b07e-5db51fa3034f None None] Pushing event updated for resources: {'Port': ['ID=23b8f60b-9b0a-446c-b107-bdc6834faf82,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.554681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:10.570345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01221d77-07ed-4637-8784-4422f1828a66 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Network': ['ID=5056a387-4f26-43bd-ad60-c8135c9a7757,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.584451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:10.584881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:10.591102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:10.596813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:10.597461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.606420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.607447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.609296 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=ce1ebdef-0653-4a30-b465-96f983b93af2,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:10.640490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-669f4bf9-15db-4164-a6dc-fa4a0c28c6a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 848 time: 0.9150250 Nov 24 04:13:10.644813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.646439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33510) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:10.658247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:10.731075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Deleting port 8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:10.731421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.771984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.799114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.874187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:10.964358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.071044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.084873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.120967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Calling delete_port for 8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:11.197571 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting port 23b8f60b-9b0a-446c-b107-bdc6834faf82 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:11.197895 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.212160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:11.212414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.308280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,segment=NetworkSegment(6bcc484d-8451-4326-bc3a-c89847342164),segment_id=6bcc484d-8451-4326-bc3a-c89847342164)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:11.308658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.322380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:11.379043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.401540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.501035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] In _notify_port_updated(), no bound segment for port ce1ebdef-0653-4a30-b465-96f983b93af2 on network 721c2ec6-3abd-47ff-80e2-24b3c8106daa {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:13:11.506815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:11.507454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.508973 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/ports/ce1ebdef-0653-4a30-b465-96f983b93af2 HTTP/1.1" status: 200 len: 818 time: 0.8585582 Nov 24 04:13:11.511438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] For port 23b8f60b-9b0a-446c-b107-bdc6834faf82, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=23b8f60b-9b0a-446c-b107-bdc6834faf82,segment=NetworkSegment(21654aad-2d09-4bc2-b5a8-6bbbc51f43a7),segment_id=21654aad-2d09-4bc2-b5a8-6bbbc51f43a7)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:11.511986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33512) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:11.512136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.546728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Calling delete_port for 23b8f60b-9b0a-446c-b107-bdc6834faf82 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:11.564096 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae35349-1744-453b-9dae-6d26a5c2b5e8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=ce1ebdef-0653-4a30-b465-96f983b93af2,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:11.582614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.639490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=6368baaf-36f9-4a6f-9950-2cd5c1f3d14e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:11.662455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 23b8f60b-9b0a-446c-b107-bdc6834faf82 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:11.737452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98ec6a46-4554-4220-9cc4-578a79fe28da None None] Network 66648f13-a35c-4875-8fcb-9c060d33a011 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:11.789003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.803068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port ce1ebdef-0653-4a30-b465-96f983b93af2 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:11.803567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.818088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.820238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.837795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.886092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event deleted for resources: {'Port': ['ID=8ccdfd10-c02d-4214-b6dc-b0fb6d1b2e20,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:11.887735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e1b63207-ec46-48bc-bb18-438ae8fd50e1 None None] Provisioning complete for port 23b8f60b-9b0a-446c-b107-bdc6834faf82 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:11.888118 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e1b63207-ec46-48bc-bb18-438ae8fd50e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.948421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43869fac-390d-463d-bb9a-5ef35a6d108c None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:11.958834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 23b8f60b-9b0a-446c-b107-bdc6834faf82 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:11.959242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:11.977653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.021577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.027752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for ce1ebdef-0653-4a30-b465-96f983b93af2 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:12.054830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.064781 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Could not find standard attr ID for object 23b8f60b-9b0a-446c-b107-bdc6834faf82. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:13:12.066553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e1b63207-ec46-48bc-bb18-438ae8fd50e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.070046 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No ports have port_id starting with 23b8f60b-9b0a-446c-b107-bdc6834faf82 Nov 24 04:13:12.113649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:12.152536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e6f2e70e-d679-4812-999e-624b2453311c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:12.178440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e6f2e70e-d679-4812-999e-624b2453311c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:12.178848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e6f2e70e-d679-4812-999e-624b2453311c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:12.183785 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.196280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.201438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Port': ['ID=23b8f60b-9b0a-446c-b107-bdc6834faf82,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:12.211183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.219853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:12.230247 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:12.238084 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8b023373-71b5-4d73-80f2-085490deca05 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7399666 Nov 24 04:13:12.240274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33514) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.243418 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:12.244039 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:12.245073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.270858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No DVR routers for this DVR port 23b8f60b-9b0a-446c-b107-bdc6834faf82 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:12.283988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=ce1ebdef-0653-4a30-b465-96f983b93af2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:12.289821 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.295782 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ea3540fb-a4d1-4450-885d-6a70fc04c924 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/ce1ebdef-0653-4a30-b465-96f983b93af2 HTTP/1.1" status: 204 len: 168 time: 0.7821908 Nov 24 04:13:12.296704 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33516) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.331011 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:12.352676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be5d3d85-bef7-4c5c-b7cf-e60083eb17dc tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:12.357624 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-be5d3d85-bef7-4c5c-b7cf-e60083eb17dc tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.0597365 Nov 24 04:13:12.358438 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33518) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.378918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Allocated IP 172.26.5.250 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/97a6381f-c7b3-411e-ac55-c7aa669ccbae) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:12.391929 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-ef9fd747-2f89-4da9-897f-673eb8904635 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:12.397411 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ef9fd747-2f89-4da9-897f-673eb8904635 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/ce1ebdef-0653-4a30-b465-96f983b93af2 HTTP/1.1" status: 404 len: 333 time: 0.0337245 Nov 24 04:13:12.398287 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33520) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.400176 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:11Z', 'revision_number': 11, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:12.404936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.405458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Fanout notify agent at l3_agent the message router_deleted on router 5be0625b-048a-4d37-8c2e-e83f3b3a8c57 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:12.406942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1924293284'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:12.422659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.428625 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3106bb97-5bc8-4e1c-a3eb-8942fff7ee52 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/5be0625b-048a-4d37-8c2e-e83f3b3a8c57 HTTP/1.1" status: 204 len: 168 time: 2.9023833 Nov 24 04:13:12.428802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33522) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.433758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-702354245', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:12.445223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:12.449482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting subnet 2fd90e2e-d7be-46b0-b347-1ae9291266ea {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:12.450211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2d6188c-7200-45b8-a9ac-30c0ac791bbc None None] Network 66648f13-a35c-4875-8fcb-9c060d33a011 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:12.450987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.453483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.456298 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:12.468056 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:12.469036 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:12.488200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-71df517e-d6d4-4dfa-9a34-f1f4f03eaa09 None None] Could not find standard attr ID for object 23b8f60b-9b0a-446c-b107-bdc6834faf82. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:13:12.494656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 185, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:12.500761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.501807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.501942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.516290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.516682 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment d514d37b-020f-4149-91a8-e0e9915d5624 of type vlan for network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 Nov 24 04:13:12.552117 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:12.602956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.611099 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:11Z', 'revision_number': 11, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:12.626128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.630422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.637753 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.645766 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b47e0623-76dd-4b6e-9d0d-5a565556da7b None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:11Z', 'revision_number': 11, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:12.661039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.674222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.678563 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-74e8e78f-6aa5-4c65-9376-de7cac7f7a14 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.2453308 Nov 24 04:13:12.679158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33524) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.685230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:12.694729 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.700497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:12.701085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.768849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.813713 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.4143164 Nov 24 04:13:12.821090 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33526) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.828911 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Subnet': ['ID=2fd90e2e-d7be-46b0-b347-1ae9291266ea,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:12.839179 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.842353 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-991a4097-8f07-42f4-9bb7-ceb8d50f259a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/2fd90e2e-d7be-46b0-b347-1ae9291266ea HTTP/1.1" status: 204 len: 168 time: 0.5831950 Nov 24 04:13:12.846431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05b7dad9-057e-4ccf-a060-e9518b6b4112 None None] Network bfb31842-b19b-4567-8e79-11d158d17b4d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:12.850080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33528) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:12.853644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.857359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:12.887572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:12.940200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=eb1120d7-3717-431e-88dc-2bf30052dfc7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:12.950531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-996ea83d-9899-416d-a2d7-0c99ef77a69c None None] Network 66648f13-a35c-4875-8fcb-9c060d33a011 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:13.008995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525d7ef6-ebc9-4fe7-aae8-3082b8cd684a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=6b3d6af7-c10b-4c2f-a386-3d3a570cb193,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:13.037752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.065502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:13.067990 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:13.071625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.083313 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.090455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['66648f13-a35c-4875-8fcb-9c060d33a011']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:13.108914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:13.109400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '21654aad-2d09-4bc2-b5a8-6bbbc51f43a7') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:13.121307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.125074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.188815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.234276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 167 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:13.235061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: items = [ Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:13.239418 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:13.242198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Port': ['ID=97a6381f-c7b3-411e-ac55-c7aa669ccbae,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:13.246314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:13.273873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:13.280913 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:13.307854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7043b410-7d9d-4d80-a36d-046df4423f1a None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:13.360718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.369044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.372256 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/66648f13-a35c-4875-8fcb-9c060d33a011 HTTP/1.1" status: 204 len: 168 time: 3.3308461 Nov 24 04:13:13.378207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33530) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:13.384529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6775fde1-9585-411b-ae90-9e16f028f892 None None] DHCP port deletion for 66648f13-a35c-4875-8fcb-9c060d33a011 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:13.417015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] DHCP port deletion for bfb31842-b19b-4567-8e79-11d158d17b4d request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:13.432811 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.462927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b6bdaa2e-1c74-4147-a40f-1b3eaf1f5a39 None None] Provisioning complete for port 97a6381f-c7b3-411e-ac55-c7aa669ccbae triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:13.463303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b6bdaa2e-1c74-4147-a40f-1b3eaf1f5a39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.507698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b6bdaa2e-1c74-4147-a40f-1b3eaf1f5a39 None None] Port 97a6381f-c7b3-411e-ac55-c7aa669ccbae cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:13.523654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] Deleting port 068a0968-802e-4184-aeb6-5b45930e0ffe {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:13.524223 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.634214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] For port 068a0968-802e-4184-aeb6-5b45930e0ffe, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=068a0968-802e-4184-aeb6-5b45930e0ffe,segment=NetworkSegment(6bcc484d-8451-4326-bc3a-c89847342164),segment_id=6bcc484d-8451-4326-bc3a-c89847342164)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:13.635203 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.647281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:13.674086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] Calling delete_port for 068a0968-802e-4184-aeb6-5b45930e0ffe owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:13.678945 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:13.679489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6368baaf-36f9-4a6f-9950-2cd5c1f3d14e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:13.679910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 23b8f60b-9b0a-446c-b107-bdc6834faf82 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:13.706560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 23b8f60b-9b0a-446c-b107-bdc6834faf82 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:13.707253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 23b8f60b-9b0a-446c-b107-bdc6834faf82 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:13.707672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 068a0968-802e-4184-aeb6-5b45930e0ffe no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:13.748280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.794857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf956a8b-54de-4f59-8607-3b01e45dac00 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=66648f13-a35c-4875-8fcb-9c060d33a011,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:13.802750 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-2690ecdc-b6ef-443c-b6b3-867cc81b2da0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:13.803465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2690ecdc-b6ef-443c-b6b3-867cc81b2da0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:13.806960 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2690ecdc-b6ef-443c-b6b3-867cc81b2da0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/eb1120d7-3717-431e-88dc-2bf30052dfc7 HTTP/1.1" status: 404 len: 337 time: 0.4270246 Nov 24 04:13:13.810450 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33532) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:13.820972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.842682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Deleting port 068a0968-802e-4184-aeb6-5b45930e0ffe {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:13.843277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.843420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.846992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=1bc11f49-6376-4c45-b16f-b71dd58426e6,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:13.847726 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.855139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.870165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.870528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.871053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.871562 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-77b9fdd5-cf2d-40d7-b991-4e18f32f53eb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:13.871701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.871911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.872400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-77b9fdd5-cf2d-40d7-b991-4e18f32f53eb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:13.872553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.872793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.873186 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.873474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.873804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.874716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.874716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:13.875537 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-77b9fdd5-cf2d-40d7-b991-4e18f32f53eb tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/66648f13-a35c-4875-8fcb-9c060d33a011 HTTP/1.1" status: 404 len: 339 time: 0.0620914 Nov 24 04:13:13.882026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33534) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:13.882264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] Pushing event deleted for resources: {'Port': ['ID=068a0968-802e-4184-aeb6-5b45930e0ffe,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:13.887503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05558521-9aa4-4956-a0b3-3d0c4f033a47 None None] No DVR routers for this DVR port 068a0968-802e-4184-aeb6-5b45930e0ffe on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:13.945690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] For port 068a0968-802e-4184-aeb6-5b45930e0ffe, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:13.946168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:13.947141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': 'd514d37b-020f-4149-91a8-e0e9915d5624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:13.947616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: 6b3d6af7-c10b-4c2f-a386-3d3a570cb193, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:13.957669 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-c56278e5-168e-4569-8059-50c0fcaba89d tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:13.957826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c56278e5-168e-4569-8059-50c0fcaba89d tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:13.961384 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c56278e5-168e-4569-8059-50c0fcaba89d tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/fabf123a-8e02-41ad-befb-7dc8438c01a5 HTTP/1.1" status: 404 len: 337 time: 0.0778966 Nov 24 04:13:13.965611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33536) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:13.994799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Calling delete_port for 068a0968-802e-4184-aeb6-5b45930e0ffe owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:13.998766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Port 068a0968-802e-4184-aeb6-5b45930e0ffe was not found and therefore no delete operation was performed {{(pid=103381) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:13:13.999416 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-673cc658-4e3d-427b-abb3-4420010d273b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:14.000047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-673cc658-4e3d-427b-abb3-4420010d273b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:14.003227 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-673cc658-4e3d-427b-abb3-4420010d273b tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/b4a86686-cdc2-4b1b-acb3-f8c21c252122 HTTP/1.1" status: 404 len: 339 time: 0.0348351 Nov 24 04:13:14.007284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33538) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:14.007923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.030439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:14.045368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 6b3d6af7-c10b-4c2f-a386-3d3a570cb193) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:14.052210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:14.052820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.055872 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0218e3fa-7e6d-4396-8810-101c44227ebe None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:14.070679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Allocated IP 172.26.5.185 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/0ac63031-0290-4ad2-ae9a-ba21350f1833) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:14.085603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Port': ['ID=068a0968-802e-4184-aeb6-5b45930e0ffe,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:14.087945 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ea65770c-5abc-44aa-9b3c-e26c37e0c475 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2657468 Nov 24 04:13:14.088171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No DVR routers for this DVR port 068a0968-802e-4184-aeb6-5b45930e0ffe on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:14.090197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33540) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:14.098362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:14.212739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.217860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.252092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.276433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.306049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:14.309507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.325063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bfb31842-b19b-4567-8e79-11d158d17b4d']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:14.356772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6bcc484d-8451-4326-bc3a-c89847342164') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:14.357196 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6bcc484d-8451-4326-bc3a-c89847342164') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:14.359575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': '1bc11f49-6376-4c45-b16f-b71dd58426e6'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:14.360520 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.374688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.411660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.431556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:14.437702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:14.441307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:14.446081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.457753 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd15d671-e83d-4ab6-a2e5-b213d7d5ccc8 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:14.477226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event updated for resources: {'Port': ['ID=0ac63031-0290-4ad2-ae9a-ba21350f1833,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:14.484378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.491597 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 1bc11f49-6376-4c45-b16f-b71dd58426e6 (CIDR: 2001:db8::/64) Nov 24 04:13:14.498025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Releasing vlan 180 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:14.498844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.502054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:13:14.502537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:14.503508 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:14.552800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Allocated IP 2001:db8::2 (6b3d6af7-c10b-4c2f-a386-3d3a570cb193/1bc11f49-6376-4c45-b16f-b71dd58426e6/6151318c-d145-44cf-b61c-6937d6cc0892) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:14.600114 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3a730bbe-536b-464e-831a-00f4abff082c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5087147 Nov 24 04:13:14.600659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33542) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:14.601260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8028b816-fdd3-460a-9e12-2d407ce2f541 None None] Provisioning complete for port 0ac63031-0290-4ad2-ae9a-ba21350f1833 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:14.601734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8028b816-fdd3-460a-9e12-2d407ce2f541 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.605844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:14.619368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '080b57ee-c55b-4ba8-a821-67592292142f') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:14.619900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '080b57ee-c55b-4ba8-a821-67592292142f') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:14.626726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:14.637005 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.639686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.652465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.656459 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/networks/bfb31842-b19b-4567-8e79-11d158d17b4d HTTP/1.1" status: 204 len: 168 time: 1.8045182 Nov 24 04:13:14.665905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33544) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:14.671342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'routes': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:14.674404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8028b816-fdd3-460a-9e12-2d407ce2f541 None None] Port 0ac63031-0290-4ad2-ae9a-ba21350f1833 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:14.705228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64416561-1bae-47ea-9a33-10629ac2ade4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Pushing event deleted for resources: {'Network': ['ID=bfb31842-b19b-4567-8e79-11d158d17b4d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:14.709849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.721482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 171 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:14.721890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:14.724957 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:14.758985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.765614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.781861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.826845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:14.829664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:14.834948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:14.838626 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Pushing event updated for resources: {'Port': ['ID=6151318c-d145-44cf-b61c-6937d6cc0892,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:14.842021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.849640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.850258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.850395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.850700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.851032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.851717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.851717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.852021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.852348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.852997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.852997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.853292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:14.853679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.857016 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45 HTTP/1.1" status: 204 len: 168 time: 0.8464258 Nov 24 04:13:14.865897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33546) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:14.870545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8314cd9-a6dc-4b8a-9401-7789d5c5f1e9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=ea5e70bd-0a4a-4f8a-a68b-71a6e59d8d45,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:14.911492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Attempting to bind port 6151318c-d145-44cf-b61c-6937d6cc0892 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:14.912220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Attempting to bind port 6151318c-d145-44cf-b61c-6937d6cc0892 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd514d37b-020f-4149-91a8-e0e9915d5624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:14.912783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Attempting to bind port 6151318c-d145-44cf-b61c-6937d6cc0892 on network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:14.943862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:14.943862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Checking segment: {'id': 'd514d37b-020f-4149-91a8-e0e9915d5624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:14.943862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.943862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Bound using segment: {'id': 'd514d37b-020f-4149-91a8-e0e9915d5624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:14.943862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Bound port: 6151318c-d145-44cf-b61c-6937d6cc0892, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd514d37b-020f-4149-91a8-e0e9915d5624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:14.943862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.954316 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a7ad295-64fc-4956-9973-7bde61cb4218 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:14.954796 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a7ad295-64fc-4956-9973-7bde61cb4218 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:14.960758 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2a7ad295-64fc-4956-9973-7bde61cb4218 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/36269490-865c-4eba-9673-710bb7e18ad6 HTTP/1.1" status: 404 len: 337 time: 0.0876434 Nov 24 04:13:14.961207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33548) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:14.986958 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-89fe7e28-2b17-4191-a3d2-37e71b0c1904 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:14.987482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-89fe7e28-2b17-4191-a3d2-37e71b0c1904 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:14.989999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Added routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 24 04:13:14.990419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Removed routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 24 04:13:14.993203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:14.993347 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-89fe7e28-2b17-4191-a3d2-37e71b0c1904 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/26acdcb7-a599-403a-86ab-8693d58c45f0 HTTP/1.1" status: 404 len: 339 time: 0.0286379 Nov 24 04:13:14.993541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33550) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.011947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] For port 6151318c-d145-44cf-b61c-6937d6cc0892, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:15.016169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] For port 6151318c-d145-44cf-b61c-6937d6cc0892, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6151318c-d145-44cf-b61c-6937d6cc0892,segment=NetworkSegment(d514d37b-020f-4149-91a8-e0e9915d5624),segment_id=d514d37b-020f-4149-91a8-e0e9915d5624)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:15.021123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.028251 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-9bc708a2-0d95-42f4-81f3-12bb9e78e25a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.028710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9bc708a2-0d95-42f4-81f3-12bb9e78e25a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.034226 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9bc708a2-0d95-42f4-81f3-12bb9e78e25a tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/a2a43892-53f4-43ea-9a62-bf78cb8b2339 HTTP/1.1" status: 404 len: 337 time: 0.0372107 Nov 24 04:13:15.042936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33552) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.085324 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-f99ff929-f6a2-48d7-b28f-27d7a6512258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.086010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f99ff929-f6a2-48d7-b28f-27d7a6512258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.093771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f99ff929-f6a2-48d7-b28f-27d7a6512258 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/1bc54576-d6fb-4dd7-9025-7e058230420c HTTP/1.1" status: 404 len: 339 time: 0.0419745 Nov 24 04:13:15.094548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e34fab-a4fa-4525-8d8e-5b12a7f354c2 None None] Pushing event updated for resources: {'Port': ['ID=6151318c-d145-44cf-b61c-6937d6cc0892,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:15.094770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33554) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.116103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:15.119736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.122576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:15.125792 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-1e06aecc-35b6-45f2-b306-68b52cd1ec37 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.126278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1e06aecc-35b6-45f2-b306-68b52cd1ec37 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.132183 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1e06aecc-35b6-45f2-b306-68b52cd1ec37 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/21e7a64c-a3cc-4963-ab25-a5f6ffaf3ff3 HTTP/1.1" status: 404 len: 337 time: 0.0341904 Nov 24 04:13:15.134143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33556) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.152641 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-f4fe2f5d-4f45-4a85-885e-42986a369090 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.153143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f4fe2f5d-4f45-4a85-885e-42986a369090 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.156145 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f4fe2f5d-4f45-4a85-885e-42986a369090 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/c2c2b239-4c2c-49cf-9332-16f01d392b00 HTTP/1.1" status: 404 len: 339 time: 0.0228128 Nov 24 04:13:15.159604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33558) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.220138 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d559f19-5c78-4aa7-a441-e91192b675d0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.220596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1d559f19-5c78-4aa7-a441-e91192b675d0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.221684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.223985 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1d559f19-5c78-4aa7-a441-e91192b675d0 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/de8f6d08-3efc-4992-a3ce-4503c1f45205 HTTP/1.1" status: 404 len: 337 time: 0.0629656 Nov 24 04:13:15.227722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33560) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.261559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.269334 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee022b78-f547-40c9-bb6e-65ef4c4d0992 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.269918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ee022b78-f547-40c9-bb6e-65ef4c4d0992 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.272935 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ee022b78-f547-40c9-bb6e-65ef4c4d0992 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/f2713fc5-675f-44b2-b65c-0a083f1c207a HTTP/1.1" status: 404 len: 339 time: 0.0442538 Nov 24 04:13:15.275574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33562) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.305298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.336398 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0472cee8-eac0-4544-a8a7-6a10a5f891be tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.336857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0472cee8-eac0-4544-a8a7-6a10a5f891be tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.340068 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0472cee8-eac0-4544-a8a7-6a10a5f891be tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/9349ed60-5646-4279-a727-67eeaa1b372b HTTP/1.1" status: 404 len: 337 time: 0.0637565 Nov 24 04:13:15.342585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33564) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.376448 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-ad2bd6b1-eb23-4592-81d8-2fcb32f5b8cf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.376931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ad2bd6b1-eb23-4592-81d8-2fcb32f5b8cf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.380760 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ad2bd6b1-eb23-4592-81d8-2fcb32f5b8cf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/af6d955c-f433-4283-a213-a0a7aaf8812b HTTP/1.1" status: 404 len: 339 time: 0.0372150 Nov 24 04:13:15.383900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33566) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.422229 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e7a3588-935b-432a-9237-83e5bc875d80 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.422817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9e7a3588-935b-432a-9237-83e5bc875d80 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.428970 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9e7a3588-935b-432a-9237-83e5bc875d80 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/269f6028-8d5c-4e69-b6b2-0acda3e08476 HTTP/1.1" status: 404 len: 337 time: 0.0417745 Nov 24 04:13:15.429723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:15.431340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33568) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.442422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Sync routers for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:15.453723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:15.454396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:15.467898 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-042a00cb-308d-41f9-bf78-28c4e5bfbe87 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.468762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-042a00cb-308d-41f9-bf78-28c4e5bfbe87 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.475783 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-042a00cb-308d-41f9-bf78-28c4e5bfbe87 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/bc24d75d-4d89-46bc-8132-50a5f65c93b4 HTTP/1.1" status: 404 len: 339 time: 0.0411971 Nov 24 04:13:15.476927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33570) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.493101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router af1bca15-198f-4ff7-9729-e777368c7abb has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:15.507067 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f925c5e-7336-41a6-a6c0-ea893572e1bf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.507389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f925c5e-7336-41a6-a6c0-ea893572e1bf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.514574 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5f925c5e-7336-41a6-a6c0-ea893572e1bf tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/c08f999d-55a2-4bec-9742-1bd26d19ac3f HTTP/1.1" status: 404 len: 337 time: 0.0333524 Nov 24 04:13:15.514574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.514865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33572) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.514967 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c4435fd5-7c58-4916-9f81-dff88e8b4fd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 5.3703704 Nov 24 04:13:15.519167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33574) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.589982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:15.598775 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9a35b25-3315-423a-b5c0-316f5ffb029d tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.599330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a9a35b25-3315-423a-b5c0-316f5ffb029d tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.605279 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a9a35b25-3315-423a-b5c0-316f5ffb029d tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/15b914c6-fff3-4369-84a1-492a5ab5f7fe HTTP/1.1" status: 404 len: 339 time: 0.0866263 Nov 24 04:13:15.605418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33578) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.643186 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a4f83a6-e53d-48d8-aa5c-c2efb61cedab tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.643951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4a4f83a6-e53d-48d8-aa5c-c2efb61cedab tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.653106 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4a4f83a6-e53d-48d8-aa5c-c2efb61cedab tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/0322cd41-0f7d-483c-84bb-528778b128fc HTTP/1.1" status: 404 len: 337 time: 0.0466926 Nov 24 04:13:15.655692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33580) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.685589 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-e953c03f-23d5-4645-8882-0e8fc07fdd54 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:15.687048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e953c03f-23d5-4645-8882-0e8fc07fdd54 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:15.693451 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e953c03f-23d5-4645-8882-0e8fc07fdd54 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/31a4b687-b268-49e1-9f85-a530cacdb9fa HTTP/1.1" status: 404 len: 339 time: 0.0343685 Nov 24 04:13:15.700505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33582) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.710924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6151318c-d145-44cf-b61c-6937d6cc0892 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:15.725790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:15.741701 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] Sync routers for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:15.758465 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:15.759211 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:15.762203 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5e109d98-b6b2-4c0e-a190-e3d0005da957 tempest-TestNetworkAdvancedServerOps-2074709094 tempest-TestNetworkAdvancedServerOps-2074709094-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=aef2575f68e0468dbefaa9800a1007e9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2415841 Nov 24 04:13:15.765405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33584) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:15.846042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6151318c-d145-44cf-b61c-6937d6cc0892 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:15.847200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.882262 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:15.907544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting subnet 99e91869-c724-430f-9652-ac006fab3f8a {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:15.912277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:15.972175 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:11Z', 'revision_number': 11, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:16.000123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:13Z', 'revision_number': 3, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:16.007576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.026483 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] Checking router: af1bca15-198f-4ff7-9729-e777368c7abb for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:16.034097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Checking router: b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:16.034484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Updating router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 port 97a6381f-c7b3-411e-ac55-c7aa669ccbae binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:13:16.038339 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] Routers {'af1bca15-198f-4ff7-9729-e777368c7abb'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:16.039207 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['af1bca15-198f-4ff7-9729-e777368c7abb'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:16.049202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a42817c-1764-4d35-95b3-2b15b9583f16 tempest-TestNetworkAdvancedServerOps-2074709094 tempest-TestNetworkAdvancedServerOps-2074709094-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:16.050708 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1a42817c-1764-4d35-95b3-2b15b9583f16 tempest-TestNetworkAdvancedServerOps-2074709094 tempest-TestNetworkAdvancedServerOps-2074709094-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2838385 Nov 24 04:13:16.053837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33586) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.065035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.087558 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.109759 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-777fc04c-0131-441b-97bd-6ed913fef731 tempest-TestNetworkAdvancedServerOps-2074709094 tempest-TestNetworkAdvancedServerOps-2074709094-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0547369 Nov 24 04:13:16.113258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33588) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.122854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-193880739', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:16.130755 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] Set router af1bca15-198f-4ff7-9729-e777368c7abb gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:16.132893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 6151318c-d145-44cf-b61c-6937d6cc0892, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6151318c-d145-44cf-b61c-6937d6cc0892,segment=NetworkSegment(d514d37b-020f-4149-91a8-e0e9915d5624),segment_id=d514d37b-020f-4149-91a8-e0e9915d5624)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:16.145119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.216889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.238729 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.251427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.262899 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b725dff4-a534-43f5-b8a3-127e3fa24d51 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 700 time: 1.5957227 Nov 24 04:13:16.270545 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33590) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.292098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Made reservation on behalf of aef2575f68e0468dbefaa9800a1007e9 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:16.295649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.314194 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0855f639-7315-4d4f-8bef-18ebc3a32cb3 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 205 time: 0.0421650 Nov 24 04:13:16.314806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33592) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.342842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.356966 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:11Z', 'revision_number': 11, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:16.359186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=6151318c-d145-44cf-b61c-6937d6cc0892,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:16.403354 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20bd315-4224-47bd-ab72-da5bd1648f25 None None] The sync data for ids ['af1bca15-198f-4ff7-9729-e777368c7abb'] in dv-neutron-819049-1-hyperv is: [{'id': 'af1bca15-198f-4ff7-9729-e777368c7abb', 'name': 'tempest-RoutersTest-router-466995232', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:11Z', 'updated_at': '2021-11-24T04:13:11Z', 'revision_number': 11, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:16.483872 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aacc871e-768a-4f93-8e08-9ff65b173cc2 None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:16.499382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.512955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.545803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.559356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Subnet': ['ID=99e91869-c724-430f-9652-ac006fab3f8a,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:16.574222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.577699 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/subnets/99e91869-c724-430f-9652-ac006fab3f8a HTTP/1.1" status: 204 len: 168 time: 0.8762770 Nov 24 04:13:16.581320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33594) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.584297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.585043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.585470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.585859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.586309 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.586707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.587228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.588102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.588102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.588322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.588695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.589114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0248ac1-8aea-4b92-b28e-7253f2b56ef9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:16.593981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3986b930-b5bc-4ee5-b5d0-de650ae32458 None None] Network c62f8a24-132b-4a75-9aa8-b8366a6c2c14 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:16.602290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5b527c3b-7374-4230-afbc-5cc2a4cbfac7 None None] Provisioning complete for port 6151318c-d145-44cf-b61c-6937d6cc0892 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:16.602290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5b527c3b-7374-4230-afbc-5cc2a4cbfac7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.655182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:16.720487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.723745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.726897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:16.757031 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.759430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=5c0b3f8f-475f-41ec-9085-d573eb4a50b9,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:16.761919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:16.762683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.785329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.789323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.797490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a6c487a7-a429-4342-8ba4-77d3838bf4d9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 2.1911671 Nov 24 04:13:16.798302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33596) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.806959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'fixed_ips': [{'subnet_id': '1bc11f49-6376-4c45-b16f-b71dd58426e6'}, {'subnet_id': '5c0b3f8f-475f-41ec-9085-d573eb4a50b9'}], 'name': 'tempest-PortsIpV6TestJSON-326372817'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:16.822401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.835490 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Subnet': ['ID=33f81594-0144-42a4-83a7-399a3f0ca39f,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:16.853897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Router caa2f482-6336-4d5e-ae3d-753282912c95 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:16.868397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.868397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router af1bca15-198f-4ff7-9729-e777368c7abb {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:16.914619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.919813 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-31e86972-1677-43d7-a934-813513cb71cf tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 204 len: 168 time: 0.5593889 Nov 24 04:13:16.922236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Checking segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:16.922707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33598) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:16.923132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network hostable DHCP agents. Network: 5056a387-4f26-43bd-ad60-c8135c9a7757, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:16.928567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-2122205934', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:16.955412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Deleting port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:16.955970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.992153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:16.993323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:16.994455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.042109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:17.054230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.055720 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cc5da93d-ac31-4843-84b8-5b20298e6a4f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "PUT /v2.0/routers/caa2f482-6336-4d5e-ae3d-753282912c95 HTTP/1.1" status: 200 len: 883 time: 4.3751554 Nov 24 04:13:17.060515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33600) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.116932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e61debf-c0b8-4d2b-b01e-d4bff34e8a9b None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:17.129221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] Sync routers for ids ['caa2f482-6336-4d5e-ae3d-753282912c95'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:17.145585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Attempting to bind port 97a6381f-c7b3-411e-ac55-c7aa669ccbae on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:17.145848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Attempting to bind port 97a6381f-c7b3-411e-ac55-c7aa669ccbae by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:17.146142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Attempting to bind port 97a6381f-c7b3-411e-ac55-c7aa669ccbae on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:17.150733 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.158778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.162467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2494d93-85b4-42fb-9222-7638181ac5ab None None] Pushing event updated for resources: {'Port': ['ID=97a6381f-c7b3-411e-ac55-c7aa669ccbae,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:17.183321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:17.183703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:17.184101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.184497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:17.184984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Bound port: 97a6381f-c7b3-411e-ac55-c7aa669ccbae, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:17.185369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.218459 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] Routers {'caa2f482-6336-4d5e-ae3d-753282912c95'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:17.219135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['caa2f482-6336-4d5e-ae3d-753282912c95'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:17.245234 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e01bb5a0-97d2-4b8c-8145-dd331037d6aa tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/caa2f482-6336-4d5e-ae3d-753282912c95 HTTP/1.1" status: 200 len: 924 time: 0.1837807 Nov 24 04:13:17.247702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33602) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.270358 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:17.309793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] Routers {'caa2f482-6336-4d5e-ae3d-753282912c95'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:17.310761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['caa2f482-6336-4d5e-ae3d-753282912c95'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:17.340581 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-725bd8aa-63cf-4972-9584-9e1c8585a348 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:17.342513 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-725bd8aa-63cf-4972-9584-9e1c8585a348 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=caa2f482-6336-4d5e-ae3d-753282912c95&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0932684 Nov 24 04:13:17.345244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33604) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.354739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] For port 97a6381f-c7b3-411e-ac55-c7aa669ccbae, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:17.358396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] DHCP port deletion for c62f8a24-132b-4a75-9aa8-b8366a6c2c14 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:17.367733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:17.368238 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f86cb2f-70b1-4928-911c-f19f1ab80955 None None] The sync data for ids ['caa2f482-6336-4d5e-ae3d-753282912c95'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:17.399269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] For port 97a6381f-c7b3-411e-ac55-c7aa669ccbae, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=97a6381f-c7b3-411e-ac55-c7aa669ccbae,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:17.425950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.436710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 5056a387-4f26-43bd-ad60-c8135c9a7757) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:17.444284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] For port 984231f8-e4fb-4b65-892f-c5e8bc34ada8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=984231f8-e4fb-4b65-892f-c5e8bc34ada8,segment=NetworkSegment(b0ab0804-7f9b-4c31-bf12-1c25c5735467),segment_id=b0ab0804-7f9b-4c31-bf12-1c25c5735467)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:17.444656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.452524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ac86a88-6f22-4ec8-ae9b-8eff1028280c tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:17.455148 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5ac86a88-6f22-4ec8-ae9b-8eff1028280c tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.1084349 Nov 24 04:13:17.457946 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33606) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.460445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:17.461037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.467070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7f6a8dc9-49fc-472a-a8bb-5a6d4c2c2d4e None None] Provisioning complete for port 97a6381f-c7b3-411e-ac55-c7aa669ccbae triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:17.467448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f6a8dc9-49fc-472a-a8bb-5a6d4c2c2d4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.468742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Calling delete_port for 984231f8-e4fb-4b65-892f-c5e8bc34ada8 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:17.485424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:17.492790 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3cb86dba-b0d0-4406-a9f9-57542931ee3a tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=caa2f482-6336-4d5e-ae3d-753282912c95 HTTP/1.1" status: 200 len: 205 time: 0.0305676 Nov 24 04:13:17.493857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33608) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.495569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54aa51fe-6367-4acf-bf9f-cf31b2e94944 None None] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:17.532846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-551ca876-9cd8-4b86-9583-59188b02cc2d None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:17.534507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] Update dhcp port {'port': {'network_id': '6b3d6af7-c10b-4c2f-a386-3d3a570cb193', 'fixed_ips': [{'subnet_id': '1bc11f49-6376-4c45-b16f-b71dd58426e6', 'ip_address': '2001:db8::2'}, {'subnet_id': '5c0b3f8f-475f-41ec-9085-d573eb4a50b9'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '6151318c-d145-44cf-b61c-6937d6cc0892'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:13:17.541573 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ea7a0174-65bb-42e5-983f-6489a879979e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 1.4259822 Nov 24 04:13:17.548145 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33610) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.608800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.613091 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9b8c285b-5659-46c6-9f9f-f5728b698c69 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.6891017 Nov 24 04:13:17.615634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33612) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:17.620024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Request body: {'router': {'admin_state_up': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:17.662630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6151318c-d145-44cf-b61c-6937d6cc0892 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:17.692177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.721846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:17.722572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:17.723487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.724910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2494d93-85b4-42fb-9222-7638181ac5ab None None] Pushing event updated for resources: {'Port': ['ID=97a6381f-c7b3-411e-ac55-c7aa669ccbae,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:17.728613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.766652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 607f7000-de8f-4ff0-ba4c-90eb6966938b yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:17.804732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.838457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Deleting port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:17.838841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.879459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] No DVR routers for this DVR port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:17.881104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Port': ['ID=984231f8-e4fb-4b65-892f-c5e8bc34ada8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:17.935350 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:17.954102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.034140 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.090879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] For port 984231f8-e4fb-4b65-892f-c5e8bc34ada8, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:18.091273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.097029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.104321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f6a8dc9-49fc-472a-a8bb-5a6d4c2c2d4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.108404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Deleting port 0ac63031-0290-4ad2-ae9a-ba21350f1833 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:18.108755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.111428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Router e007af6a-e2da-48d3-a61f-fba222c588b6 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:18.120763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6151318c-d145-44cf-b61c-6937d6cc0892 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:18.121348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.134013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:18.139905 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Calling delete_port for 984231f8-e4fb-4b65-892f-c5e8bc34ada8 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:18.146840 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:13:18.172804 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c62f8a24-132b-4a75-9aa8-b8366a6c2c14']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.189229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b0ab0804-7f9b-4c31-bf12-1c25c5735467') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.189582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b0ab0804-7f9b-4c31-bf12-1c25c5735467') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.220026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:18.232141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.232826 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] Sync routers for ids ['e007af6a-e2da-48d3-a61f-fba222c588b6'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:18.245296 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] Routers {'e007af6a-e2da-48d3-a61f-fba222c588b6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:18.246298 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e007af6a-e2da-48d3-a61f-fba222c588b6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.256668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.262867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.264702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Releasing vlan 161 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:18.265160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.267908 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7f6a8dc9-49fc-472a-a8bb-5a6d4c2c2d4e None None] For port 97a6381f-c7b3-411e-ac55-c7aa669ccbae, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=97a6381f-c7b3-411e-ac55-c7aa669ccbae,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:18.299883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.304927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f6a8dc9-49fc-472a-a8bb-5a6d4c2c2d4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.306770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-5056a387-4f26-43bd-ad60-c8135c9a7757', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:18.307643 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.318589 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Calling delete_port for 0ac63031-0290-4ad2-ae9a-ba21350f1833 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:18.332987 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] Set router e007af6a-e2da-48d3-a61f-fba222c588b6 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:18.343635 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:18.352779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.367641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.371853 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] 10.222.0.48 "DELETE /v2.0/networks/c62f8a24-132b-4a75-9aa8-b8366a6c2c14 HTTP/1.1" status: 204 len: 168 time: 1.7892625 Nov 24 04:13:18.372732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] Pushing event deleted for resources: {'Port': ['ID=984231f8-e4fb-4b65-892f-c5e8bc34ada8,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:18.377676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecdd54fe-f6c8-4242-9a91-2e788f8177c7 None None] No DVR routers for this DVR port 984231f8-e4fb-4b65-892f-c5e8bc34ada8 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:18.417229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a95e6b-35c4-4104-833b-3fc133b139a9 tempest-NetworksTest-2025739026 tempest-NetworksTest-2025739026-project] Pushing event deleted for resources: {'Network': ['ID=c62f8a24-132b-4a75-9aa8-b8366a6c2c14,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:18.435643 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e007af6a-e2da-48d3-a61f-fba222c588b6', 'name': 'tempest-RoutersTest-router-2122205934', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:17Z', 'updated_at': '2021-11-24T04:13:17Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.451434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f6a8dc9-49fc-472a-a8bb-5a6d4c2c2d4e None None] Pushing event updated for resources: {'Port': ['ID=97a6381f-c7b3-411e-ac55-c7aa669ccbae,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:18.471460 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] Checking router: e007af6a-e2da-48d3-a61f-fba222c588b6 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:18.485099 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] Routers {'e007af6a-e2da-48d3-a61f-fba222c588b6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:18.486278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.486862 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e007af6a-e2da-48d3-a61f-fba222c588b6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.490626 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0429b157-1884-4444-8308-b0aabedb7b59 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "PUT /v2.0/routers/e007af6a-e2da-48d3-a61f-fba222c588b6 HTTP/1.1" status: 200 len: 694 time: 0.8709786 Nov 24 04:13:18.493888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33616) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:18.501176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] Allocated IP 2001:db8:0:1::2 (6b3d6af7-c10b-4c2f-a386-3d3a570cb193/5c0b3f8f-475f-41ec-9085-d573eb4a50b9/6151318c-d145-44cf-b61c-6937d6cc0892) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:18.580863 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] Set router e007af6a-e2da-48d3-a61f-fba222c588b6 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:18.616479 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.621996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-94c5d224-01bc-4e32-84f5-4c83cf5839a8 None None] Provisioning complete for port 97a6381f-c7b3-411e-ac55-c7aa669ccbae triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:18.622404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-94c5d224-01bc-4e32-84f5-4c83cf5839a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.641148 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1443666d-5a4f-4c23-b024-20b556a68bbe tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/routers/e007af6a-e2da-48d3-a61f-fba222c588b6 HTTP/1.1" status: 200 len: 700 time: 0.1441619 Nov 24 04:13:18.645386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33618) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:18.668408 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e007af6a-e2da-48d3-a61f-fba222c588b6', 'name': 'tempest-RoutersTest-router-2122205934', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:17Z', 'updated_at': '2021-11-24T04:13:17Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:18.691434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event deleted for resources: {'Port': ['ID=0ac63031-0290-4ad2-ae9a-ba21350f1833,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:18.702859 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dd1e2fc6-3a30-4712-92b2-1210c1a2467d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=e007af6a-e2da-48d3-a61f-fba222c588b6 HTTP/1.1" status: 200 len: 205 time: 0.0557818 Nov 24 04:13:18.709109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33620) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:18.721794 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b343d59e-d5cd-49aa-b34a-bfd4b2c9fadb None None] The sync data for ids ['e007af6a-e2da-48d3-a61f-fba222c588b6'] in dv-neutron-819049-1-hyperv is: [{'id': 'e007af6a-e2da-48d3-a61f-fba222c588b6', 'name': 'tempest-RoutersTest-router-2122205934', 'tenant_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:17Z', 'updated_at': '2021-11-24T04:13:17Z', 'revision_number': 2, 'project_id': 'fe0b1da3a1fe4ad9887be34e62b78e30', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:18.749430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8023531e-3c02-461f-ae71-282ce8015736 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:18.807515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.835930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 984231f8-e4fb-4b65-892f-c5e8bc34ada8 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:18.860718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:18.878900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Allocated IP 172.20.0.2 (5056a387-4f26-43bd-ad60-c8135c9a7757/33f81594-0144-42a4-83a7-399a3f0ca39f/b5628e02-3570-45bd-a28e-4382d747296c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:18.962951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33624) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.003501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.006135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.036436 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.040801 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.065673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.072579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.072977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Fanout notify agent at l3_agent the message router_deleted on router caa2f482-6336-4d5e-ae3d-753282912c95 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:19.081339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.087285 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e228536d-8608-48a7-a821-a7a966cc41b4 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/caa2f482-6336-4d5e-ae3d-753282912c95 HTTP/1.1" status: 204 len: 168 time: 1.5882630 Nov 24 04:13:19.087285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33628) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.091978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-785947770', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:19.124683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.125894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.136315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 984231f8-e4fb-4b65-892f-c5e8bc34ada8 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:19.136834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 984231f8-e4fb-4b65-892f-c5e8bc34ada8 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:19.166288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.166721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Fanout notify agent at l3_agent the message router_deleted on router e007af6a-e2da-48d3-a61f-fba222c588b6 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:19.175067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.176364 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d554f627-790e-4bec-b5f3-4697b4258c7d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/e007af6a-e2da-48d3-a61f-fba222c588b6 HTTP/1.1" status: 204 len: 168 time: 0.4660325 Nov 24 04:13:19.180074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33630) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.263477 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-04d68143-c793-4461-84f9-251b53b629aa tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=e007af6a-e2da-48d3-a61f-fba222c588b6 HTTP/1.1" status: 200 len: 205 time: 0.0818605 Nov 24 04:13:19.264423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33634) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.265182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.276404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.297665 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:13Z', 'revision_number': 3, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:19.300979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] For port 6151318c-d145-44cf-b61c-6937d6cc0892, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6151318c-d145-44cf-b61c-6937d6cc0892,segment=NetworkSegment(d514d37b-020f-4149-91a8-e0e9915d5624),segment_id=d514d37b-020f-4149-91a8-e0e9915d5624)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:19.313845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.315171 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6064d4fe-5b5b-4b5c-a80c-b499aa484d3f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.2269146 Nov 24 04:13:19.326692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33636) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.326692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': True}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:19.340929 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-33bc0fe8-3cb8-475d-9e8d-69964c83819d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:19.342110 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-33bc0fe8-3cb8-475d-9e8d-69964c83819d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/e007af6a-e2da-48d3-a61f-fba222c588b6 HTTP/1.1" status: 404 len: 336 time: 0.0766637 Nov 24 04:13:19.347606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33640) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.347816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65d75134-17ad-426e-a593-26e2a95cdead None None] The sync data for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv is: [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:13Z', 'revision_number': 3, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:19.382390 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.386586 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-53ce6045-d0b6-44af-8d19-aabac226b998 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:19.387082 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-53ce6045-d0b6-44af-8d19-aabac226b998 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:19.391356 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-53ce6045-d0b6-44af-8d19-aabac226b998 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/c3fd3c3f-6c82-4a68-b025-36e5ef24fc50 HTTP/1.1" status: 404 len: 337 time: 0.0421767 Nov 24 04:13:19.395123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.400499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33642) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.521586 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0c20c2b8-946e-4b21-8388-de84039092da tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:19.522471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0c20c2b8-946e-4b21-8388-de84039092da tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:19.525187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0c20c2b8-946e-4b21-8388-de84039092da tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/eca384a0-ac7f-4e35-8e16-c905722624f0 HTTP/1.1" status: 404 len: 337 time: 0.1242673 Nov 24 04:13:19.529689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33644) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.541078 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f8e2e2-7026-435e-acf0-07eca4b4b685 None None] Pushing event updated for resources: {'Port': ['ID=6151318c-d145-44cf-b61c-6937d6cc0892,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:19.557366 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.566759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.581257 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd27f2ab-2d9f-4d60-b513-99211452cec9 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:19.582449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fd27f2ab-2d9f-4d60-b513-99211452cec9 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:19.588115 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fd27f2ab-2d9f-4d60-b513-99211452cec9 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/df7589cb-718c-4fcd-ba62-6833177081f9 HTTP/1.1" status: 404 len: 337 time: 0.0546494 Nov 24 04:13:19.620956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:19.624269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:19.626748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33646) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.633930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:19.675851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Pushing event updated for resources: {'Port': ['ID=b5628e02-3570-45bd-a28e-4382d747296c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:19.746960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Attempting to bind port b5628e02-3570-45bd-a28e-4382d747296c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:19.748884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Attempting to bind port b5628e02-3570-45bd-a28e-4382d747296c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:19.749661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Attempting to bind port b5628e02-3570-45bd-a28e-4382d747296c on network 5056a387-4f26-43bd-ad60-c8135c9a7757 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:19.757248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:19.758041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Checking segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:19.764243 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.765331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Bound using segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:19.766081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Bound port: b5628e02-3570-45bd-a28e-4382d747296c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:19.769075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.784858 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-5621c154-424b-4dcf-b883-0e0dcbf1c2ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:19.786002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5621c154-424b-4dcf-b883-0e0dcbf1c2ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:19.789357 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5621c154-424b-4dcf-b883-0e0dcbf1c2ea tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/2fd90e2e-d7be-46b0-b347-1ae9291266ea HTTP/1.1" status: 404 len: 337 time: 0.1578338 Nov 24 04:13:19.797398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33648) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.819420 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-60cee0c7-c468-4e0a-ba18-98d6dbb2dd56 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=fe4291b8f221492d8b81baaa02df346a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8552263 Nov 24 04:13:19.822339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33650) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.884376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] For port b5628e02-3570-45bd-a28e-4382d747296c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:19.888803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Allocated IP 172.20.0.1 (5056a387-4f26-43bd-ad60-c8135c9a7757/33f81594-0144-42a4-83a7-399a3f0ca39f/75d0fa55-1147-44a1-ad13-e876f755d833) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:19.892005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] For port b5628e02-3570-45bd-a28e-4382d747296c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b5628e02-3570-45bd-a28e-4382d747296c,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:19.899474 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-66f35a36-6157-497d-a569-d99e15ac3781 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 200 len: 205 time: 0.1004441 Nov 24 04:13:19.909382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33652) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:19.909575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:19.985972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d360691-f6ff-47c8-9b55-aab2bbf91607 None None] Pushing event updated for resources: {'Port': ['ID=b5628e02-3570-45bd-a28e-4382d747296c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:19.994664 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::13 (6b3d6af7-c10b-4c2f-a386-3d3a570cb193/1bc11f49-6376-4c45-b16f-b71dd58426e6/607f7000-de8f-4ff0-ba4c-90eb6966938b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:20.044942 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-a3abdf11-f610-4c5f-ba3e-a1559dbe476a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:20.048903 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a3abdf11-f610-4c5f-ba3e-a1559dbe476a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/af1bca15-198f-4ff7-9729-e777368c7abb HTTP/1.1" status: 404 len: 336 time: 0.1383517 Nov 24 04:13:20.049056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8:0:1::387 (6b3d6af7-c10b-4c2f-a386-3d3a570cb193/5c0b3f8f-475f-41ec-9085-d573eb4a50b9/607f7000-de8f-4ff0-ba4c-90eb6966938b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:20.049166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33654) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.110724 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-06187088-cf25-48c7-8fd1-8480688fe808 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=c4c47676-087d-4294-b078-629be3c2c426 HTTP/1.1" status: 200 len: 205 time: 0.0538924 Nov 24 04:13:20.121152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33656) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.134816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c40db5ae-e221-446e-aabc-7b7ea3e38647 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.251104 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-9838cbcc-7f65-4795-8346-a70e8d9354af tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:20.252382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9838cbcc-7f65-4795-8346-a70e8d9354af tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/c4c47676-087d-4294-b078-629be3c2c426 HTTP/1.1" status: 404 len: 336 time: 0.1304343 Nov 24 04:13:20.259034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33658) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.343170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.354882 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-80279a51-cf64-4ef5-937d-93f78065ea60 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:20.355673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-80279a51-cf64-4ef5-937d-93f78065ea60 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:20.358709 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-80279a51-cf64-4ef5-937d-93f78065ea60 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/8d5f518d-c9d6-478a-82fd-b9f890fc8fb1 HTTP/1.1" status: 404 len: 337 time: 0.0799727 Nov 24 04:13:20.361355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c40db5ae-e221-446e-aabc-7b7ea3e38647 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.364162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33660) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.395295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.453278 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a39df57d-3eb5-4040-80e2-d4d846dd57f4 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 200 len: 205 time: 0.0851860 Nov 24 04:13:20.462475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33662) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.509581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.523680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9070edb8-861e-4db1-a7fb-c89baa5a4fc7 None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:20.537851 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-e0587599-9d3c-4d77-a9b7-3e270d92fa4d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:20.539071 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0587599-9d3c-4d77-a9b7-3e270d92fa4d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/ab2ed2ad-9a67-4de0-9f0e-a6d60053938a HTTP/1.1" status: 404 len: 336 time: 0.0731895 Nov 24 04:13:20.544988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33664) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.585724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.632027 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c9a7c55c-4abf-4983-9632-ca6656f289af tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=e69bb93d-78fa-499d-a7af-dfa32819151e HTTP/1.1" status: 200 len: 205 time: 0.0844455 Nov 24 04:13:20.635082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33666) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.653226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0dbd7b25-8fac-4c05-93ee-931e4315f514 None None] Provisioning complete for port 6151318c-d145-44cf-b61c-6937d6cc0892 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:20.653996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0dbd7b25-8fac-4c05-93ee-931e4315f514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.673892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.687647 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:20.690926 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-d0638555-37ab-48bb-9850-6faec96c25cc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:20.693265 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d0638555-37ab-48bb-9850-6faec96c25cc tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/e69bb93d-78fa-499d-a7af-dfa32819151e HTTP/1.1" status: 404 len: 336 time: 0.0567417 Nov 24 04:13:20.697667 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33668) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.705039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Port': ['ID=75d0fa55-1147-44a1-ad13-e876f755d833,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:20.714453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:20.721325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:20.729739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c40db5ae-e221-446e-aabc-7b7ea3e38647 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.735689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c40db5ae-e221-446e-aabc-7b7ea3e38647 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.740422 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c40db5ae-e221-446e-aabc-7b7ea3e38647 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/538ad144-886d-4797-a27b-4065d8353844 HTTP/1.1" status: 204 len: 168 time: 0.9131391 Nov 24 04:13:20.781109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c40db5ae-e221-446e-aabc-7b7ea3e38647 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=538ad144-886d-4797-a27b-4065d8353844,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:20.796234 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d04b1ae1-9b77-47eb-bce6-7521f92745c7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:20.796706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d04b1ae1-9b77-47eb-bce6-7521f92745c7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:20.803826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:20.806949 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d04b1ae1-9b77-47eb-bce6-7521f92745c7 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/86b66dec-73bb-497a-a092-63fdb23e66a0 HTTP/1.1" status: 404 len: 337 time: 0.1074424 Nov 24 04:13:20.809520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33672) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.838274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:20.874798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:20.889778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:20.892045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:20.900896 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c1dc6f94-d9f5-49e8-96d9-74b69dc92731 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=c75d89d7-ce43-46a1-b7ab-9bc683d54469 HTTP/1.1" status: 200 len: 205 time: 0.0858893 Nov 24 04:13:20.911550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33674) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:20.924064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=607f7000-de8f-4ff0-ba4c-90eb6966938b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:20.995751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.013951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.042369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.070036 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-7e8bf400-7e8d-424d-bdd1-c9abd4fed41d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:21.075044 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7e8bf400-7e8d-424d-bdd1-c9abd4fed41d tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/c75d89d7-ce43-46a1-b7ab-9bc683d54469 HTTP/1.1" status: 404 len: 336 time: 0.1590712 Nov 24 04:13:21.076298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33678) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:21.093099 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-23e4b525-4521-4ca9-84a3-72a25069c1c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1015 time: 4.2937725 Nov 24 04:13:21.098943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33682) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:21.137130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '1bc11f49-6376-4c45-b16f-b71dd58426e6'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:21.181724 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e320872-4a67-4c73-bc1d-979d6fad8100 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:21.181724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e320872-4a67-4c73-bc1d-979d6fad8100 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:21.187562 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0e320872-4a67-4c73-bc1d-979d6fad8100 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/ac622e9a-0595-4421-8277-c93244989e08 HTTP/1.1" status: 404 len: 337 time: 0.1077771 Nov 24 04:13:21.188191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33686) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:21.216597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-00a6efe4-7f50-4e1c-b7b5-62cbcfcbf43c None None] Provisioning complete for port 6151318c-d145-44cf-b61c-6937d6cc0892 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:21.216978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00a6efe4-7f50-4e1c-b7b5-62cbcfcbf43c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.249496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Allocated IP 172.26.5.121 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/40ac870c-614d-4f6b-875f-c08d3a8e5e2c) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:21.316541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33692) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:21.316967 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-45f27c0c-7885-40c7-b4b9-f60ce52364da tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "GET /v2.0/ports?device_id=7018d854-20ab-4a10-9fbe-cf1d554328fe HTTP/1.1" status: 200 len: 205 time: 0.0697646 Nov 24 04:13:21.325167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.388589 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-00a6efe4-7f50-4e1c-b7b5-62cbcfcbf43c None None] Provisioning complete for port 607f7000-de8f-4ff0-ba4c-90eb6966938b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:21.389061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00a6efe4-7f50-4e1c-b7b5-62cbcfcbf43c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.444289 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-95d75937-f38a-4954-97a7-1f6609e1636a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] delete failed (client error): The resource could not be found. Nov 24 04:13:21.445376 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-95d75937-f38a-4954-97a7-1f6609e1636a tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/routers/7018d854-20ab-4a10-9fbe-cf1d554328fe HTTP/1.1" status: 404 len: 336 time: 0.1261163 Nov 24 04:13:21.454199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33694) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:21.463899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-00a6efe4-7f50-4e1c-b7b5-62cbcfcbf43c None None] Port 607f7000-de8f-4ff0-ba4c-90eb6966938b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:21.545367 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-b7c8ebe5-744a-4582-bfa3-466b8296f465 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:21.545818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b7c8ebe5-744a-4582-bfa3-466b8296f465 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:21.549077 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b7c8ebe5-744a-4582-bfa3-466b8296f465 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/79a08516-6cbb-4969-91b9-a4463e92bf0a HTTP/1.1" status: 404 len: 337 time: 0.0471017 Nov 24 04:13:21.562282 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33698) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:21.615579 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d4f65e08-208b-4915-9da1-e58a3afba662 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:21.616060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d4f65e08-208b-4915-9da1-e58a3afba662 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:21.622200 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d4f65e08-208b-4915-9da1-e58a3afba662 tempest-RoutersTest-793343933 tempest-RoutersTest-793343933-project] 10.222.0.48 "DELETE /v2.0/subnets/dfcb001c-d1d5-4a10-90d3-89338c1ce680 HTTP/1.1" status: 404 len: 337 time: 0.0563650 Nov 24 04:13:21.670078 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.677662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d517dc2a-8875-4897-95e7-cb5a3f3b9af9 None None] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:21.748333 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.845529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:21.856002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Port': ['ID=40ac870c-614d-4f6b-875f-c08d3a8e5e2c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:21.856345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Provisioning complete for port 607f7000-de8f-4ff0-ba4c-90eb6966938b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:21.856719 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:21.878328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:21.883890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:21.918402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37d96624-ae7e-4c0a-81f2-d00d2fd89ff0 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:21.955747 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6151318c-d145-44cf-b61c-6937d6cc0892 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:21.975006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Port 607f7000-de8f-4ff0-ba4c-90eb6966938b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:22.027617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.048726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33712) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:22.068507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33716) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:22.096578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Provisioning complete for port b5628e02-3570-45bd-a28e-4382d747296c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:22.096797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.183572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6151318c-d145-44cf-b61c-6937d6cc0892 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:22.184057 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.286399 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1103798796'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:22.292644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.320359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:22.323796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.355033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.379659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5628e02-3570-45bd-a28e-4382d747296c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:22.384067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.419363 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d958cd7c-7b54-4480-93aa-a9f2c682df8c admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=fe0b1da3a1fe4ad9887be34e62b78e30&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3496785 Nov 24 04:13:22.421912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33720) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:22.483113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] For port b5628e02-3570-45bd-a28e-4382d747296c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b5628e02-3570-45bd-a28e-4382d747296c,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:22.492093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.499370 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Delete allocated IP 2001:db8:0:1::387 (6b3d6af7-c10b-4c2f-a386-3d3a570cb193/5c0b3f8f-475f-41ec-9085-d573eb4a50b9) {{(pid=103381) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 04:13:22.527560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b5628e02-3570-45bd-a28e-4382d747296c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:22.528385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.568727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f47fd6e0-8f2c-418a-96cd-2ca2bb4b49de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.607204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f47fd6e0-8f2c-418a-96cd-2ca2bb4b49de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.615821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8343ae56-9cd5-4913-8d11-dc59cf78a91e None None] Pushing event updated for resources: {'Port': ['ID=b5628e02-3570-45bd-a28e-4382d747296c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:22.617419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.625392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.656282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Provisioning complete for port b5628e02-3570-45bd-a28e-4382d747296c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:22.656730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.683463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.712096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 97a6381f-c7b3-411e-ac55-c7aa669ccbae up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:22.716103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.722662 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.749161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f47fd6e0-8f2c-418a-96cd-2ca2bb4b49de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.751900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f47fd6e0-8f2c-418a-96cd-2ca2bb4b49de admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.756900 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f47fd6e0-8f2c-418a-96cd-2ca2bb4b49de admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/50a6cafd-d71d-4a82-8689-3af92613ee6e HTTP/1.1" status: 204 len: 168 time: 0.3338637 Nov 24 04:13:22.771887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47fd6e0-8f2c-418a-96cd-2ca2bb4b49de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50a6cafd-d71d-4a82-8689-3af92613ee6e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:22.788616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Port': ['ID=75d0fa55-1147-44a1-ad13-e876f755d833,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:22.802808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.831698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Router 8db6a9d0-5556-4f76-9fe9-8db0ba2f774f is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:22.849333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 97a6381f-c7b3-411e-ac55-c7aa669ccbae triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:22.849721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.872192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 167, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:22.914598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.914948 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment 7bf5b14e-f40d-4760-a2d5-49f2d2712f10 of type vlan for network a288e794-7129-48ec-b278-2ea8bf1fe00e Nov 24 04:13:22.918422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Provisioning complete for port 75d0fa55-1147-44a1-ad13-e876f755d833 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:22.919083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.925942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16fb3cce-8746-4113-8285-e490ab03bd0e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:22.940678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.949930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:22.971422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Port 75d0fa55-1147-44a1-ad13-e876f755d833 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:22.979778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.015587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Provisioning complete for port 40ac870c-614d-4f6b-875f-c08d3a8e5e2c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:23.015969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.027716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:23.039350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] Sync routers for ids ['8db6a9d0-5556-4f76-9fe9-8db0ba2f774f'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:23.039565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.040694 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6f278f7e-b4c7-4707-ada1-4e15c4675726 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "PUT /v2.0/routers/8db6a9d0-5556-4f76-9fe9-8db0ba2f774f HTTP/1.1" status: 200 len: 918 time: 3.7204826 Nov 24 04:13:23.043902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33726) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.055307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=607f7000-de8f-4ff0-ba4c-90eb6966938b,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:23.061515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] Routers {'8db6a9d0-5556-4f76-9fe9-8db0ba2f774f'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:23.062200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8db6a9d0-5556-4f76-9fe9-8db0ba2f774f'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:23.068115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.103836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:23.110815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9fbadf68-2ab0-41f9-8459-055e4d5a544f None None] Port 40ac870c-614d-4f6b-875f-c08d3a8e5e2c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:23.114632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] In _notify_port_updated(), no bound segment for port 607f7000-de8f-4ff0-ba4c-90eb6966938b on network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:13:23.118216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] Routers {'8db6a9d0-5556-4f76-9fe9-8db0ba2f774f'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:23.118713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['8db6a9d0-5556-4f76-9fe9-8db0ba2f774f'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:23.120246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:23.121171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.122233 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b9091bbe-239e-4118-b692-07fbf655e7ab tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/ports/607f7000-de8f-4ff0-ba4c-90eb6966938b HTTP/1.1" status: 200 len: 924 time: 2.0179181 Nov 24 04:13:23.130028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33730) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.143326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '1bc11f49-6376-4c45-b16f-b71dd58426e6'}, {'subnet_id': '5c0b3f8f-475f-41ec-9085-d573eb4a50b9'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:23.166745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:23.167519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36072a7d-ffe5-4d1d-a2d8-4fffcf485775 None None] The sync data for ids ['8db6a9d0-5556-4f76-9fe9-8db0ba2f774f'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:23.208718 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6538ac2c-5b24-49c0-b3d7-37e778013e20 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/8db6a9d0-5556-4f76-9fe9-8db0ba2f774f HTTP/1.1" status: 200 len: 924 time: 0.1635146 Nov 24 04:13:23.211447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33734) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.232721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.240081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:23.240720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.251053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d438e5f4-fe67-4f9b-8864-7edc6552441b None None] Provisioning complete for port 75d0fa55-1147-44a1-ad13-e876f755d833 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:23.251441 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d438e5f4-fe67-4f9b-8864-7edc6552441b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.297577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4cdf6d6-3363-43c4-92a4-e1c36769c60a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:23.297577 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c4cdf6d6-3363-43c4-92a4-e1c36769c60a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=8db6a9d0-5556-4f76-9fe9-8db0ba2f774f&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0810173 Nov 24 04:13:23.298948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33738) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.316491 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d438e5f4-fe67-4f9b-8864-7edc6552441b None None] Port 75d0fa55-1147-44a1-ad13-e876f755d833 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:23.352981 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 1.2971859 Nov 24 04:13:23.353868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33742) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.367752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'name': 'tempest-PortsTestJSON-988581057'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:23.380286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055213cb-39d6-4f69-bc67-ba1821fe05c0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=a288e794-7129-48ec-b278-2ea8bf1fe00e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:23.391655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:23.429351 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8faf098d-6e59-42c4-8763-5f5e1a4512b6 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:23.430464 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8faf098d-6e59-42c4-8763-5f5e1a4512b6 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.1292710 Nov 24 04:13:23.433919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33744) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.468108 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f441447d-a68c-4933-a68e-9ccefa079b2f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=8db6a9d0-5556-4f76-9fe9-8db0ba2f774f HTTP/1.1" status: 200 len: 205 time: 0.0326047 Nov 24 04:13:23.473326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33748) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.514177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:23.522646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:23.636033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.666087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5628e02-3570-45bd-a28e-4382d747296c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:23.680746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.714242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-92116dd0-a4d6-4bc6-94c1-1375927cea20 None None] Provisioning complete for port 607f7000-de8f-4ff0-ba4c-90eb6966938b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:23.714751 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-92116dd0-a4d6-4bc6-94c1-1375927cea20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.757975 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:23.761750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.781896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-92116dd0-a4d6-4bc6-94c1-1375927cea20 None None] Port 607f7000-de8f-4ff0-ba4c-90eb6966938b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:23.803637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b5628e02-3570-45bd-a28e-4382d747296c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:23.804160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.808092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 6069ea67-8627-41f6-b533-5ca8850bfd72 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:23.825443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.898633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Deleting port 40ac870c-614d-4f6b-875f-c08d3a8e5e2c {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:23.899029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.929769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7c64363b-4290-469c-af82-efd786cc60f3 None None] Provisioning complete for port 75d0fa55-1147-44a1-ad13-e876f755d833 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:23.930457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7c64363b-4290-469c-af82-efd786cc60f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:23.946202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33756) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:23.971784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7c64363b-4290-469c-af82-efd786cc60f3 None None] Port 75d0fa55-1147-44a1-ad13-e876f755d833 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:23.980151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:24.000505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.014425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Calling delete_port for 40ac870c-614d-4f6b-875f-c08d3a8e5e2c owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:24.082229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-2146224063'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:24.180838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.209961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event deleted for resources: {'Port': ['ID=40ac870c-614d-4f6b-875f-c08d3a8e5e2c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:24.231456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b06a71b5-c987-4238-867a-5dd4346b71b1 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:24.262997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Made reservation on behalf of 700e4436a7fe450b93f258c3b345b106 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:24.266483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.273054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.273662 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.294671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.354181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:24.377740 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7fc9fae0-e814-42a3-87cf-3eb08c8e22e5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "PUT /v2.0/routers/b8a445b6-5fdb-42f6-b52f-7fd6b64b4707/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8142188 Nov 24 04:13:24.377991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.378098 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Sync routers for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:24.379209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.395229 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:24.395531 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8:0:1::232 (6b3d6af7-c10b-4c2f-a386-3d3a570cb193/5c0b3f8f-475f-41ec-9085-d573eb4a50b9/607f7000-de8f-4ff0-ba4c-90eb6966938b) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:24.396893 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:24.420496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.421520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Fanout notify agent at l3_agent the message router_deleted on router 8db6a9d0-5556-4f76-9fe9-8db0ba2f774f {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:24.429911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.432088 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bcf4a581-5503-4798-918d-021a710e1c43 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/8db6a9d0-5556-4f76-9fe9-8db0ba2f774f HTTP/1.1" status: 204 len: 168 time: 0.9566681 Nov 24 04:13:24.437711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33762) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:24.442842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1444585213', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:24.461329 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.474553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.475639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.573120 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:24.588411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=6069ea67-8627-41f6-b533-5ca8850bfd72,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:24.716585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.733867 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-e73b2767-65d6-493f-8dae-7610602a3c95 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1226514769&fields=id&tenant_id=aef2575f68e0468dbefaa9800a1007e9 HTTP/1.1" status: 200 len: 267 time: 0.1172888 Nov 24 04:13:24.734512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.747056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:24.756970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.757318 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Added segment 866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8 of type vlan for network eece608a-2941-4024-9a30-f80ac327dc91 Nov 24 04:13:24.793616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.819627 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:22Z', 'revision_number': 2, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:24.825059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.833766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.840113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.844288 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': '7bf5b14e-f40d-4760-a2d5-49f2d2712f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:24.844541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.845043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: a288e794-7129-48ec-b278-2ea8bf1fe00e, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:24.847092 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Checking router: b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:24.847956 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Updating router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 port 75d0fa55-1147-44a1-ad13-e876f755d833 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:13:24.863203 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.865141 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2313210d-368e-4a8c-ad60-6f86c400ee94 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4264035 Nov 24 04:13:24.868115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33774) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:24.872874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'enable_snat': False}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:24.880101 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:24.921022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1b7281f0-94ac-4e5f-a6bd-3a23478f6ead,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:25.173341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.191642 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.203789 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.279302 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Pushing event updated for resources: {'Port': ['ID=75d0fa55-1147-44a1-ad13-e876f755d833,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:25.297151 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.297522 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.297885 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.298290 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.298583 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.298940 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.299277 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.299626 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.299973 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.300472 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.300799 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.301123 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:13:25.354544 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Attempting to bind port 75d0fa55-1147-44a1-ad13-e876f755d833 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:25.354919 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Attempting to bind port 75d0fa55-1147-44a1-ad13-e876f755d833 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:25.355291 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Attempting to bind port 75d0fa55-1147-44a1-ad13-e876f755d833 on network 5056a387-4f26-43bd-ad60-c8135c9a7757 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:25.360917 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:25.361282 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Checking segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:25.361692 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.362086 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Bound using segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:25.362943 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Bound port: 75d0fa55-1147-44a1-ad13-e876f755d833, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:25.363354 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.415026 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-47e308e5-e70e-459e-8b7c-78ff65e815a5 None None] Provisioning complete for port 607f7000-de8f-4ff0-ba4c-90eb6966938b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:25.415647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-47e308e5-e70e-459e-8b7c-78ff65e815a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.436327 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] For port 75d0fa55-1147-44a1-ad13-e876f755d833, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:25.441449 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] For port 75d0fa55-1147-44a1-ad13-e876f755d833, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=75d0fa55-1147-44a1-ad13-e876f755d833,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:25.456259 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.463002 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-47e308e5-e70e-459e-8b7c-78ff65e815a5 None None] Port 607f7000-de8f-4ff0-ba4c-90eb6966938b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:25.483196 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.515576 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:25.516220 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:25.529419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.536192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.536839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.544692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.545104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=607f7000-de8f-4ff0-ba4c-90eb6966938b,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:25.548089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] In _notify_port_updated(), no bound segment for port 607f7000-de8f-4ff0-ba4c-90eb6966938b on network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:13:25.554645 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.555539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.558616 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d9e1f47e-cda7-4f33-896a-367877df7172 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/ports/607f7000-de8f-4ff0-ba4c-90eb6966938b HTTP/1.1" status: 200 len: 1010 time: 2.4249887 Nov 24 04:13:25.560443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33778) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:25.560836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:25.587585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ad1ae4c0-4b71-4d3e-9449-28d47122404b None None] Provisioning complete for port 75d0fa55-1147-44a1-ad13-e876f755d833 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:25.587963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1ae4c0-4b71-4d3e-9449-28d47122404b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.703126 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.7535076 Nov 24 04:13:25.705932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, a288e794-7129-48ec-b278-2ea8bf1fe00e) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:25.706820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33780) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:25.711574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:25.718281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.718778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.722096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33782) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:25.725760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Request body: {'subnet': {'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:25.729996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d4ebbdb-ad48-4dd0-8d9c-ebea1cbe493c None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:25.731463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98cd4e81-5159-4db9-918f-77efe38bb4b5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event updated for resources: {'Network': ['ID=eece608a-2941-4024-9a30-f80ac327dc91,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:25.735564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1ae4c0-4b71-4d3e-9449-28d47122404b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.760427 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c898f39c-bb12-49fa-8b97-9a9dab6d4274 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 2.3987508 Nov 24 04:13:25.761476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33784) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:25.771755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-528c5f1c-d309-4aa1-aa32-21dd92f9ec37 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.776410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network eece608a-2941-4024-9a30-f80ac327dc91 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:25.780264 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b644d63-0b74-4ee1-99e2-e0ef22545799 None None] Pushing event updated for resources: {'Port': ['ID=75d0fa55-1147-44a1-ad13-e876f755d833,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:25.781008 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-528c5f1c-d309-4aa1-aa32-21dd92f9ec37 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 797 time: 0.9848440 Nov 24 04:13:25.797195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1708415517'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:25.813768 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:25.831848 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-34758140-fabc-445f-b58a-5d0f2572b7fe tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/quotas/aef2575f68e0468dbefaa9800a1007e9 HTTP/1.1" status: 200 len: 375 time: 0.0493433 Nov 24 04:13:25.884488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 607f7000-de8f-4ff0-ba4c-90eb6966938b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:25.885056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.895099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:25.901092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.923494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad1ae4c0-4b71-4d3e-9449-28d47122404b None None] For port 75d0fa55-1147-44a1-ad13-e876f755d833, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=75d0fa55-1147-44a1-ad13-e876f755d833,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:25.949693 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-3b01dab2-dd2a-4dc0-af24-36677095161f tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1084824 Nov 24 04:13:25.975075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad1ae4c0-4b71-4d3e-9449-28d47122404b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:25.991049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24f3aa22-b013-4d13-9cd0-765e65cf0430 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.991523 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24f3aa22-b013-4d13-9cd0-765e65cf0430 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.992523 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24f3aa22-b013-4d13-9cd0-765e65cf0430 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:25.999165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 168, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:26.007949 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-24f3aa22-b013-4d13-9cd0-765e65cf0430 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?project_id=b951944bf1f44ed1b10939b3ae3d3197&network_id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 3000 time: 0.2754254 Nov 24 04:13:26.042424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Allocated IP 172.26.5.107 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/21ad8624-6bce-4a98-b537-0fe37fa99d09) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:26.055008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.057674 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment 587a7274-6993-44c0-8c83-37ad2d0e43df of type vlan for network b174064f-d0e5-4174-9b36-f84442e29aea Nov 24 04:13:26.117770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Made reservation on behalf of 700e4436a7fe450b93f258c3b345b106 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:26.121354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.127537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.129593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.137481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1ae4c0-4b71-4d3e-9449-28d47122404b None None] Pushing event updated for resources: {'Port': ['ID=75d0fa55-1147-44a1-ad13-e876f755d833,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:26.140472 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:26.150634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4a95ad40-ac22-49db-8ac6-8e892ed6237d None None] Provisioning complete for port 75d0fa55-1147-44a1-ad13-e876f755d833 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:26.151343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4a95ad40-ac22-49db-8ac6-8e892ed6237d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.158037 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-e2b7ff73-8d0e-4b28-a0ab-51a5a1ebd829 service neutron] 10.222.0.48 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2002039 Nov 24 04:13:26.188919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 607f7000-de8f-4ff0-ba4c-90eb6966938b owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:26.192737 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67396078-9c79-43a0-b17c-4b06b1931a29 None None] The sync data for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv is: [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:26.245571 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.253811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:26.254472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.266545 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.324910 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.5304396 Nov 24 04:13:26.326032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33790) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:26.363660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3b48ef-1d07-440a-9c8e-3647eeb8fa24 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=b174064f-d0e5-4174-9b36-f84442e29aea,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:26.367476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'ports': [{'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'}, {'network_id': 'b174064f-d0e5-4174-9b36-f84442e29aea'}]} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:26.368323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:26.368323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'b174064f-d0e5-4174-9b36-f84442e29aea'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:26.378843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network b174064f-d0e5-4174-9b36-f84442e29aea details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:26.384678 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:13:26.396836 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-f40697a0-981c-4462-8c13-a874603995c3 service neutron] 10.222.0.48 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2368476 Nov 24 04:13:26.530587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.656759 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9cc009d9-0179-40e8-b1ee-94fb784ccd54 req-69dc93c8-b827-462f-a281-9c43d3019518 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 210 time: 0.0870514 Nov 24 04:13:26.709280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:26.787370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Pushing event updated for resources: {'Port': ['ID=21ad8624-6bce-4a98-b537-0fe37fa99d09,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:26.791177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:26.793300 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:26.818472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfdb5efc-0251-4d96-b52b-fbd908011e37 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:26.880217 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:26.952151 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a6b34f4f-563f-48d8-9f23-459cbad7480c None None] Provisioning complete for port 21ad8624-6bce-4a98-b537-0fe37fa99d09 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:26.952762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a6b34f4f-563f-48d8-9f23-459cbad7480c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.000377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a6b34f4f-563f-48d8-9f23-459cbad7480c None None] Port 21ad8624-6bce-4a98-b537-0fe37fa99d09 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:27.059034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 2} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:27.064509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.135984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.137846 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event updated for resources: {'Subnet': ['ID=958504fd-5b6e-43e5-976b-817e580cdd34,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:27.177283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Checking segment: {'id': '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:27.177663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Network hostable DHCP agents. Network: eece608a-2941-4024-9a30-f80ac327dc91, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:27.181934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.259139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=607f7000-de8f-4ff0-ba4c-90eb6966938b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:27.373625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.380032 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dfce0899-0010-4ffc-a98a-940914ab7d60 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/607f7000-de8f-4ff0-ba4c-90eb6966938b HTTP/1.1" status: 204 len: 168 time: 1.8157480 Nov 24 04:13:27.380823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33802) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:27.392678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 06f80541-be69-4f70-bdd8-8abde55230e5 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:27.401827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Network eece608a-2941-4024-9a30-f80ac327dc91 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:27.413512 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-2dbc3de3-3b6c-4247-8939-aa736f38a781 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:27.417474 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2dbc3de3-3b6c-4247-8939-aa736f38a781 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/607f7000-de8f-4ff0-ba4c-90eb6966938b HTTP/1.1" status: 404 len: 333 time: 0.0325687 Nov 24 04:13:27.418182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33804) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:27.453853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, eece608a-2941-4024-9a30-f80ac327dc91) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:27.458517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:27.459121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.466553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c23d238-fd08-4f17-ae7a-2112639165d4 None None] Network eece608a-2941-4024-9a30-f80ac327dc91 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:27.498377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 5c0b3f8f-475f-41ec-9085-d573eb4a50b9 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:27.498583 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5ab557d0-303c-4bab-9cb7-34b1bdc61319 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7771509 Nov 24 04:13:27.503318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.504117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33806) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:27.513878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Request body: {'port': {'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91', 'name': 'tempest-TagsExtTest-1548996506'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:27.554199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.685249 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.698901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 75d0fa55-1147-44a1-ad13-e876f755d833 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:27.745696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-eece608a-2941-4024-9a30-f80ac327dc91', 'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91', 'tenant_id': '700e4436a7fe450b93f258c3b345b106', 'fixed_ips': [{'subnet_id': '958504fd-5b6e-43e5-976b-817e580cdd34'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:27.746631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.796680 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.905198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 75d0fa55-1147-44a1-ad13-e876f755d833 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:27.906177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.914928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Made reservation on behalf of 700e4436a7fe450b93f258c3b345b106 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:27.916329 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2dbc00f5-1dbf-4689-a5da-cec0d13986a8 req-87e3e188-4939-4efd-b9a7-b236dda72c40 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 210 time: 0.0762827 Nov 24 04:13:27.921568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.923720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:27.937479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-e75a2b7c-7fc5-4ac9-b3a9-14e5847a3252 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:27.939377 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-e75a2b7c-7fc5-4ac9-b3a9-14e5847a3252 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.21 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 797 time: 0.2541399 Nov 24 04:13:27.955299 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 11ee5027-ec2b-410e-b9f7-251f236c45f0 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:27.955540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Allocated IP 172.20.0.2 (eece608a-2941-4024-9a30-f80ac327dc91/958504fd-5b6e-43e5-976b-817e580cdd34/a5f1c74b-6dee-4797-ad76-28272679b369) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:27.973307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] device_id is not set on port 2792e925-c250-4107-927e-d83a07802192 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:28.048910 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-be24a569-4a42-45a8-8c44-43332c8e68c4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aef2575f68e0468dbefaa9800a1007e9 HTTP/1.1" status: 200 len: 380 time: 0.0899537 Nov 24 04:13:28.054990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.095045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'port': {'device_id': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'admin_state_up': True, 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'security_groups': ['e24375a3-c4f9-4455-8a33-cc4587a3c8fa']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:28.098989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=5c0b3f8f-475f-41ec-9085-d573eb4a50b9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:28.118990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.122438 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-313cb65e-6a1a-455e-8a50-e664ac5651ec tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/5c0b3f8f-475f-41ec-9085-d573eb4a50b9 HTTP/1.1" status: 204 len: 168 time: 0.7031541 Nov 24 04:13:28.129668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33816) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:28.143354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddc8e1cc-4345-46ba-a23c-3e07f778b364 None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:28.224313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.231517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 1bc11f49-6376-4c45-b16f-b71dd58426e6 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:28.236141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.243750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.287879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Network eece608a-2941-4024-9a30-f80ac327dc91 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:28.297546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:28.312969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.320342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:28.331979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Pushing event updated for resources: {'Port': ['ID=a5f1c74b-6dee-4797-ad76-28272679b369,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:28.356816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Made reservation on behalf of aef2575f68e0468dbefaa9800a1007e9 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:28.362071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.423669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Attempting to bind port a5f1c74b-6dee-4797-ad76-28272679b369 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:28.424051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Attempting to bind port a5f1c74b-6dee-4797-ad76-28272679b369 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:28.424403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Attempting to bind port a5f1c74b-6dee-4797-ad76-28272679b369 on network eece608a-2941-4024-9a30-f80ac327dc91 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:28.430866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:28.431282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Checking segment: {'id': '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:28.431642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.432034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Bound using segment: {'id': '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:28.432500 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Bound port: a5f1c74b-6dee-4797-ad76-28272679b369, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': 'eece608a-2941-4024-9a30-f80ac327dc91'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:28.432881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.487154 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.492416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Allocated IP 172.20.0.11 (eece608a-2941-4024-9a30-f80ac327dc91/958504fd-5b6e-43e5-976b-817e580cdd34/2792e925-c250-4107-927e-d83a07802192) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:28.506690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7780d628-86fb-465b-af13-768116cfc95a None None] For port a5f1c74b-6dee-4797-ad76-28272679b369, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:28.510429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7780d628-86fb-465b-af13-768116cfc95a None None] For port a5f1c74b-6dee-4797-ad76-28272679b369, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a5f1c74b-6dee-4797-ad76-28272679b369,segment=NetworkSegment(866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8),segment_id=866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:28.518242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.581366 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7780d628-86fb-465b-af13-768116cfc95a None None] Pushing event updated for resources: {'Port': ['ID=a5f1c74b-6dee-4797-ad76-28272679b369,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:28.586809 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.589277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Allocated IP 172.20.0.13 (5056a387-4f26-43bd-ad60-c8135c9a7757/33f81594-0144-42a4-83a7-399a3f0ca39f/c286a8f2-ac43-4387-b29d-abf0de1cbc16) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:28.613885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.624336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.665034 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=1bc11f49-6376-4c45-b16f-b71dd58426e6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:28.669547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.673045 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8e01b0d2-f7c6-433c-8b53-551c86f4af77 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/1bc11f49-6376-4c45-b16f-b71dd58426e6 HTTP/1.1" status: 204 len: 168 time: 0.5426080 Nov 24 04:13:28.679296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33820) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:28.768722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.880811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.901858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.948669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:28.960622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=06f80541-be69-4f70-bdd8-8abde55230e5,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:28.970074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.007810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:29.010053 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.025509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:29.041244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Router b9bc3cb9-e4b1-42cc-adc2-b51898adab9a is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:29.043441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:29.044273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.082466 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:29.088073 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:29.090576 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:29.099571 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 6151318c-d145-44cf-b61c-6937d6cc0892 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:29.099949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.123704 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:29.220603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:29.221238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.229130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.242213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] For port 6151318c-d145-44cf-b61c-6937d6cc0892, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6151318c-d145-44cf-b61c-6937d6cc0892,segment=NetworkSegment(d514d37b-020f-4149-91a8-e0e9915d5624),segment_id=d514d37b-020f-4149-91a8-e0e9915d5624)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:29.242610 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.256127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Network eece608a-2941-4024-9a30-f80ac327dc91 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:29.256919 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-343fe161-1247-4055-8546-705133aa8c5a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1688032 Nov 24 04:13:29.261088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 6151318c-d145-44cf-b61c-6937d6cc0892 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:29.262422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:29.272715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Request body: {'port': {'device_id': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:29.277247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:29.354684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=11ee5027-ec2b-410e-b9f7-251f236c45f0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:29.383274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.385407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67aab00c-91f8-429f-8803-0ce9f7fa855e req-be0832df-1f85-4123-a471-35b1ec0e2450 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:29.387200 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-67aab00c-91f8-429f-8803-0ce9f7fa855e req-be0832df-1f85-4123-a471-35b1ec0e2450 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 932 time: 0.3815498 Nov 24 04:13:29.394095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:29.401557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.402788 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f709a0d3-8b4b-4106-9748-fc7cc4f1d4e8 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "PUT /v2.0/routers/b9bc3cb9-e4b1-42cc-adc2-b51898adab9a HTTP/1.1" status: 200 len: 920 time: 4.5337267 Nov 24 04:13:29.409663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33824) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:29.413533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] Sync routers for ids ['b9bc3cb9-e4b1-42cc-adc2-b51898adab9a'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:29.429162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] Routers {'b9bc3cb9-e4b1-42cc-adc2-b51898adab9a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:29.429784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b9bc3cb9-e4b1-42cc-adc2-b51898adab9a'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:29.466906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:29.467553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.484609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:29.492974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.496289 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': '587a7274-6993-44c0-8c83-37ad2d0e43df', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': 'b174064f-d0e5-4174-9b36-f84442e29aea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:29.497686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] Routers {'b9bc3cb9-e4b1-42cc-adc2-b51898adab9a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:29.498036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: b174064f-d0e5-4174-9b36-f84442e29aea, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:29.498611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b9bc3cb9-e4b1-42cc-adc2-b51898adab9a'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:29.534790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=6151318c-d145-44cf-b61c-6937d6cc0892,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:29.548355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event updated for resources: {'Port': ['ID=2792e925-c250-4107-927e-d83a07802192,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:29.560545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:29.565044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6834dee4-7f17-4b0c-8bac-687a886232e3 None None] The sync data for ids ['b9bc3cb9-e4b1-42cc-adc2-b51898adab9a'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:29.583136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5ebcb791-05e3-483f-aa5c-5e09bc756a74 None None] Provisioning complete for port c286a8f2-ac43-4387-b29d-abf0de1cbc16 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:29.583510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb791-05e3-483f-aa5c-5e09bc756a74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.601788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33826) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:29.616710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-470bad70-aaa6-425e-beed-7a35ac0a40d0 None None] Network 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:29.647608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5ebcb791-05e3-483f-aa5c-5e09bc756a74 None None] Port c286a8f2-ac43-4387-b29d-abf0de1cbc16 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:29.657417 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-67aab00c-91f8-429f-8803-0ce9f7fa855e req-2985a7b0-6e62-49c2-ab39-61c078b64149 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1990414 Nov 24 04:13:29.667731 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-58cba042-2977-4616-84e1-496ab71e22b2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.1625791 Nov 24 04:13:29.674108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33828) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:29.680673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-876999833', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:29.689909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No DVR routers for this DVR port 6151318c-d145-44cf-b61c-6937d6cc0892 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:29.724982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.727958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.733109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network b174064f-d0e5-4174-9b36-f84442e29aea is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:29.735447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a5f1c74b-6dee-4797-ad76-28272679b369 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:29.786540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9ffbab99-15d2-482f-b5b5-f7b20b593ef5 None None] Could not find standard attr ID for object 6151318c-d145-44cf-b61c-6937d6cc0892. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:13:29.817331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.819914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, b174064f-d0e5-4174-9b36-f84442e29aea) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:29.826496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.827392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a5f1c74b-6dee-4797-ad76-28272679b369 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:29.827821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.835399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:29.841521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:29.849917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:29.850812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.875292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33e47f8c-1283-4206-b914-ae28ed1eba35 None None] Network b174064f-d0e5-4174-9b36-f84442e29aea requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:29.877107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.881175 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-98ee35dc-dbb3-4a1b-838a-9828db0a2c48 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2022679 Nov 24 04:13:29.886787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4b42c3cb-0992-47e6-87ac-51db9aeeb9e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 3.5578392 Nov 24 04:13:29.887976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f58a0553-1635-446b-b34b-b041f0976525 None None] DHCP port deletion for 6b3d6af7-c10b-4c2f-a386-3d3a570cb193 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:29.888123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33830) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:29.888489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33832) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:29.892540 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1dc0d057-853d-46e3-8a5f-8c341047d27c tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/b9bc3cb9-e4b1-42cc-adc2-b51898adab9a HTTP/1.1" status: 200 len: 926 time: 0.4793882 Nov 24 04:13:29.893205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33834) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:29.913515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-85dabb48-1d25-404d-9f5c-b6f946a6f3fc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-298592242', 'prefixes': ['172.20.0.0/16']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:29.920090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:29.938883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0274b8d-a38a-4f46-9285-1e367c119273 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:29.940345 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e0274b8d-a38a-4f46-9285-1e367c119273 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 814 time: 0.2739916 Nov 24 04:13:29.991893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b3d6af7-c10b-4c2f-a386-3d3a570cb193']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:30.020389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd514d37b-020f-4149-91a8-e0e9915d5624') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:30.020536 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd514d37b-020f-4149-91a8-e0e9915d5624') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:30.048816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.065545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-261e9d53-a867-45c6-939e-22da79c10955 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:30.067702 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-261e9d53-a867-45c6-939e-22da79c10955 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=b9bc3cb9-e4b1-42cc-adc2-b51898adab9a&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1447198 Nov 24 04:13:30.071703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33838) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.093566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.116052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.122305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 11ee5027-ec2b-410e-b9f7-251f236c45f0 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:30.122654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.148794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-85dabb48-1d25-404d-9f5c-b6f946a6f3fc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for subnetpool, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.150028 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-85dabb48-1d25-404d-9f5c-b6f946a6f3fc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 747 time: 0.2603700 Nov 24 04:13:30.157104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port a5f1c74b-6dee-4797-ad76-28272679b369, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a5f1c74b-6dee-4797-ad76-28272679b369,segment=NetworkSegment(866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8),segment_id=866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:30.164592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.174627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33842) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.186474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-75434cae-4339-4567-828a-c6ce320f32d0 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-1552624524') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:30.227030 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a773a025-0ba9-4732-a31b-aa23ec16822f None None] Network eece608a-2941-4024-9a30-f80ac327dc91 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:30.233737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 185 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:30.234229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:30.238039 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:30.240325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c286a8f2-ac43-4387-b29d-abf0de1cbc16 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:13:30.240413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.251345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=a5f1c74b-6dee-4797-ad76-28272679b369,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:30.257836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.263752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 11ee5027-ec2b-410e-b9f7-251f236c45f0 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:30.271171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7e37969-61a6-4ce7-bd26-0bb2cc2f0675 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:30.275421 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d7e37969-61a6-4ce7-bd26-0bb2cc2f0675 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/networks/f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 881 time: 0.2003198 Nov 24 04:13:30.276014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33844) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.318576 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-60b10af8-23c0-47d2-bb91-e953d48bd27c tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=b9bc3cb9-e4b1-42cc-adc2-b51898adab9a HTTP/1.1" status: 200 len: 205 time: 0.0385833 Nov 24 04:13:30.324135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33846) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.358984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3d8a444d-ab5f-4a4a-8ec1-acd05d136448 None None] Provisioning complete for port a5f1c74b-6dee-4797-ad76-28272679b369 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:30.359455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3d8a444d-ab5f-4a4a-8ec1-acd05d136448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.380915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Transition to ACTIVE for port object c286a8f2-ac43-4387-b29d-abf0de1cbc16 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:13:30.384992 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.397334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.405689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.412863 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/6b3d6af7-c10b-4c2f-a386-3d3a570cb193 HTTP/1.1" status: 204 len: 168 time: 1.7284973 Nov 24 04:13:30.414206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33848) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.415284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.448997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.452638 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/11ee5027-ec2b-410e-b9f7-251f236c45f0 HTTP/1.1" status: 204 len: 168 time: 0.5612693 Nov 24 04:13:30.472368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e5573b-9d0b-4223-9b10-0c6ab611a1ad tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=11ee5027-ec2b-410e-b9f7-251f236c45f0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:30.475131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33850) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.502835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10354eb5-d9dd-41b6-bf1f-8a0bb32d9d09 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=6b3d6af7-c10b-4c2f-a386-3d3a570cb193,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:30.529882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e3739e3-e71c-4bf3-ab5c-a9b98f971e1b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:30.531496 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4e3739e3-e71c-4bf3-ab5c-a9b98f971e1b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.1172822 Nov 24 04:13:30.535550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33852) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.558713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b6fddb9-8bdc-424e-9cb4-fc8586bb3951 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:30.564708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b6fddb9-8bdc-424e-9cb4-fc8586bb3951 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:30.569274 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3b6fddb9-8bdc-424e-9cb4-fc8586bb3951 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1451 time: 0.0906513 Nov 24 04:13:30.582988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33854) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.669477 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0cfe1cf3-6e92-4739-93e3-78c7f4a1208a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1327853 Nov 24 04:13:30.673832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33856) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.681932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1228271058'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:30.723446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:30.727754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.765769 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 06f80541-be69-4f70-bdd8-8abde55230e5 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:30.766224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.774092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 198, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:30.808884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.809187 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment 9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1 of type vlan for network 94776e82-fcf4-4983-adeb-870633eba4b7 Nov 24 04:13:30.879283 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.880719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33860) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:30.895248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--1947075321', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:30.913722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.916027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 06f80541-be69-4f70-bdd8-8abde55230e5 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:30.970650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6e7e0447-fdb1-4033-8000-8cfe505ff825 None None] Provisioning complete for port a5f1c74b-6dee-4797-ad76-28272679b369 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:30.971225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e7e0447-fdb1-4033-8000-8cfe505ff825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:30.992983 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:30.996823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.015168 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.023134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.023958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.073121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:31.093501 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6e7e0447-fdb1-4033-8000-8cfe505ff825 None None] Provisioning complete for port 2792e925-c250-4107-927e-d83a07802192 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:31.094095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6e7e0447-fdb1-4033-8000-8cfe505ff825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.112815 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-75434cae-4339-4567-828a-c6ce320f32d0 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-1552624524 HTTP/1.1" status: 201 len: 201 time: 0.9346864 Nov 24 04:13:31.118394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33862) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.132365 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.4561479 Nov 24 04:13:31.132737 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6e7e0447-fdb1-4033-8000-8cfe505ff825 None None] Port 2792e925-c250-4107-927e-d83a07802192 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:31.135384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-2afcb091-93e1-43fd-ac6f-214f4adcde0c tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-1590183674') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:31.138253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33864) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.139001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d72e6d-de89-4566-a810-22ea87a6b28b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=94776e82-fcf4-4983-adeb-870633eba4b7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:31.144254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 157, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:31.151767 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:31.153646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 94776e82-fcf4-4983-adeb-870633eba4b7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:31.167554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Attempting to bind port c286a8f2-ac43-4387-b29d-abf0de1cbc16 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:31.167554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Attempting to bind port c286a8f2-ac43-4387-b29d-abf0de1cbc16 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:31.167917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Attempting to bind port c286a8f2-ac43-4387-b29d-abf0de1cbc16 on network 5056a387-4f26-43bd-ad60-c8135c9a7757 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:31.176597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.185663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.185923 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment d92fbff6-b634-454f-b4b7-5f45f8744fac of type vlan for network 61fb4de4-ff65-42d0-aed9-c58e7caab600 Nov 24 04:13:31.235381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Port c286a8f2-ac43-4387-b29d-abf0de1cbc16 on network 5056a387-4f26-43bd-ad60-c8135c9a7757 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:13:31.235709 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Attempting to bind port c286a8f2-ac43-4387-b29d-abf0de1cbc16 on network 5056a387-4f26-43bd-ad60-c8135c9a7757 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:31.267553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a5c9ac9f-f146-4838-b19d-a465cad95c30 None None] Provisioning complete for port 2792e925-c250-4107-927e-d83a07802192 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:31.267933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a5c9ac9f-f146-4838-b19d-a465cad95c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.273237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.282257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.286169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e1abfe-9f01-4c98-9da3-a099942b1716 req-ca67c4ee-8330-47f0-8749-3d3f193a91f7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.288465 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-05e1abfe-9f01-4c98-9da3-a099942b1716 req-ca67c4ee-8330-47f0-8749-3d3f193a91f7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 944 time: 0.2900233 Nov 24 04:13:31.288465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:31.288872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Checking segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:31.289157 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Bound using segment: {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:31.289601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Bound port: c286a8f2-ac43-4387-b29d-abf0de1cbc16, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:31.289964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.308166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a5c9ac9f-f146-4838-b19d-a465cad95c30 None None] Port 2792e925-c250-4107-927e-d83a07802192 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:31.326028 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=06f80541-be69-4f70-bdd8-8abde55230e5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:31.348352 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.351526 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8b15663e-6197-4c01-982c-511dacd0e28a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/06f80541-be69-4f70-bdd8-8abde55230e5 HTTP/1.1" status: 204 len: 168 time: 0.7666669 Nov 24 04:13:31.356599 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33866) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.391790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:31.395900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.398948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.404251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.404819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.408232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.444858 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2afcb091-93e1-43fd-ac6f-214f4adcde0c tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-1590183674 HTTP/1.1" status: 201 len: 201 time: 0.3205004 Nov 24 04:13:31.452165 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-05e1abfe-9f01-4c98-9da3-a099942b1716 req-73949ccd-f6fd-4cfd-8320-43eead575e5d tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1353731 Nov 24 04:13:31.457834 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33868) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.476752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-d8ec0f00-8ad3-4c33-a52e-c09da9358844 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-1520106574') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:31.484503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:31.486949 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6024168 Nov 24 04:13:31.494809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33870) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.508372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:31.537772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.586027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a5f1c74b-6dee-4797-ad76-28272679b369 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:31.598230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a7c2a2f-ab82-4d78-a6ac-7046bdbcbb3c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.599727 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a7c2a2f-ab82-4d78-a6ac-7046bdbcbb3c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.2411304 Nov 24 04:13:31.600472 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0600c163-d4d0-44a5-80ec-a0c48ef853f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=61fb4de4-ff65-42d0-aed9-c58e7caab600,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:31.602428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33872) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.626131 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.626773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.628731 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] 10.222.0.21 "PUT /v2.0/ports/c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 1094 time: 2.3620741 Nov 24 04:13:31.629858 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:31.634739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:13:31.637330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f09ab760-3a70-4249-a717-cccf21b313be" -d '{"events": [{"name": "network-changed", "server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:13:31.665823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-140892fc-ff25-4c96-8bc9-d21bb3b7b245 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.670967 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-140892fc-ff25-4c96-8bc9-d21bb3b7b245 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 829 time: 0.1744568 Nov 24 04:13:31.679488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33876) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.692432 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-cadb2e70-e084-4ba2-8a4d-bb6d3a717921 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:13:31.693896 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cadb2e70-e084-4ba2-8a4d-bb6d3a717921 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/11ee5027-ec2b-410e-b9f7-251f236c45f0 HTTP/1.1" status: 404 len: 333 time: 0.0466440 Nov 24 04:13:31.698179 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:13:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fea5271a-bbfa-43bc-99b5-464bfbb5aa18 x-openstack-request-id: req-fea5271a-bbfa-43bc-99b5-464bfbb5aa18 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:13:31.698488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:13:31.699067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-fea5271a-bbfa-43bc-99b5-464bfbb5aa18 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:13:31.699388 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'status': 'completed', 'code': 200} Nov 24 04:13:31.703409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33878) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.725667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Deleting port 21ad8624-6bce-4a98-b537-0fe37fa99d09 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:31.726015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.756618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a5f1c74b-6dee-4797-ad76-28272679b369 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:31.757023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.784320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a4734e-4db0-45b4-b6b3-453cf0f49ef5 service neutron] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:31.786755 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d8ec0f00-8ad3-4c33-a52e-c09da9358844 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-1520106574 HTTP/1.1" status: 201 len: 201 time: 0.3206105 Nov 24 04:13:31.789862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33880) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.796853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-f7c1f226-8277-4e42-91a4-3d5f270ae31a tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-1506848573') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:31.806916 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb78d038-bc9a-4c60-af1d-092ff47dea1a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:13:31.808730 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fb78d038-bc9a-4c60-af1d-092ff47dea1a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/06f80541-be69-4f70-bdd8-8abde55230e5 HTTP/1.1" status: 404 len: 333 time: 0.1044402 Nov 24 04:13:31.816710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33882) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:31.940895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6151318c-d145-44cf-b61c-6937d6cc0892 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:31.941128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.947403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-4ae7de2a-0a6e-498e-a1ff-8b8c64a4a33d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:31.949163 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-4ae7de2a-0a6e-498e-a1ff-8b8c64a4a33d service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1097 time: 0.2473810 Nov 24 04:13:31.960221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.969750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:31.976414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6151318c-d145-44cf-b61c-6937d6cc0892 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:31.976965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6151318c-d145-44cf-b61c-6937d6cc0892 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:32.002141 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f7c1f226-8277-4e42-91a4-3d5f270ae31a tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-1506848573 HTTP/1.1" status: 201 len: 201 time: 0.2111213 Nov 24 04:13:32.008122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Calling delete_port for 21ad8624-6bce-4a98-b537-0fe37fa99d09 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:32.012339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33884) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.016506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-6af91c73-d871-4ce4-8ebb-b14faa59fe03 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:32.022324 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-93deadf3-1f17-40cb-b7c2-0b3dbed84596 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 217 time: 0.0631738 Nov 24 04:13:32.033457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-380aba9a-64d2-498c-b43c-e649f2c7e68b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.037726 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-380aba9a-64d2-498c-b43c-e649f2c7e68b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3536539 Nov 24 04:13:32.038337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33886) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.081416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=c035091e-dcad-4011-ac6e-b6ef0769fb13,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:32.132378 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dab1b5d4-f937-4cc9-a933-aa8d343dff5f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0819237 Nov 24 04:13:32.134780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33888) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.144691 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:32.145061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: 94776e82-fcf4-4983-adeb-870633eba4b7, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:32.180583 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f6e211fd-7897-4189-a12b-51dbcaf6d059 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0410631 Nov 24 04:13:32.183431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33890) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.196410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-9b387bbf-6991-4bb0-9ae3-34c165b6cccc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.197884 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-9b387bbf-6991-4bb0-9ae3-34c165b6cccc service neutron] 10.222.0.21 "GET /v2.0/subnets?id=33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 200 len: 834 time: 0.1665754 Nov 24 04:13:32.199400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.232373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 94776e82-fcf4-4983-adeb-870633eba4b7 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:32.245211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b174064f-d0e5-4174-9b36-f84442e29aea']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:32.249625 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6af91c73-d871-4ce4-8ebb-b14faa59fe03 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags HTTP/1.1" status: 200 len: 241 time: 0.2364647 Nov 24 04:13:32.255395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33892) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.259789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-5ac5d7a3-036b-400b-9f5f-5842190a0d5c tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-1552624524') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:32.264114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 94776e82-fcf4-4983-adeb-870633eba4b7) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:32.267669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '587a7274-6993-44c0-8c83-37ad2d0e43df') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:32.267972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '587a7274-6993-44c0-8c83-37ad2d0e43df') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:32.274094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-666b5c20-0e87-4714-9972-c0e973fe6726 None None] Network 94776e82-fcf4-4983-adeb-870633eba4b7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:32.295499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.296100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.300538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.320978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.329699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 168 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:32.330001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:32.333147 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:32.354729 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2f24efc4-27b7-4b4f-a019-6639420167c7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2122133 Nov 24 04:13:32.356878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33894) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.361960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-49f356a1-7086-4c2b-b78b-8657c37c02e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.364315 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-49f356a1-7086-4c2b-b78b-8657c37c02e7 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=5056a387-4f26-43bd-ad60-c8135c9a7757&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1533229 Nov 24 04:13:32.385162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7', 'name': 'tempest-PortsIpV6TestJSON-1435170687'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:32.412955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.415823 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5ac5d7a3-036b-400b-9f5f-5842190a0d5c tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-1552624524 HTTP/1.1" status: 204 len: 168 time: 0.1591868 Nov 24 04:13:32.419285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33896) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.421369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.424479 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/b174064f-d0e5-4174-9b36-f84442e29aea HTTP/1.1" status: 204 len: 168 time: 0.6029527 Nov 24 04:13:32.428948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33898) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.441838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-b77a44bc-81af-424d-b33b-192e330aee7f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-1552624524') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:32.442635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-2103967906'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:32.447043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae3a12b-cd8d-4fb7-8f70-2ddd6f3de22e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=b174064f-d0e5-4174-9b36-f84442e29aea,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:32.460553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dc0baf7-2aea-4e8d-89c5-b03c80453d6b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.462843 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8dc0baf7-2aea-4e8d-89c5-b03c80453d6b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2782564 Nov 24 04:13:32.465113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33900) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.467905 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-94776e82-fcf4-4983-adeb-870633eba4b7', 'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': 'c035091e-dcad-4011-ac6e-b6ef0769fb13'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:32.468896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.485954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:32.491470 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.524223 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0e29d5c-adab-4245-9b84-56cb570e0c52 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0577269 Nov 24 04:13:32.526626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33904) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.531502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1105063797', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:32.572391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 190, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:32.622008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.627886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.629674 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment 5785dfca-7a65-423b-8661-6b45c167d29a of type vlan for network d7a0f84f-e834-4089-b23f-3e27ba00872e Nov 24 04:13:32.653118 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Allocated IP 2001:db8::2 (94776e82-fcf4-4983-adeb-870633eba4b7/c035091e-dcad-4011-ac6e-b6ef0769fb13/a6193dc7-4517-494d-91e5-ebf6cb86d61e) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:32.683207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event deleted for resources: {'Port': ['ID=21ad8624-6bce-4a98-b537-0fe37fa99d09,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:32.683708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.695378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:32.697787 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.713556 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-55a51b32-5c70-48ff-b23d-f45f2c108fed service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3221838 Nov 24 04:13:32.732664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e3cb424-bfaf-4865-80d1-8b78c10a05b0 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:32.739127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.745261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.745880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.826014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.826813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:32.830402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.833245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.855362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86566bcc-9ab8-42cf-b63a-175a19d33e78 req-58d0bd3e-611d-46ef-a43e-cc6a2f2459cd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:32.869915 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-86566bcc-9ab8-42cf-b63a-175a19d33e78 req-58d0bd3e-611d-46ef-a43e-cc6a2f2459cd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 944 time: 0.3090932 Nov 24 04:13:32.880211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Network 94776e82-fcf4-4983-adeb-870633eba4b7 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:32.883292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:32.888447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:32.897666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Pushing event updated for resources: {'Port': ['ID=a6193dc7-4517-494d-91e5-ebf6cb86d61e,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:32.969601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 9219a34d-ba81-4210-9ee1-03d607ea9aa5 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:32.979365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Attempting to bind port a6193dc7-4517-494d-91e5-ebf6cb86d61e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:32.979926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Attempting to bind port a6193dc7-4517-494d-91e5-ebf6cb86d61e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:32.980085 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b77a44bc-81af-424d-b33b-192e330aee7f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-1552624524 HTTP/1.1" status: 204 len: 168 time: 0.5519185 Nov 24 04:13:32.980190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Attempting to bind port a6193dc7-4517-494d-91e5-ebf6cb86d61e on network 94776e82-fcf4-4983-adeb-870633eba4b7 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:32.982243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.985599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:32.985980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Checking segment: {'id': '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:32.986777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33906) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:32.989053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:32.989204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Bound using segment: {'id': '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:32.989690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Bound port: a6193dc7-4517-494d-91e5-ebf6cb86d61e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:32.990258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.001340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-a3d20e9a-7177-4e6f-ab8f-12245921f5b7 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:33.061815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] For port a6193dc7-4517-494d-91e5-ebf6cb86d61e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:33.065095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] For port a6193dc7-4517-494d-91e5-ebf6cb86d61e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a6193dc7-4517-494d-91e5-ebf6cb86d61e,segment=NetworkSegment(9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1),segment_id=9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:33.072075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.131727 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7016871 Nov 24 04:13:33.141216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08749b7-aed3-45b0-9a92-1c020cb527fb None None] Pushing event updated for resources: {'Port': ['ID=a6193dc7-4517-494d-91e5-ebf6cb86d61e,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:33.159564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33908) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:33.164468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:33.170579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1855361f-bb91-4e4d-9a2b-30ac61000d01 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=d7a0f84f-e834-4089-b23f-3e27ba00872e,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:33.185869 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network d7a0f84f-e834-4089-b23f-3e27ba00872e details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:33.191633 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-86566bcc-9ab8-42cf-b63a-175a19d33e78 req-5fe909e4-181d-41ab-aee7-a2400f98e15f tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3167715 Nov 24 04:13:33.204198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.207380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.221419 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-241d05a1-6bd1-4ac4-9280-1e4886f7a238 req-7f42c8c5-3109-473c-854f-1e3c402e7863 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4823372 Nov 24 04:13:33.348737 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:33.353869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.374006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.374611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Fanout notify agent at l3_agent the message router_deleted on router b9bc3cb9-e4b1-42cc-adc2-b51898adab9a {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:33.382249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.388815 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33910) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:33.388916 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-16826f9e-5cf6-4dbb-bca8-55114acbf429 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/b9bc3cb9-e4b1-42cc-adc2-b51898adab9a HTTP/1.1" status: 204 len: 168 time: 3.0596893 Nov 24 04:13:33.400061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-230174471', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:33.416382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.416813 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3d20e9a-7177-4e6f-ab8f-12245921f5b7 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags HTTP/1.1" status: 200 len: 205 time: 0.4275391 Nov 24 04:13:33.421315 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33912) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:33.428682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-f3b4af4d-6f37-436b-a043-55b2e443d639 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:33.474124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::15b (94776e82-fcf4-4983-adeb-870633eba4b7/c035091e-dcad-4011-ac6e-b6ef0769fb13/9219a34d-ba81-4210-9ee1-03d607ea9aa5) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:33.477814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09ab760-3a70-4249-a717-cccf21b313be req-4b4db198-24f4-4998-9c20-cb169aff293b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:33.479380 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-4b4db198-24f4-4998-9c20-cb169aff293b service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1097 time: 0.1882522 Nov 24 04:13:33.483758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Performing IP validity checks on allocation pools {{(pid=103380) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 24 04:13:33.484190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.ipam_backend_mixin [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103380) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 24 04:13:33.516534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.517551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.548833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=b58537d8-e9f8-43e0-92cb-52a12f3fe9d6,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:33.653611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:33.653611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: 61fb4de4-ff65-42d0-aed9-c58e7caab600, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:33.656451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.669065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a6193dc7-4517-494d-91e5-ebf6cb86d61e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:33.722683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a6193dc7-4517-494d-91e5-ebf6cb86d61e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:33.723144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.787346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:33.798939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.825733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.835847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 61fb4de4-ff65-42d0-aed9-c58e7caab600) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:33.849286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f749bc8-93d6-42d1-ba0e-3b7a5f4f80d7 None None] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:33.872520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:33.873118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.888039 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port a6193dc7-4517-494d-91e5-ebf6cb86d61e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a6193dc7-4517-494d-91e5-ebf6cb86d61e,segment=NetworkSegment(9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1),segment_id=9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:33.903587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.914885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:33.942779 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e6f71789-4aed-432d-ab34-1ba31de90cd0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.4151387 Nov 24 04:13:33.952943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=24f23be1-76a8-4e35-9977-5261ffd9a7ce,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:33.975675 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f3b4af4d-6f37-436b-a043-55b2e443d639 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags HTTP/1.1" status: 200 len: 241 time: 0.5498657 Nov 24 04:13:33.980282 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33916) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:33.998814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-6dfc67c1-eb57-40c9-9f2c-07d19ef6041c tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-1590183674') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:34.037912 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': '5785dfca-7a65-423b-8661-6b45c167d29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:34.038636 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: d7a0f84f-e834-4089-b23f-3e27ba00872e, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:34.040575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09ab760-3a70-4249-a717-cccf21b313be req-0c232ca4-398d-45bf-bd71-72466aee129e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:34.042071 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-0c232ca4-398d-45bf-bd71-72466aee129e service neutron] 10.222.0.21 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 898 time: 0.5523868 Nov 24 04:13:34.068209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=a6193dc7-4517-494d-91e5-ebf6cb86d61e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:34.130740 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network d7a0f84f-e834-4089-b23f-3e27ba00872e is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:34.143263 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-65cd6f1b-e4f3-4087-a897-2be531a56287 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 217 time: 0.0620298 Nov 24 04:13:34.164349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-61fb4de4-ff65-42d0-aed9-c58e7caab600', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:34.167869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, d7a0f84f-e834-4089-b23f-3e27ba00872e) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:34.168756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.183912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1daf9e89-52e5-4a7c-a762-cc5092cc262c None None] Network d7a0f84f-e834-4089-b23f-3e27ba00872e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:34.185467 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6dfc67c1-eb57-40c9-9f2c-07d19ef6041c tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-1590183674 HTTP/1.1" status: 204 len: 168 time: 0.1966445 Nov 24 04:13:34.187017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:34.187699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.193996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33918) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:34.200913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-67795fa2-14f1-4e69-8cfb-b4a15187b25a tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-1590183674') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:34.271114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.297861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09ab760-3a70-4249-a717-cccf21b313be req-e9a740e3-d4e7-418e-b623-93dcc8a95c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:34.299392 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-e9a740e3-d4e7-418e-b623-93dcc8a95c14 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 200 len: 834 time: 0.1480818 Nov 24 04:13:34.328857 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7f0e84e4-3f14-4a26-a0ea-2e6185227d62 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1682513 Nov 24 04:13:34.332429 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33922) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:34.355425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e', 'name': 'tempest-PortsTestJSON-1745538160'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:34.379145 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33924) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:34.386179 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-310062344', 'description': 'tempest-secgroup-smoke-310062344 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:34.457413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.479403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Allocated IP 172.20.0.18 (61fb4de4-ff65-42d0-aed9-c58e7caab600/b58537d8-e9f8-43e0-92cb-52a12f3fe9d6/79f9a8dc-23c7-4067-be18-299b610d4334) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:34.532850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-d7a0f84f-e834-4089-b23f-3e27ba00872e', 'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': '24f23be1-76a8-4e35-9977-5261ffd9a7ce'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:34.533732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.544356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f43173c1-d28f-4d4c-8403-9c92e482b820 None None] Network 94776e82-fcf4-4983-adeb-870633eba4b7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:34.553269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ffe3f67-3154-4f5c-8165-9c476caf191a req-3bd35960-ecdf-4c86-a633-1b70dae0a502 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:34.555437 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9ffe3f67-3154-4f5c-8165-9c476caf191a req-3bd35960-ecdf-4c86-a633-1b70dae0a502 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 944 time: 0.2275324 Nov 24 04:13:34.564800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09ab760-3a70-4249-a717-cccf21b313be req-9c015f4b-c65f-4b97-a39e-82f0918da7b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:34.567335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-9c015f4b-c65f-4b97-a39e-82f0918da7b4 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=5056a387-4f26-43bd-ad60-c8135c9a7757&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2566826 Nov 24 04:13:34.575334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.590121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.605580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 94776e82-fcf4-4983-adeb-870633eba4b7 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:34.611948 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-67795fa2-14f1-4e69-8cfb-b4a15187b25a tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-1590183674 HTTP/1.1" status: 204 len: 168 time: 0.4153810 Nov 24 04:13:34.615952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33926) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:34.619703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-7f7d5f86-6499-4498-8aab-421be650c714 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:34.624205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.641839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:34.645090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:34.651233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:34.651842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.664077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=9219a34d-ba81-4210-9ee1-03d607ea9aa5,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:34.693799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:34.697752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.745519 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-09d88633-d032-48af-a6f3-153ffd559fbe tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.3831542 Nov 24 04:13:34.745735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 2cf13928-5e4c-4acf-a3c7-6990e743b102 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:34.751344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33928) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:34.764651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '94776e82-fcf4-4983-adeb-870633eba4b7', 'name': 'tempest-PortsIpV6TestJSON-1361181293'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:34.792124 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9ffe3f67-3154-4f5c-8165-9c476caf191a req-333158c6-d9f9-42a6-9d4c-65de2b7af41c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2206454 Nov 24 04:13:34.868061 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7f7d5f86-6499-4498-8aab-421be650c714 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags HTTP/1.1" status: 200 len: 205 time: 0.2516057 Nov 24 04:13:34.869259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Allocated IP 172.26.5.60 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/b80b3d0b-c657-44ae-b471-c93210f156ac) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:34.874611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33930) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:34.884730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-bd534a90-229b-492f-b608-04880cba8196 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:34.889640 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-78f7e926-fa8d-4b33-8572-d0c0a7f7a0ae service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3025658 Nov 24 04:13:34.908717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d60b2542-c39f-4a10-8f72-ef5059f47850 None None] Provisioning complete for port a6193dc7-4517-494d-91e5-ebf6cb86d61e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:34.909095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d60b2542-c39f-4a10-8f72-ef5059f47850 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:34.951962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.3 (d7a0f84f-e834-4089-b23f-3e27ba00872e/24f23be1-76a8-4e35-9977-5261ffd9a7ce/2cf13928-5e4c-4acf-a3c7-6990e743b102) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:35.017692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.034915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-498f753b-6ec0-4635-bd48-e50120c0774e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.050188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.059958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.061790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.091856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.134230 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bd534a90-229b-492f-b608-04880cba8196 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags HTTP/1.1" status: 200 len: 241 time: 0.2565479 Nov 24 04:13:35.136400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33932) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.140235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.141428 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.7602546 Nov 24 04:13:35.149944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-e9428e9b-ec6c-4a97-89c9-a49726e89a73 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-1520106574') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:35.151483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33934) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.160817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '85d13e9f-8f86-478e-a7fe-77e3092afe4b', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:35.169167 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:35.170618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b08576-e41a-46ca-a481-b8b40b9e18c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=85d13e9f-8f86-478e-a7fe-77e3092afe4b,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:35.179014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:35.182378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Pushing event updated for resources: {'Port': ['ID=79f9a8dc-23c7-4067-be18-299b610d4334,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:35.183650 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09ab760-3a70-4249-a717-cccf21b313be req-2b190e0d-5948-438e-a7c2-04083f8c7835 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2398393 Nov 24 04:13:35.185356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:35.202838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:35.211348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.240646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 051df91e-8c7f-4786-a440-47b4ab3b519e yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:35.254558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.260910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Attempting to bind port 79f9a8dc-23c7-4067-be18-299b610d4334 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:35.261344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Attempting to bind port 79f9a8dc-23c7-4067-be18-299b610d4334 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:35.261722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Attempting to bind port 79f9a8dc-23c7-4067-be18-299b610d4334 on network 61fb4de4-ff65-42d0-aed9-c58e7caab600 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:35.267437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:35.268097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Checking segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:35.269079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.269508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Bound using segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:35.269958 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Bound port: 79f9a8dc-23c7-4067-be18-299b610d4334, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:35.270548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.281050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.332564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.343047 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e9428e9b-ec6c-4a97-89c9-a49726e89a73 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-1520106574 HTTP/1.1" status: 204 len: 168 time: 0.2054791 Nov 24 04:13:35.345998 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33936) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.353065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:35.353668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] For port 79f9a8dc-23c7-4067-be18-299b610d4334, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:35.359447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] For port 79f9a8dc-23c7-4067-be18-299b610d4334, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=79f9a8dc-23c7-4067-be18-299b610d4334,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:35.360293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:35.363096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event updated for resources: {'Port': ['ID=b80b3d0b-c657-44ae-b471-c93210f156ac,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:35.366939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:35.367293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.389195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-993ab271-a1fa-4424-ac5e-2de27c57a87b tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-1520106574') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:35.400456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddd6ed78-b0e3-4b75-a548-f312f8eece55 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:35.477622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.478416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.486956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Allocated IP 172.20.0.2 (d7a0f84f-e834-4089-b23f-3e27ba00872e/24f23be1-76a8-4e35-9977-5261ffd9a7ce/b61f7b77-282f-40f8-9eb0-4d564b594c50) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:35.532707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.567181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df175f51-bb0f-45ca-aff1-3f03e57643a6 None None] Pushing event updated for resources: {'Port': ['ID=79f9a8dc-23c7-4067-be18-299b610d4334,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:35.610183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=30da7a56-2c3d-42f2-8e9c-436523ecc7ba,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:35.610527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::26f (94776e82-fcf4-4983-adeb-870633eba4b7/c035091e-dcad-4011-ac6e-b6ef0769fb13/051df91e-8c7f-4786-a440-47b4ab3b519e) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:35.617997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network d7a0f84f-e834-4089-b23f-3e27ba00872e is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:35.623090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.624385 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-49d4e3f1-f20b-4b19-8c8e-0f516586c162 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4719334 Nov 24 04:13:35.641851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eb0e4417-5789-44af-8d46-e582090271f3 None None] Provisioning complete for port b80b3d0b-c657-44ae-b471-c93210f156ac triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:35.642467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb0e4417-5789-44af-8d46-e582090271f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.644101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33938) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.650548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:35.654460 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:35.654643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '85d13e9f-8f86-478e-a7fe-77e3092afe4b', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:35.656930 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=2cf13928-5e4c-4acf-a3c7-6990e743b102,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:35.708020 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a6193dc7-4517-494d-91e5-ebf6cb86d61e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:35.711183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.730531 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-993ab271-a1fa-4424-ac5e-2de27c57a87b tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-1520106574 HTTP/1.1" status: 204 len: 168 time: 0.3762591 Nov 24 04:13:35.733003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33940) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.745330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-0c9bb65d-906a-44f3-9859-7a1bed708cea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:35.779707 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c286a8f2-ac43-4387-b29d-abf0de1cbc16 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:13:35.861742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:35.867111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.871472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eb0e4417-5789-44af-8d46-e582090271f3 None None] Port b80b3d0b-c657-44ae-b471-c93210f156ac cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:35.906545 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-34695b6d-567e-48fa-a6e6-2490f631c41f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.5647097 Nov 24 04:13:35.908943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33944) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.969234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:35.976637 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0c9bb65d-906a-44f3-9859-7a1bed708cea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags HTTP/1.1" status: 200 len: 205 time: 0.2326567 Nov 24 04:13:35.980065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33948) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:35.984917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-88caabda-b8ee-462f-93cd-9d7be0936cf5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:35.993051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.resource_extend [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 04:13:35.997195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.031019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.054961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a6193dc7-4517-494d-91e5-ebf6cb86d61e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:36.055333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.078044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ae7366d9-5597-4380-a9f9-e05512fe6b33,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:36.092474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.093802 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ce6e1717-83cc-4a7a-98c4-5273640694c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4478369 Nov 24 04:13:36.107735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33950) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.109862 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-88caabda-b8ee-462f-93cd-9d7be0936cf5 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags HTTP/1.1" status: 200 len: 241 time: 0.1285696 Nov 24 04:13:36.119069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '85d13e9f-8f86-478e-a7fe-77e3092afe4b', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:36.123089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33952) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.128856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-69d5cedc-7ee4-4a81-a760-a02a01d9ecea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-1506848573') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:36.164587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.197582 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-69d5cedc-7ee4-4a81-a760-a02a01d9ecea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-1506848573 HTTP/1.1" status: 204 len: 168 time: 0.0732868 Nov 24 04:13:36.208914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33954) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.209666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.216580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-42d1a7ce-7388-4c57-9518-23013b40cac9 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-1506848573') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:36.247522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-64c50857-c626-4ad4-a22d-e2f5885faa27 None None] Provisioning complete for port a6193dc7-4517-494d-91e5-ebf6cb86d61e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:36.248161 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64c50857-c626-4ad4-a22d-e2f5885faa27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.279360 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.292041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.311774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.380412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.384579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 94776e82-fcf4-4983-adeb-870633eba4b7 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:36.390572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:36.396115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.398105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:36.404428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:36.404705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.406285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:36.416631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Network d7a0f84f-e834-4089-b23f-3e27ba00872e is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:36.427389 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-42d1a7ce-7388-4c57-9518-23013b40cac9 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-1506848573 HTTP/1.1" status: 204 len: 168 time: 0.2145834 Nov 24 04:13:36.431460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=051df91e-8c7f-4786-a440-47b4ab3b519e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:36.437019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:36.441248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33956) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.442623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de86b1ab-a89a-407e-8c12-0ac1d814541d,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:36.445777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Pushing event updated for resources: {'Port': ['ID=b61f7b77-282f-40f8-9eb0-4d564b594c50,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:36.449370 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:36.457230 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2e63f1a9-beab-4a0a-8359-635c766b6fa4 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.7007802 Nov 24 04:13:36.458791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'port_id': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'mac_address': 'fa:16:3e:cc:4a:1d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 191, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:13:36.465872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-ab31ef63-d90e-4292-9a1b-efe6ebab0561 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:36.488965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33958) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.571275 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ab31ef63-d90e-4292-9a1b-efe6ebab0561 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags HTTP/1.1" status: 200 len: 205 time: 0.1098111 Nov 24 04:13:36.577009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.579020 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a01204d3-0ca1-4319-8ea8-f63f529eb4a3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4678881 Nov 24 04:13:36.580613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33960) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.597325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33962) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.598879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Attempting to bind port b61f7b77-282f-40f8-9eb0-4d564b594c50 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:36.599560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Attempting to bind port b61f7b77-282f-40f8-9eb0-4d564b594c50 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '5785dfca-7a65-423b-8661-6b45c167d29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:36.600004 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Attempting to bind port b61f7b77-282f-40f8-9eb0-4d564b594c50 on network d7a0f84f-e834-4089-b23f-3e27ba00872e {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:36.608235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-7e483fad-f56e-4a5e-8e8c-a47bc92134c1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:36.613517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:36.614054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Checking segment: {'id': '5785dfca-7a65-423b-8661-6b45c167d29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:36.614594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.615158 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Bound using segment: {'id': '5785dfca-7a65-423b-8661-6b45c167d29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:36.615750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Bound port: b61f7b77-282f-40f8-9eb0-4d564b594c50, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5785dfca-7a65-423b-8661-6b45c167d29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': 'd7a0f84f-e834-4089-b23f-3e27ba00872e'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:36.616493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.619763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.647741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-64c50857-c626-4ad4-a22d-e2f5885faa27 None None] Provisioning complete for port 9219a34d-ba81-4210-9ee1-03d607ea9aa5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:36.648244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64c50857-c626-4ad4-a22d-e2f5885faa27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.653725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c286a8f2-ac43-4387-b29d-abf0de1cbc16 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:13:36.655961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '85d13e9f-8f86-478e-a7fe-77e3092afe4b', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:36.703479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b4c0219-3858-46c0-864a-2096b0721832 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:36.707743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8b4c0219-3858-46c0-864a-2096b0721832 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A15b HTTP/1.1" status: 200 len: 929 time: 0.2084174 Nov 24 04:13:36.707931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-64c50857-c626-4ad4-a22d-e2f5885faa27 None None] Port 9219a34d-ba81-4210-9ee1-03d607ea9aa5 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:36.711590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33964) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.784688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-474e3a13-2f82-40c9-87e0-74d7e46583ce req-54521f8e-46e3-4102-a8bc-95e4b0352453 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:36.787086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] For port b61f7b77-282f-40f8-9eb0-4d564b594c50, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:36.791503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] For port b61f7b77-282f-40f8-9eb0-4d564b594c50, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b61f7b77-282f-40f8-9eb0-4d564b594c50,segment=NetworkSegment(5785dfca-7a65-423b-8661-6b45c167d29a),segment_id=5785dfca-7a65-423b-8661-6b45c167d29a)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:36.791882 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-474e3a13-2f82-40c9-87e0-74d7e46583ce req-54521f8e-46e3-4102-a8bc-95e4b0352453 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 944 time: 0.8646235 Nov 24 04:13:36.796744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 2cf13928-5e4c-4acf-a3c7-6990e743b102 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:36.797387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.801653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.806972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.832110 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7e483fad-f56e-4a5e-8e8c-a47bc92134c1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags HTTP/1.1" status: 204 len: 168 time: 0.2377331 Nov 24 04:13:36.838915 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33966) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:36.852656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-8e25a8ea-74ac-4e79-b61c-b6148e5fbd2f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:36.861122 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.929000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 051df91e-8c7f-4786-a440-47b4ab3b519e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:36.929346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.930460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:36.933238 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd55e89f-6fab-407b-b8f9-dcfb98dd6b94 None None] Pushing event updated for resources: {'Port': ['ID=b61f7b77-282f-40f8-9eb0-4d564b594c50,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:36.942658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.953225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.962291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f1cdf1e1-da98-4f50-a91d-3c03c18f6cd7 None None] Provisioning complete for port 9219a34d-ba81-4210-9ee1-03d607ea9aa5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:36.962291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f1cdf1e1-da98-4f50-a91d-3c03c18f6cd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:36.968695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.013774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1764b2e5-0d96-40d4-bc60-162cb4198d28,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:37.055282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f1cdf1e1-da98-4f50-a91d-3c03c18f6cd7 None None] Port 9219a34d-ba81-4210-9ee1-03d607ea9aa5 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:37.077540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:37.081860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.084005 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-49af50c0-4dc3-4044-a0b3-b253efa32ae1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4367342 Nov 24 04:13:37.087061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33968) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.093175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '85d13e9f-8f86-478e-a7fe-77e3092afe4b', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:37.094343 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-474e3a13-2f82-40c9-87e0-74d7e46583ce req-249ff1d4-5b97-4721-882c-8c58082f63eb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2847879 Nov 24 04:13:37.115402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.139592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.155597 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:13:37.162330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 051df91e-8c7f-4786-a440-47b4ab3b519e owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:37.164125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.174004 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 2cf13928-5e4c-4acf-a3c7-6990e743b102 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:37.195354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['c286a8f2-ac43-4387-b29d-abf0de1cbc16'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:13:37.196957 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8e25a8ea-74ac-4e79-b61c-b6148e5fbd2f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags HTTP/1.1" status: 204 len: 168 time: 0.3558326 Nov 24 04:13:37.199026 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-44d1907a-54cc-48fc-8254-a5868b5e5476 None None] Provisioning complete for port 051df91e-8c7f-4786-a440-47b4ab3b519e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:37.199402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-44d1907a-54cc-48fc-8254-a5868b5e5476 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.210684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33970) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.217060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-dfcbdefa-0ae5-4dde-ba33-f8dc63ee84ad tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:37.222404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e93804e-023a-47e6-9afe-d5eb6b227ca2 None None] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:37.314091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.331758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.362270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-44d1907a-54cc-48fc-8254-a5868b5e5476 None None] Port 051df91e-8c7f-4786-a440-47b4ab3b519e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:37.363690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=118af873-8f8f-4194-9815-a47df076b9aa,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:37.398610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Router b8245ffe-09fd-4917-bcd1-064539ced840 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:37.407713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.409367 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f99b6053-5bed-4f93-be01-486b78bdb58b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3213875 Nov 24 04:13:37.415081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33972) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.421720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '85d13e9f-8f86-478e-a7fe-77e3092afe4b', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:37.426330 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dfcbdefa-0ae5-4dde-ba33-f8dc63ee84ad tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags HTTP/1.1" status: 204 len: 168 time: 0.2127495 Nov 24 04:13:37.432184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33974) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.465097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.467280 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:13:37.473075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-14fe7c27-dc7c-4f0e-b110-96647f097534 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:37.481381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.557727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=051df91e-8c7f-4786-a440-47b4ab3b519e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:37.557970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2f148b53-a210-4c99-9b51-32fb236a8150 None None] Provisioning complete for port 79f9a8dc-23c7-4067-be18-299b610d4334 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:37.558463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2f148b53-a210-4c99-9b51-32fb236a8150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.568111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.578293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-72d6d839-d9f4-4eb7-aa93-d40dd0855782 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/051df91e-8c7f-4786-a440-47b4ab3b519e HTTP/1.1" status: 204 len: 168 time: 0.8616662 Nov 24 04:13:37.581039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33976) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.640308 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-3a2cf275-02b7-4de8-81b0-7afb92e16356 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:37.640678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.641357 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3a2cf275-02b7-4de8-81b0-7afb92e16356 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/051df91e-8c7f-4786-a440-47b4ab3b519e HTTP/1.1" status: 404 len: 333 time: 0.0488186 Nov 24 04:13:37.651320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33978) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.675306 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.687394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.720671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=064e17dc-e583-40b7-b227-0b66477d0ca4,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:37.721148 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=2cf13928-5e4c-4acf-a3c7-6990e743b102,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:37.751463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:37.753713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.773429 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] Sync routers for ids ['b8245ffe-09fd-4917-bcd1-064539ced840'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:37.783238 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e56a95da-3a22-471c-81b0-977d6efe7399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3661625 Nov 24 04:13:37.829436 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] Routers {'b8245ffe-09fd-4917-bcd1-064539ced840'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:37.830092 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8245ffe-09fd-4917-bcd1-064539ced840'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:37.857037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 79f9a8dc-23c7-4067-be18-299b610d4334 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:37.886670 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-14fe7c27-dc7c-4f0e-b110-96647f097534 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags HTTP/1.1" status: 204 len: 168 time: 0.4530854 Nov 24 04:13:37.888694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33982) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.894500 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2f148b53-a210-4c99-9b51-32fb236a8150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.902188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-49045026-89ac-496b-9d20-9bd8a91599a4 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-894237232') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:37.907477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.910066 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2c85b739-b1db-4a6c-b944-ec5947707748 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 4.5138490 Nov 24 04:13:37.925794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33984) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:37.937315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:37.937708 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:37.949093 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7281dbd7-c010-4a60-aec7-82f9b943fff7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/2cf13928-5e4c-4acf-a3c7-6990e743b102 HTTP/1.1" status: 204 len: 168 time: 2.0387173 Nov 24 04:13:37.952471 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] Routers {'b8245ffe-09fd-4917-bcd1-064539ced840'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:37.953077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:37.953221 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8245ffe-09fd-4917-bcd1-064539ced840'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:37.962410 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 33986) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.000119 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:38.000775 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cce56353-8f7a-4cfc-927f-1c01ff797a56 None None] The sync data for ids ['b8245ffe-09fd-4917-bcd1-064539ced840'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:38.006864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0520ca32-9f93-42dd-b105-5cc531dd5399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.032203 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2f148b53-a210-4c99-9b51-32fb236a8150 None None] For port 79f9a8dc-23c7-4067-be18-299b610d4334, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=79f9a8dc-23c7-4067-be18-299b610d4334,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:38.041516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2f148b53-a210-4c99-9b51-32fb236a8150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.044611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 79f9a8dc-23c7-4067-be18-299b610d4334 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:38.045042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.079541 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-49045026-89ac-496b-9d20-9bd8a91599a4 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-894237232 HTTP/1.1" status: 201 len: 201 time: 0.1890955 Nov 24 04:13:38.082439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 33988) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.087049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-1b140b50-35b8-4a36-b274-fb3997f6c159 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-599800847') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:38.159528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f148b53-a210-4c99-9b51-32fb236a8150 None None] Pushing event updated for resources: {'Port': ['ID=79f9a8dc-23c7-4067-be18-299b610d4334,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:38.178817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 9219a34d-ba81-4210-9ee1-03d607ea9aa5 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:38.179635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.222324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b61f7b77-282f-40f8-9eb0-4d564b594c50 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:38.261182 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1b140b50-35b8-4a36-b274-fb3997f6c159 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-599800847 HTTP/1.1" status: 201 len: 201 time: 0.1772561 Nov 24 04:13:38.261887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34000) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.269657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-3d82d40c-ba9f-4fac-b7a5-874d95ad2980 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-831807848') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:38.292957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ccf45d4a-4e04-4c40-9476-f6d3f7381a4b None None] Provisioning complete for port 79f9a8dc-23c7-4067-be18-299b610d4334 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:38.295153 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ccf45d4a-4e04-4c40-9476-f6d3f7381a4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.310243 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.327269 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-4799d1c9-6ede-464c-b109-537a3736d971 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:38.327965 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4799d1c9-6ede-464c-b109-537a3736d971 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:38.331743 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4799d1c9-6ede-464c-b109-537a3736d971 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/2cf13928-5e4c-4acf-a3c7-6990e743b102 HTTP/1.1" status: 404 len: 333 time: 0.3603475 Nov 24 04:13:38.342113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 9219a34d-ba81-4210-9ee1-03d607ea9aa5 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:38.350582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34002) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.364366 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b61f7b77-282f-40f8-9eb0-4d564b594c50 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:38.364862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.421181 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-2bb30630-acfc-4790-b949-64397e410d99 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:13:38.422724 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2bb30630-acfc-4790-b949-64397e410d99 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/2cf13928-5e4c-4acf-a3c7-6990e743b102 HTTP/1.1" status: 404 len: 333 time: 0.0703340 Nov 24 04:13:38.426274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34004) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.503046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c984557f-2f75-4823-8e5d-925c5cb017d1 req-19bd0781-3a01-4e1f-968d-3b25ba0b4e12 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:38.506645 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c984557f-2f75-4823-8e5d-925c5cb017d1 req-19bd0781-3a01-4e1f-968d-3b25ba0b4e12 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 945 time: 0.1807904 Nov 24 04:13:38.528412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 24f23be1-76a8-4e35-9977-5261ffd9a7ce {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:38.534960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.544583 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3d82d40c-ba9f-4fac-b7a5-874d95ad2980 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-831807848 HTTP/1.1" status: 201 len: 201 time: 0.2815027 Nov 24 04:13:38.560031 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.565730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34010) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.578907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-991e8786-b169-4926-ae1a-ef2d77e0dbcd tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-174203893') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:38.623816 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-c1c112c3-1e4e-4a1f-8a60-294bddfa3086 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-310062344&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.1496315 Nov 24 04:13:38.633011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.701054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c984557f-2f75-4823-8e5d-925c5cb017d1 req-cc66cdfa-e980-435a-b73c-f53de032e549 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1846111 Nov 24 04:13:38.765928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd6a823b-e650-407d-ae40-9c7ae2591dfa None None] Network d7a0f84f-e834-4089-b23f-3e27ba00872e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:38.782337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.795081 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-991e8786-b169-4926-ae1a-ef2d77e0dbcd tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-174203893 HTTP/1.1" status: 201 len: 201 time: 0.2279203 Nov 24 04:13:38.797675 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34012) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.803643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-2d06e178-c3de-4fd5-826d-4fb2c8b54ccc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', {'tags': ['tempest-TagsExtTest-Tag-1403052400', 'tempest-TagsExtTest-Tag-199730706', 'tempest-TagsExtTest-Tag-156403030']}) {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:38.829492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=9219a34d-ba81-4210-9ee1-03d607ea9aa5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:38.860494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port b61f7b77-282f-40f8-9eb0-4d564b594c50, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b61f7b77-282f-40f8-9eb0-4d564b594c50,segment=NetworkSegment(5785dfca-7a65-423b-8661-6b45c167d29a),segment_id=5785dfca-7a65-423b-8661-6b45c167d29a)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:38.862797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.865644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-daa3f152-b2a7-4878-b7c8-5580fcb806de None None] Provisioning complete for port b61f7b77-282f-40f8-9eb0-4d564b594c50 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:38.866082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-daa3f152-b2a7-4878-b7c8-5580fcb806de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.884580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-9cae3fce-09fe-4f87-bbf5-26c7e58d9529 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:38.886574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.892404 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5f9dfce0-3dfe-432b-ba6a-59b65ed661db tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/9219a34d-ba81-4210-9ee1-03d607ea9aa5 HTTP/1.1" status: 204 len: 168 time: 1.2350030 Nov 24 04:13:38.892591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.893214 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-9cae3fce-09fe-4f87-bbf5-26c7e58d9529 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=61fb4de4-ff65-42d0-aed9-c58e7caab600 HTTP/1.1" status: 200 len: 797 time: 0.2318304 Nov 24 04:13:38.894456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34014) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.911860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.926936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.944441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:38.963634 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7160dbd-f83d-4147-9464-928c8b0f8741 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:38.967523 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a7160dbd-f83d-4147-9464-928c8b0f8741 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/9219a34d-ba81-4210-9ee1-03d607ea9aa5 HTTP/1.1" status: 404 len: 333 time: 0.0638545 Nov 24 04:13:38.971617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34016) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:38.990380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=b61f7b77-282f-40f8-9eb0-4d564b594c50,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:38.991704 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-68bdc0f1-5494-4593-b7f4-8229a9a38f5a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0764794 Nov 24 04:13:39.028315 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2d06e178-c3de-4fd5-826d-4fb2c8b54ccc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags HTTP/1.1" status: 200 len: 316 time: 0.2283590 Nov 24 04:13:39.031583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34018) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:39.043852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Deleting port b80b3d0b-c657-44ae-b471-c93210f156ac {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:39.044605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.049327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-f065aedf-f09d-4b43-a559-502f3e0befe2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:39.133298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet c035091e-dcad-4011-ac6e-b6ef0769fb13 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:39.140660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.159556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.172118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.173901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Calling delete_port for b80b3d0b-c657-44ae-b471-c93210f156ac owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:39.200082 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.254367 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-41c0f056-73da-4748-8732-935bb8d841d9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 394 time: 0.2368686 Nov 24 04:13:39.261419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=24f23be1-76a8-4e35-9977-5261ffd9a7ce,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:39.267464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.270834 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-540daaee-aad4-493a-9a2a-35205594aa26 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/24f23be1-76a8-4e35-9977-5261ffd9a7ce HTTP/1.1" status: 204 len: 168 time: 0.8434527 Nov 24 04:13:39.276301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34020) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:39.371286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.399128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Pushing event deleted for resources: {'Port': ['ID=b80b3d0b-c657-44ae-b471-c93210f156ac,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:39.414819 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1554c1ec-923b-4353-9762-5e1be4e919ca None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:39.478241 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.480107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4dfd629e-2f71-47b3-9f25-88d0293ae2e1 None None] Network d7a0f84f-e834-4089-b23f-3e27ba00872e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:39.604420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8d88113d-045d-4fa8-95ca-17b617a45d08 None None] Provisioning complete for port b61f7b77-282f-40f8-9eb0-4d564b594c50 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:39.604770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d88113d-045d-4fa8-95ca-17b617a45d08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.632485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 79f9a8dc-23c7-4067-be18-299b610d4334 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:39.701144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.704674 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.751519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c286a8f2-ac43-4387-b29d-abf0de1cbc16 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:39.795708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 79f9a8dc-23c7-4067-be18-299b610d4334 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:39.796086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.798718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Router b8245ffe-09fd-4917-bcd1-064539ced840 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:39.831498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] DHCP port deletion for d7a0f84f-e834-4089-b23f-3e27ba00872e request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:39.873190 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f065aedf-f09d-4b43-a559-502f3e0befe2 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags HTTP/1.1" status: 204 len: 168 time: 0.8278570 Nov 24 04:13:39.877379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.879412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34024) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:39.887469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-47b48ffe-19f2-4324-b6b4-ef9276789a12 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-1403052400') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:39.895881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port c286a8f2-ac43-4387-b29d-abf0de1cbc16 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:13:39.903977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port c286a8f2-ac43-4387-b29d-abf0de1cbc16 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:39.910267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.936375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:39.985797 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-4c5eafc6-23cb-41a5-8da6-6183e79d6aec service neutron] 10.222.0.48 "GET /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6956828 Nov 24 04:13:39.993587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b61f7b77-282f-40f8-9eb0-4d564b594c50 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:40.014937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] Deleting port b61f7b77-282f-40f8-9eb0-4d564b594c50 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:40.015317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.122245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] For port b61f7b77-282f-40f8-9eb0-4d564b594c50, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b61f7b77-282f-40f8-9eb0-4d564b594c50,segment=NetworkSegment(5785dfca-7a65-423b-8661-6b45c167d29a),segment_id=5785dfca-7a65-423b-8661-6b45c167d29a)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:40.122573 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.126484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.138811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.149765 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-47b48ffe-19f2-4324-b6b4-ef9276789a12 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:40.153543 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-47b48ffe-19f2-4324-b6b4-ef9276789a12 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-1403052400 HTTP/1.1" status: 404 len: 329 time: 0.2672768 Nov 24 04:13:40.164266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] Calling delete_port for b61f7b77-282f-40f8-9eb0-4d564b594c50 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:40.169410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34026) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.181735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b61f7b77-282f-40f8-9eb0-4d564b594c50 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:40.182104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.199517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-0eb5eac1-0027-4004-b5a8-32cab7cf43da tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-199730706') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:40.208763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.212233 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/c035091e-dcad-4011-ac6e-b6ef0769fb13 HTTP/1.1" status: 204 len: 168 time: 1.2376332 Nov 24 04:13:40.213173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdc13795-269c-4fc7-8e08-bbd504ee8aae tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=c035091e-dcad-4011-ac6e-b6ef0769fb13,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:40.216663 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34028) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.242948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.246719 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-3b7713ac-6a8b-42ef-9baa-043433d2e820 service neutron] 10.222.0.48 "GET /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2599628 Nov 24 04:13:40.249604 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-423e7a2e-4a75-437c-864f-87e411bbd896 None None] Network 94776e82-fcf4-4983-adeb-870633eba4b7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:40.257172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:40.265334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port b61f7b77-282f-40f8-9eb0-4d564b594c50 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:40.265581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.277487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.282675 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6515eacc-1619-46de-b03f-d941630da5ad tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "PUT /v2.0/routers/b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 200 len: 709 time: 2.3499727 Nov 24 04:13:40.285193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] Sync routers for ids ['b8245ffe-09fd-4917-bcd1-064539ced840'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:40.286713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34030) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.321508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0e707f-5beb-430e-99db-975ce3a02fb0 req-33b671bf-5ac8-49f1-8ea4-a2927e60f01a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:40.324559 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8e0e707f-5beb-430e-99db-975ce3a02fb0 req-33b671bf-5ac8-49f1-8ea4-a2927e60f01a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 945 time: 0.4737334 Nov 24 04:13:40.359763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:13:40.362389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2784fba-acb7-4dc6-90ee-b111c43b82a3" -d '{"events": [{"server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "name": "network-vif-plugged", "status": "completed", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:13:40.397029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:40.400138 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] Routers {'b8245ffe-09fd-4917-bcd1-064539ced840'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:40.400765 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8245ffe-09fd-4917-bcd1-064539ced840'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:40.448801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:13:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9459712-f00f-4022-98a7-5a66b647338a x-openstack-request-id: req-f9459712-f00f-4022-98a7-5a66b647338a {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:13:40.449387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "name": "network-vif-plugged", "status": "completed", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:13:40.449387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-f9459712-f00f-4022-98a7-5a66b647338a {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:13:40.449771 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'code': 200} Nov 24 04:13:40.450739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.456478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:40.472137 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8e0e707f-5beb-430e-99db-975ce3a02fb0 req-6cd6bed4-b9ea-448f-899d-0747f7837a03 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1416934 Nov 24 04:13:40.520358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] For port b61f7b77-282f-40f8-9eb0-4d564b594c50, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b61f7b77-282f-40f8-9eb0-4d564b594c50,segment=NetworkSegment(5785dfca-7a65-423b-8661-6b45c167d29a),segment_id=5785dfca-7a65-423b-8661-6b45c167d29a)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:40.520806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.541356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] Routers {'b8245ffe-09fd-4917-bcd1-064539ced840'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:40.541996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8245ffe-09fd-4917-bcd1-064539ced840'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:40.550776 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-15ef7744-938e-4e8e-b95f-9910bf73989a tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/routers/b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 200 len: 744 time: 0.2596531 Nov 24 04:13:40.552709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34040) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.564271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.606808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.613902 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-958958d2-1fe2-466c-ac00-b5b1ef5c0df0 req-2e719446-788e-4f9d-ab11-953b58cb6c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 210 time: 0.1231763 Nov 24 04:13:40.616425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:40.617095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e143ea8-b1ed-4b29-8eab-c1ebb7797b35 None None] The sync data for ids ['b8245ffe-09fd-4917-bcd1-064539ced840'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:40.635887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for b61f7b77-282f-40f8-9eb0-4d564b594c50 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:40.637627 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3ba89833-5f7f-46f1-a0d4-0aa0d5874949 tempest-RoutersIpV6AdminTest-138386292 tempest-RoutersIpV6AdminTest-138386292-project-admin] 10.222.0.48 "GET /v2.0/ports?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&device_id=b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 200 len: 205 time: 0.0822659 Nov 24 04:13:40.638496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34042) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.639388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:40.646525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] No DVR routers for this DVR port b61f7b77-282f-40f8-9eb0-4d564b594c50 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:40.668344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7147bb5-e39d-4ef5-a457-6e916d2c567a None None] Pushing event deleted for resources: {'Port': ['ID=b61f7b77-282f-40f8-9eb0-4d564b594c50,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:40.672727 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a7c6036e-be4d-4e4f-9c91-1d369f503661 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 200 len: 205 time: 0.0330770 Nov 24 04:13:40.673407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34044) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.748671 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-0eb5eac1-0027-4004-b5a8-32cab7cf43da tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:40.749728 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0eb5eac1-0027-4004-b5a8-32cab7cf43da tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-199730706 HTTP/1.1" status: 404 len: 328 time: 0.5562198 Nov 24 04:13:40.768125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34046) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:40.773190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-dbaee99b-92dc-46fc-aa74-8b437e42f088 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34', 'tempest-TagsExtTest-Tag-156403030') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:40.791071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] DHCP port deletion for 94776e82-fcf4-4983-adeb-870633eba4b7 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:40.814626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.822209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.863614 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=b61f7b77-282f-40f8-9eb0-4d564b594c50,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:40.866949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d534ea-7415-4b0a-afc9-214a89346916 req-8c9b0c3d-3411-4f54-8122-91bd84e404a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:40.868529 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-76d534ea-7415-4b0a-afc9-214a89346916 req-8c9b0c3d-3411-4f54-8122-91bd84e404a3 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1099 time: 0.2285693 Nov 24 04:13:40.869431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No DVR routers for this DVR port b61f7b77-282f-40f8-9eb0-4d564b594c50 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:40.873038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.903287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] Deleting port a6193dc7-4517-494d-91e5-ebf6cb86d61e {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:40.903567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:40.987255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] For port a6193dc7-4517-494d-91e5-ebf6cb86d61e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a6193dc7-4517-494d-91e5-ebf6cb86d61e,segment=NetworkSegment(9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1),segment_id=9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:40.988072 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.001682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] Calling delete_port for a6193dc7-4517-494d-91e5-ebf6cb86d61e owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:41.017076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-dbaee99b-92dc-46fc-aa74-8b437e42f088 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:41.020734 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dbaee99b-92dc-46fc-aa74-8b437e42f088 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags/tempest-TagsExtTest-Tag-156403030 HTTP/1.1" status: 404 len: 328 time: 0.2482049 Nov 24 04:13:41.020734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.021954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34052) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.026840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-104b8253-5730-4859-9efc-a68d1d24ea96 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', {'tags': ['tempest-TagsExtTest-Tag-2104993446', 'tempest-TagsExtTest-Tag-2036597329', 'tempest-TagsExtTest-Tag-925424439']}) {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.029970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.035185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port a6193dc7-4517-494d-91e5-ebf6cb86d61e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:41.035604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.062881 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-76d534ea-7415-4b0a-afc9-214a89346916 req-48f240d1-b785-4fcf-a564-6beb706a0864 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1794047 Nov 24 04:13:41.101272 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.105995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.106541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Fanout notify agent at l3_agent the message router_deleted on router b8245ffe-09fd-4917-bcd1-064539ced840 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:41.117837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.123437 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7320db67-2398-474f-b5f8-58ee3e2d294d tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 204 len: 168 time: 0.4489622 Nov 24 04:13:41.127897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34056) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.131363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] Pushing event deleted for resources: {'Port': ['ID=a6193dc7-4517-494d-91e5-ebf6cb86d61e,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:41.137232 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4e8af54-b76b-4d5d-89f9-81e3714562d5 None None] No DVR routers for this DVR port a6193dc7-4517-494d-91e5-ebf6cb86d61e on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:41.145606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.156633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-104b8253-5730-4859-9efc-a68d1d24ea96 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags HTTP/1.1" status: 200 len: 317 time: 0.1335371 Nov 24 04:13:41.161973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34058) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.167099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-b6b75bdb-58f5-44a3-914e-1bdf0d3a7ff8 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.186640 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-82572039-3bee-43f8-b5c2-157e25028de7 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 200 len: 205 time: 0.0538726 Nov 24 04:13:41.190727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34060) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.201613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d7a0f84f-e834-4089-b23f-3e27ba00872e']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.204840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] For port a6193dc7-4517-494d-91e5-ebf6cb86d61e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a6193dc7-4517-494d-91e5-ebf6cb86d61e,segment=NetworkSegment(9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1),segment_id=9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:41.205207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.222384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5785dfca-7a65-423b-8661-6b45c167d29a') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.222682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5785dfca-7a65-423b-8661-6b45c167d29a') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.231356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for a6193dc7-4517-494d-91e5-ebf6cb86d61e owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:41.235136 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-37f36ce9-e9ab-4313-b655-ccc88c52f453 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] delete failed (client error): The resource could not be found. Nov 24 04:13:41.236180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-37f36ce9-e9ab-4313-b655-ccc88c52f453 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/b8245ffe-09fd-4917-bcd1-064539ced840 HTTP/1.1" status: 404 len: 336 time: 0.0444040 Nov 24 04:13:41.237934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.241076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34062) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.271766 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b665c0e7-cccb-4479-8dc1-35540fc459a0 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=b9bc3cb9-e4b1-42cc-adc2-b51898adab9a HTTP/1.1" status: 200 len: 205 time: 0.0295258 Nov 24 04:13:41.274942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34064) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.291694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.300972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 190 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:41.301349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:41.304892 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:41.321404 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-a7d23962-e4eb-459e-a465-948ae6171169 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] delete failed (client error): The resource could not be found. Nov 24 04:13:41.325692 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a7d23962-e4eb-459e-a465-948ae6171169 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/b9bc3cb9-e4b1-42cc-adc2-b51898adab9a HTTP/1.1" status: 404 len: 336 time: 0.0466185 Nov 24 04:13:41.326461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34066) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.361187 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4bd09c30-a2df-4ba6-8689-8ceb953530c6 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=8db6a9d0-5556-4f76-9fe9-8db0ba2f774f HTTP/1.1" status: 200 len: 205 time: 0.0313425 Nov 24 04:13:41.362208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34068) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.383115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.394840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.397985 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/d7a0f84f-e834-4089-b23f-3e27ba00872e HTTP/1.1" status: 204 len: 168 time: 2.1207314 Nov 24 04:13:41.401810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34070) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.407979 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-102058844'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:41.411873 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-3e6df35e-a8ae-47bb-a1ef-721b137baf95 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] delete failed (client error): The resource could not be found. Nov 24 04:13:41.415465 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3e6df35e-a8ae-47bb-a1ef-721b137baf95 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/8db6a9d0-5556-4f76-9fe9-8db0ba2f774f HTTP/1.1" status: 404 len: 336 time: 0.0500607 Nov 24 04:13:41.415716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a81a020-6223-4d65-87ed-97e4dbfb21d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=d7a0f84f-e834-4089-b23f-3e27ba00872e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:41.415973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34072) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.417850 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b6b75bdb-58f5-44a3-914e-1bdf0d3a7ff8 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags HTTP/1.1" status: 204 len: 168 time: 0.2548332 Nov 24 04:13:41.422832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34074) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.431370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-db5c3d79-4c55-45b6-ab0a-8eb44c591002 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-2104993446') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.447167 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-40d08921-399d-4f00-9c24-4c87937ea35f tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=caa2f482-6336-4d5e-ae3d-753282912c95 HTTP/1.1" status: 200 len: 205 time: 0.0299246 Nov 24 04:13:41.449250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.451206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34076) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.468904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:41.473148 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.509844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:41.516600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=a6193dc7-4517-494d-91e5-ebf6cb86d61e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:41.521685 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-e4a1c42b-c0a4-48ae-b045-cb5aae45ddbc tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] delete failed (client error): The resource could not be found. Nov 24 04:13:41.522783 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e4a1c42b-c0a4-48ae-b045-cb5aae45ddbc tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/caa2f482-6336-4d5e-ae3d-753282912c95 HTTP/1.1" status: 404 len: 336 time: 0.0693619 Nov 24 04:13:41.523889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No DVR routers for this DVR port a6193dc7-4517-494d-91e5-ebf6cb86d61e on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:41.525594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34080) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.525840 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-db5c3d79-4c55-45b6-ab0a-8eb44c591002 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:41.529456 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-db5c3d79-4c55-45b6-ab0a-8eb44c591002 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-2104993446 HTTP/1.1" status: 404 len: 329 time: 0.0992310 Nov 24 04:13:41.530904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34082) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.535937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-ea303d1f-9f9c-4814-80b9-70506078aa60 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-2036597329') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.538480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.538823 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment ca21c01f-c3ea-49d9-9a49-3ee4026f7116 of type vlan for network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 Nov 24 04:13:41.579505 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-02e61db4-140e-4873-bfa9-cd8473eeabba tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=5be0625b-048a-4d37-8c2e-e83f3b3a8c57 HTTP/1.1" status: 200 len: 205 time: 0.0489969 Nov 24 04:13:41.583266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34084) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.608117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a6193dc7-4517-494d-91e5-ebf6cb86d61e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:41.627403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.630769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: a6193dc7-4517-494d-91e5-ebf6cb86d61e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:41.631197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a6193dc7-4517-494d-91e5-ebf6cb86d61e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:41.632109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b61f7b77-282f-40f8-9eb0-4d564b594c50 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:41.644872 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-8f156ece-6e38-47ad-a9d8-b23c7ecd4803 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] delete failed (client error): The resource could not be found. Nov 24 04:13:41.648620 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8f156ece-6e38-47ad-a9d8-b23c7ecd4803 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/5be0625b-048a-4d37-8c2e-e83f3b3a8c57 HTTP/1.1" status: 404 len: 336 time: 0.0602674 Nov 24 04:13:41.651317 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34086) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.651996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b61f7b77-282f-40f8-9eb0-4d564b594c50 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:41.652433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b61f7b77-282f-40f8-9eb0-4d564b594c50 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:41.701130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f2dce7-ca92-4346-86a3-47395df57b1c req-58f05c96-270d-47fa-9bb7-8c4252e06bd2 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:41.702683 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-62f2dce7-ca92-4346-86a3-47395df57b1c req-58f05c96-270d-47fa-9bb7-8c4252e06bd2 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0885770 Nov 24 04:13:41.705771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.708559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.712790 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6f065494-84dd-4a8c-9cde-5370d5c5e8ae tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "GET /v2.0/ports?device_id=8752bfb1-3ff0-4d45-91ca-40435e422682 HTTP/1.1" status: 200 len: 205 time: 0.0600817 Nov 24 04:13:41.718494 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34090) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.723025 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:41.724052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.751609 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-ea303d1f-9f9c-4814-80b9-70506078aa60 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:41.755878 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ea303d1f-9f9c-4814-80b9-70506078aa60 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-2036597329 HTTP/1.1" status: 404 len: 329 time: 0.2208419 Nov 24 04:13:41.771267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34092) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.774835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['94776e82-fcf4-4983-adeb-870633eba4b7']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.777428 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-08955320-e707-41cd-801c-f7a7f7b1256b tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] delete failed (client error): The resource could not be found. Nov 24 04:13:41.778516 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-08955320-e707-41cd-801c-f7a7f7b1256b tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/routers/8752bfb1-3ff0-4d45-91ca-40435e422682 HTTP/1.1" status: 404 len: 336 time: 0.0588150 Nov 24 04:13:41.791738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-56308f86-2735-44c9-8d9e-3dedb5c124cc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192', 'tempest-TagsExtTest-Tag-925424439') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.792415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34094) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.798268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.798537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9c81d486-53e9-4f4c-bfe9-3c8d0ad03db1') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.823328 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.4195480 Nov 24 04:13:41.827109 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56059f21-29da-4f08-89ec-5e6d73eb81a0 req-75c1b286-769c-47aa-9f16-15b6ea3d0cdf tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 210 time: 0.0548635 Nov 24 04:13:41.829414 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34096) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.852390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:41.856693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.872574 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-320ca35c-2800-4ff9-9ca5-7a1a1a417177 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] DELETE failed (client error): The resource could not be found. Nov 24 04:13:41.873038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-320ca35c-2800-4ff9-9ca5-7a1a1a417177 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:13:41.875413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c582d6-fb5f-4c07-a0ac-6157bed4d4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=477c5afc-4ace-4739-a3d8-bec54c1b40d4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:41.876079 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-320ca35c-2800-4ff9-9ca5-7a1a1a417177 tempest-RoutersIpV6AdminTest-328737193 tempest-RoutersIpV6AdminTest-328737193-project] 10.222.0.48 "DELETE /v2.0/subnets/beae5781-a64e-41fd-a2bc-7b1098a9c7df HTTP/1.1" status: 404 len: 337 time: 0.0799441 Nov 24 04:13:41.890140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:41.930274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.932677 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-62f2dce7-ca92-4346-86a3-47395df57b1c req-828f04ae-4eed-4137-8ce2-52332077dec7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2031207 Nov 24 04:13:41.942399 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-56308f86-2735-44c9-8d9e-3dedb5c124cc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:41.942399 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-56308f86-2735-44c9-8d9e-3dedb5c124cc tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags/tempest-TagsExtTest-Tag-925424439 HTTP/1.1" status: 404 len: 328 time: 0.1667645 Nov 24 04:13:41.948152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34100) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:41.953336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-cc8c93f8-edb5-4e10-8a0f-9400e01d2c2e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', {'tags': ['tempest-TagsExtTest-Tag-775379524', 'tempest-TagsExtTest-Tag-1227196349', 'tempest-TagsExtTest-Tag-2042465221']}) {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:41.972206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 198 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:41.972862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:41.976320 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:42.099080 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cc8c93f8-edb5-4e10-8a0f-9400e01d2c2e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags HTTP/1.1" status: 200 len: 317 time: 0.1470659 Nov 24 04:13:42.100231 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34106) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.114708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-6ecf7547-79d2-4462-b609-21662f344f12 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.132268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.146044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-3c323e64-67d1-4dd3-bd65-2ec28caab273 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:42.148219 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-3c323e64-67d1-4dd3-bd65-2ec28caab273 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=61fb4de4-ff65-42d0-aed9-c58e7caab600 HTTP/1.1" status: 200 len: 797 time: 0.2996845 Nov 24 04:13:42.148742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.149745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.153217 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/94776e82-fcf4-4983-adeb-870633eba4b7 HTTP/1.1" status: 204 len: 168 time: 1.9186671 Nov 24 04:13:42.155815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:42.159766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.168278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34108) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.184214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1161158579'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:42.205144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d9e95a-ddd6-490d-bf2c-1a458c4c5434 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=94776e82-fcf4-4983-adeb-870633eba4b7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:42.258573 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6ecf7547-79d2-4462-b609-21662f344f12 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags HTTP/1.1" status: 204 len: 168 time: 0.1569760 Nov 24 04:13:42.261667 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34112) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.266215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-d3d20444-4a65-415f-9c5c-79866ef9057f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-775379524') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.292586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:42.296084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.340236 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34114) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.354225 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-d3d20444-4a65-415f-9c5c-79866ef9057f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:42.357794 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d3d20444-4a65-415f-9c5c-79866ef9057f tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-775379524 HTTP/1.1" status: 404 len: 328 time: 0.0926719 Nov 24 04:13:42.358025 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34118) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.363544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-3439dd70-8bb3-4d74-8368-8239046420ea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-1227196349') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.367299 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-f55fd691-54dc-4308-8674-de3df328df0b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 472 time: 0.2041159 Nov 24 04:13:42.381724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['85d13e9f-8f86-478e-a7fe-77e3092afe4b']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:42.385958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 159, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:42.440567 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-3439dd70-8bb3-4d74-8368-8239046420ea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:42.444182 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3439dd70-8bb3-4d74-8368-8239046420ea tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-1227196349 HTTP/1.1" status: 404 len: 329 time: 0.0826750 Nov 24 04:13:42.444418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34120) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.448090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.448448 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment 4676eb6e-8189-41e6-b977-2c091b7a9a07 of type vlan for network 64e83f65-05b7-41ea-8a57-8ebe680b1558 Nov 24 04:13:42.448813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-5322f7d1-c4ab-4681-bce6-1b04c4e2bb83 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05', 'tempest-TagsExtTest-Tag-2042465221') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.522948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950f4cf9-3552-4f7a-96e3-b9686eb042c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.538588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.551510 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-5322f7d1-c4ab-4681-bce6-1b04c4e2bb83 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:42.555761 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5322f7d1-c4ab-4681-bce6-1b04c4e2bb83 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags/tempest-TagsExtTest-Tag-2042465221 HTTP/1.1" status: 404 len: 329 time: 0.1073527 Nov 24 04:13:42.556129 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34122) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.563303 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-3fba5ad9-367e-4ed3-b494-8303a425a3d4 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', {'tags': ['tempest-TagsExtTest-Tag-2052757244', 'tempest-TagsExtTest-Tag-509873674', 'tempest-TagsExtTest-Tag-400696146']}) {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.619903 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3fba5ad9-367e-4ed3-b494-8303a425a3d4 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "PUT /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags HTTP/1.1" status: 200 len: 316 time: 0.0625918 Nov 24 04:13:42.623931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34124) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.630769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-95119a6a-5824-469f-8cec-7f0bbc0c3309 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.635236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.640661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:42.641246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.643427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950f4cf9-3552-4f7a-96e3-b9686eb042c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.643697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.648041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-950f4cf9-3552-4f7a-96e3-b9686eb042c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.689129 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-950f4cf9-3552-4f7a-96e3-b9686eb042c5 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=bce76f0e0aad4013b5f0ba3077bb043b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3469684 Nov 24 04:13:42.689844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950f4cf9-3552-4f7a-96e3-b9686eb042c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3287d26-c887-4445-afef-0faa8c49f2d2,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:42.692162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34126) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.716997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:42.720489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.741402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fad92743-ba57-4dc4-b74a-8c52806352f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.743577 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.5633836 Nov 24 04:13:42.749942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34128) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.756294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:42.781609 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fad92743-ba57-4dc4-b74a-8c52806352f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.803434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=2b2caa5e-1110-46b8-b9b9-8cd8afcb8109,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:42.808339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b707edb5-25d1-46a9-855f-855d098afb5c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=64e83f65-05b7-41ea-8a57-8ebe680b1558,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:42.819600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:42.873171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:42.873422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: 477c5afc-4ace-4739-a3d8-bec54c1b40d4, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:42.882198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:42.890011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.899143 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-95119a6a-5824-469f-8cec-7f0bbc0c3309 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags HTTP/1.1" status: 204 len: 168 time: 0.2718120 Nov 24 04:13:42.899950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34132) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:42.904337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-afe51c9d-7927-4d74-a04e-adb1c52b1861 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-2052757244') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:42.943421 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fad92743-ba57-4dc4-b74a-8c52806352f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.945895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fad92743-ba57-4dc4-b74a-8c52806352f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:42.949840 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fad92743-ba57-4dc4-b74a-8c52806352f2 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/c3287d26-c887-4445-afef-0faa8c49f2d2 HTTP/1.1" status: 204 len: 168 time: 0.2542248 Nov 24 04:13:42.953512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:42.985379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad92743-ba57-4dc4-b74a-8c52806352f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3287d26-c887-4445-afef-0faa8c49f2d2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:42.988571 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-afe51c9d-7927-4d74-a04e-adb1c52b1861 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:42.989623 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-afe51c9d-7927-4d74-a04e-adb1c52b1861 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-2052757244 HTTP/1.1" status: 404 len: 329 time: 0.0887332 Nov 24 04:13:42.994997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 477c5afc-4ace-4739-a3d8-bec54c1b40d4) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:42.995251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34138) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.001710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-3be4fb2c-5f1d-4045-bb06-6a9e9e1a8016 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-509873674') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:43.021871 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ead7333a-bd99-4983-9b7f-03170835d346 req-8565279e-b88f-484a-87fa-c492efaac9e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 210 time: 0.0571446 Nov 24 04:13:43.023387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:43.023991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.027499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8048320-b562-4caa-afe4-abbcbc39ac8f None None] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:43.036890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.20 (61fb4de4-ff65-42d0-aed9-c58e7caab600/b58537d8-e9f8-43e0-92cb-52a12f3fe9d6/26aa7f6c-485f-4a13-a097-744803530749) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:43.062025 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d7fcf8c8-fd0b-4fdf-bdca-0e13ea8daa09 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2146616 Nov 24 04:13:43.065137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34140) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.070194 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-3be4fb2c-5f1d-4045-bb06-6a9e9e1a8016 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:43.070754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4', 'security_groups': [], 'name': 'tempest-PortsTestJSON-1121104967'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:43.074766 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3be4fb2c-5f1d-4045-bb06-6a9e9e1a8016 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-509873674 HTTP/1.1" status: 404 len: 328 time: 0.0781553 Nov 24 04:13:43.078394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34142) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.083592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-d6113e30-4776-411f-b048-dbce934a1878 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150', 'tempest-TagsExtTest-Tag-400696146') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:43.208731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d24c6f-66f6-46a8-890c-f60e12e96dbd req-8fa6fbdc-10d4-4817-9c50-32537060fb52 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:43.209481 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-d6113e30-4776-411f-b048-dbce934a1878 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] show failed (client error): The resource could not be found. Nov 24 04:13:43.210569 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d6113e30-4776-411f-b048-dbce934a1878 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags/tempest-TagsExtTest-Tag-400696146 HTTP/1.1" status: 404 len: 328 time: 0.1309915 Nov 24 04:13:43.215715 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d3d24c6f-66f6-46a8-890c-f60e12e96dbd req-8fa6fbdc-10d4-4817-9c50-32537060fb52 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1044903 Nov 24 04:13:43.215993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34146) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.222209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-3abe9cad-f396-4217-8ee5-d1db6c143daf tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', 'e1332584-4bc4-4d9e-80d3-d855b25dd150') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:43.283450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.307570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-477c5afc-4ace-4739-a3d8-bec54c1b40d4', 'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': '2b2caa5e-1110-46b8-b9b9-8cd8afcb8109'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:43.308460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.309003 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3abe9cad-f396-4217-8ee5-d1db6c143daf tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150/tags HTTP/1.1" status: 204 len: 168 time: 0.0901718 Nov 24 04:13:43.309522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.310648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34148) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.315775 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-d39bb5f6-f40c-469d-8552-8420020d1e08 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:43.321578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:43.325116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.374182 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d3d24c6f-66f6-46a8-890c-f60e12e96dbd req-22bbb7a3-901d-4a74-a72e-2b9a70e9acf5 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1382539 Nov 24 04:13:43.398886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=d67eb75e-81c0-40cb-a02b-2cc53700a7e1,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:43.398886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': '4676eb6e-8189-41e6-b977-2c091b7a9a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:43.398886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: 64e83f65-05b7-41ea-8a57-8ebe680b1558, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:43.422030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:43.425369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34152) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.436470 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 09026ad1-da90-48e7-ae79-ff9c6f1b53b1 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:43.465015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 64e83f65-05b7-41ea-8a57-8ebe680b1558) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:43.474597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc71af4e-10d0-4722-a996-bbd097f5297e None None] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:43.482989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:43.485230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.498585 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3495d00b-3090-4a24-bb3f-92c7e0e1e0f0 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=e9d040c743724e29897c8fd842f0d888&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0720592 Nov 24 04:13:43.502064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34154) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.527407 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-86703c67-8e18-43b6-a785-038bdf5d8482 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7764149 Nov 24 04:13:43.532573 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34156) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.538295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.541087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558', 'name': 'tempest-PortsIpV6TestJSON-800502910', 'fixed_ips': [{'subnet_id': 'd67eb75e-81c0-40cb-a02b-2cc53700a7e1', 'ip_address': '2001:db8::10'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:43.599562 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d39bb5f6-f40c-469d-8552-8420020d1e08 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05/tags HTTP/1.1" status: 204 len: 168 time: 0.2806184 Nov 24 04:13:43.599562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34158) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:43.607791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-9dabc751-9b6c-41bd-a1d5-eb5430bc45e9 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '2792e925-c250-4107-927e-d83a07802192') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:43.628653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:43.641999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-94a74175-baac-4115-bbfa-9a2a8cccd9b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.660803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:43.667338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:43.679719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df74fd31-f1b3-42bf-a0d3-6c87663d2544 req-2c6e53da-3bb7-404e-a252-b5c79ccca464 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:43.681425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-df74fd31-f1b3-42bf-a0d3-6c87663d2544 req-2c6e53da-3bb7-404e-a252-b5c79ccca464 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1876626 Nov 24 04:13:43.684789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=26aa7f6c-485f-4a13-a097-744803530749,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:43.685747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-94a74175-baac-4115-bbfa-9a2a8cccd9b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.755197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:43.782012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-94a74175-baac-4115-bbfa-9a2a8cccd9b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.784738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-94a74175-baac-4115-bbfa-9a2a8cccd9b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.786022 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-94a74175-baac-4115-bbfa-9a2a8cccd9b3 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/685e132c-5a61-4d70-b831-65ee5534aaf5 HTTP/1.1" status: 204 len: 168 time: 0.2815728 Nov 24 04:13:43.798229 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Allocated IP 172.20.0.2 (477c5afc-4ace-4739-a3d8-bec54c1b40d4/2b2caa5e-1110-46b8-b9b9-8cd8afcb8109/616e3b69-f1e3-4777-b5da-71577d4731ea) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:43.808724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a74175-baac-4115-bbfa-9a2a8cccd9b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=685e132c-5a61-4d70-b831-65ee5534aaf5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:43.913947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:43.948306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 1b369773-f02b-4d4e-b07b-11977e4190e0 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:43.978939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-64e83f65-05b7-41ea-8a57-8ebe680b1558', 'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': 'd67eb75e-81c0-40cb-a02b-2cc53700a7e1'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:43.979813 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.200107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6b1f5eca-9c7d-4f41-8f16-00891cfdadc0 None None] Provisioning complete for port 26aa7f6c-485f-4a13-a097-744803530749 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:44.200483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6b1f5eca-9c7d-4f41-8f16-00891cfdadc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.207821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:44.208705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.238278 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-df74fd31-f1b3-42bf-a0d3-6c87663d2544 req-36daf295-9239-4853-8463-745c61982432 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0978777 Nov 24 04:13:44.246781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::10 (64e83f65-05b7-41ea-8a57-8ebe680b1558/d67eb75e-81c0-40cb-a02b-2cc53700a7e1/1b369773-f02b-4d4e-b07b-11977e4190e0) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:44.257984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34170) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:44.265062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab29dbe-4d4c-4cfd-bf71-69e2c766daae req-748b310b-b700-4004-9dda-6d330c6e9a9d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:44.270922 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-5ab29dbe-4d4c-4cfd-bf71-69e2c766daae req-748b310b-b700-4004-9dda-6d330c6e9a9d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 932 time: 0.1165421 Nov 24 04:13:44.276458 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-6b9b7c67-135d-4375-b099-ddd6a797d036 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9024975 Nov 24 04:13:44.295872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Request body: {'port': {'device_id': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:44.299411 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9dabc751-9b6c-41bd-a1d5-eb5430bc45e9 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/ports/2792e925-c250-4107-927e-d83a07802192/tags HTTP/1.1" status: 204 len: 168 time: 0.6991799 Nov 24 04:13:44.303382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34174) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:44.306180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6b1f5eca-9c7d-4f41-8f16-00891cfdadc0 None None] Port 26aa7f6c-485f-4a13-a097-744803530749 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:44.312935 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.324097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.324561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-de91dee6-51a6-4920-abb4-f696dfb1dec7 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '958504fd-5b6e-43e5-976b-817e580cdd34') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:44.368055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:44.371593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:44.374170 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:44.435076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78103e40-48a3-40f3-b2c4-c2ea98e39935 tempest-TestNetworkAdvancedServerOps-2074709094 tempest-TestNetworkAdvancedServerOps-2074709094-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:44.436621 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-78103e40-48a3-40f3-b2c4-c2ea98e39935 tempest-TestNetworkAdvancedServerOps-2074709094 tempest-TestNetworkAdvancedServerOps-2074709094-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1094 time: 0.1776562 Nov 24 04:13:44.442797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Pushing event updated for resources: {'Port': ['ID=616e3b69-f1e3-4777-b5da-71577d4731ea,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:44.446555 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34178) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:44.450949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:44.456284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Attempting to bind port 616e3b69-f1e3-4777-b5da-71577d4731ea on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:44.456657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Attempting to bind port 616e3b69-f1e3-4777-b5da-71577d4731ea by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:44.457111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Attempting to bind port 616e3b69-f1e3-4777-b5da-71577d4731ea on network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:44.461568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.463381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:44.463984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Checking segment: {'id': 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:44.464490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.465065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Bound using segment: {'id': 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:44.465544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Bound port: 616e3b69-f1e3-4777-b5da-71577d4731ea, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '477c5afc-4ace-4739-a3d8-bec54c1b40d4'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:44.466303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.468751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.3 (477c5afc-4ace-4739-a3d8-bec54c1b40d4/2b2caa5e-1110-46b8-b9b9-8cd8afcb8109/09026ad1-da90-48e7-ae79-ff9c6f1b53b1) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:44.483483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.532803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.536889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.552134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] For port 616e3b69-f1e3-4777-b5da-71577d4731ea, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:44.579552 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-5ab29dbe-4d4c-4cfd-bf71-69e2c766daae req-5cf5be2d-0f41-439e-902c-7b028b81e9f7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2966244 Nov 24 04:13:44.605849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:44.609040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] For port 616e3b69-f1e3-4777-b5da-71577d4731ea, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=616e3b69-f1e3-4777-b5da-71577d4731ea,segment=NetworkSegment(ca21c01f-c3ea-49d9-9a49-3ee4026f7116),segment_id=ca21c01f-c3ea-49d9-9a49-3ee4026f7116)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:44.615095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:44.619953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.629579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:44.635623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:44.636385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.641214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=1b369773-f02b-4d4e-b07b-11977e4190e0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:44.663155 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0c71cd1f-54a0-4efd-84e3-2bc2e0a7193a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.1288707 Nov 24 04:13:44.665285 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34186) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:44.673287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Allocated IP 2001:db8::2 (64e83f65-05b7-41ea-8a57-8ebe680b1558/d67eb75e-81c0-40cb-a02b-2cc53700a7e1/8cabd167-9915-4547-9843-281d86189e2b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:44.678178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558', 'name': 'tempest-PortsIpV6TestJSON-1870369714', 'fixed_ips': [{'subnet_id': 'd67eb75e-81c0-40cb-a02b-2cc53700a7e1', 'ip_address': '2001:db8::f'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:44.704752 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-de91dee6-51a6-4920-abb4-f696dfb1dec7 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34/tags HTTP/1.1" status: 204 len: 168 time: 0.3861423 Nov 24 04:13:44.717683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe056276-9e18-4513-abdd-3e9716de78dd None None] Pushing event updated for resources: {'Port': ['ID=616e3b69-f1e3-4777-b5da-71577d4731ea,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:44.726372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34188) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:44.890228 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:44.893930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.899347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.903667 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.932817 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34192) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:44.941264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:44.969613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:44.973264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:44.976080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:44.981226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:44.989037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Pushing event updated for resources: {'Port': ['ID=8cabd167-9915-4547-9843-281d86189e2b,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:45.045154 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-30facd6c-fadb-4478-b159-411403c64dde tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for subnetpool, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.046492 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-30facd6c-fadb-4478-b159-411403c64dde tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnetpools/e1332584-4bc4-4d9e-80d3-d855b25dd150 HTTP/1.1" status: 204 len: 168 time: 0.3184042 Nov 24 04:13:45.056765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34196) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:45.105670 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Attempting to bind port 8cabd167-9915-4547-9843-281d86189e2b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:45.106365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Attempting to bind port 8cabd167-9915-4547-9843-281d86189e2b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '4676eb6e-8189-41e6-b977-2c091b7a9a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:45.106745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Attempting to bind port 8cabd167-9915-4547-9843-281d86189e2b on network 64e83f65-05b7-41ea-8a57-8ebe680b1558 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:45.115053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:45.115406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Checking segment: {'id': '4676eb6e-8189-41e6-b977-2c091b7a9a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:45.116150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.116575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Bound using segment: {'id': '4676eb6e-8189-41e6-b977-2c091b7a9a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:45.117152 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Bound port: 8cabd167-9915-4547-9843-281d86189e2b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4676eb6e-8189-41e6-b977-2c091b7a9a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 159, 'network_id': '64e83f65-05b7-41ea-8a57-8ebe680b1558'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:45.117641 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.128747 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-022d1493-9fc6-4c9b-9459-61f173a47e55 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "GET /v2.0/ports?device_id=ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05 HTTP/1.1" status: 200 len: 205 time: 0.0606184 Nov 24 04:13:45.132389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34198) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:45.154824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.184670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.202809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] For port 8cabd167-9915-4547-9843-281d86189e2b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:45.207299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] For port 8cabd167-9915-4547-9843-281d86189e2b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8cabd167-9915-4547-9843-281d86189e2b,segment=NetworkSegment(4676eb6e-8189-41e6-b977-2c091b7a9a07),segment_id=4676eb6e-8189-41e6-b977-2c091b7a9a07)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:45.219347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.234037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 26aa7f6c-485f-4a13-a097-744803530749 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:13:45.244056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.270814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Transition to ACTIVE for port object 26aa7f6c-485f-4a13-a097-744803530749 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:13:45.289044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f39ec6-6e54-4f08-81ac-ef8a011e2cee None None] Pushing event updated for resources: {'Port': ['ID=8cabd167-9915-4547-9843-281d86189e2b,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:45.305599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.361419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:45.378810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:45.392099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:45.396331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=09026ad1-da90-48e7-ae79-ff9c6f1b53b1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:45.532468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:45.533101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.585474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Pushing event updated for resources: {'Port': ['ID=26aa7f6c-485f-4a13-a097-744803530749,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:45.623463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Allocated IP 172.26.5.41 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/cc889587-0362-4296-85ec-4d51003bcc7f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:45.626725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-33675639', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:45.652953 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9d9dfea9-01ce-4b84-a5ac-ffe566220988 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 886 time: 2.5865319 Nov 24 04:13:45.660624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34202) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:45.742841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.804407 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8cabd167-9915-4547-9843-281d86189e2b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:45.842048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Attempting to bind port 26aa7f6c-485f-4a13-a097-744803530749 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:45.842419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Attempting to bind port 26aa7f6c-485f-4a13-a097-744803530749 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:45.842756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Attempting to bind port 26aa7f6c-485f-4a13-a097-744803530749 on network 61fb4de4-ff65-42d0-aed9-c58e7caab600 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:45.888887 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8cabd167-9915-4547-9843-281d86189e2b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:45.889258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.906308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Port 26aa7f6c-485f-4a13-a097-744803530749 on network 61fb4de4-ff65-42d0-aed9-c58e7caab600 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:13:45.906639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Attempting to bind port 26aa7f6c-485f-4a13-a097-744803530749 on network 61fb4de4-ff65-42d0-aed9-c58e7caab600 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:45.929824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:45.930083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Checking segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:45.930505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Bound using segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:45.930983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Bound port: 26aa7f6c-485f-4a13-a097-744803530749, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:45.931579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:45.952138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbffb9e3-6cde-4820-9fe5-6b46aa4770ef req-0a8e9ab6-848d-4903-9d79-85e79d5df9f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:45.953761 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bbffb9e3-6cde-4820-9fe5-6b46aa4770ef req-0a8e9ab6-848d-4903-9d79-85e79d5df9f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 944 time: 0.1968575 Nov 24 04:13:46.011847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.035294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.036601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.052512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] For port 26aa7f6c-485f-4a13-a097-744803530749, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:46.054720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 8cabd167-9915-4547-9843-281d86189e2b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8cabd167-9915-4547-9843-281d86189e2b,segment=NetworkSegment(4676eb6e-8189-41e6-b977-2c091b7a9a07),segment_id=4676eb6e-8189-41e6-b977-2c091b7a9a07)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:46.056700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] For port 26aa7f6c-485f-4a13-a097-744803530749, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=26aa7f6c-485f-4a13-a097-744803530749,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:46.062314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.063224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 616e3b69-f1e3-4777-b5da-71577d4731ea up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:46.083072 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.100873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:46.101816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.103488 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] 10.222.0.21 "PUT /v2.0/ports/26aa7f6c-485f-4a13-a097-744803530749 HTTP/1.1" status: 200 len: 1094 time: 1.8118641 Nov 24 04:13:46.106838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.110309 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.112185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'tag': '26aa7f6c-485f-4a13-a097-744803530749'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:13:46.115599 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa63c121-583b-4568-8fc2-02c11d585cb7" -d '{"events": [{"name": "network-changed", "server_uuid": "f7a44151-8384-4ee1-997e-6273cc167dcc", "tag": "26aa7f6c-485f-4a13-a097-744803530749"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:13:46.120221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.145761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.149620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.150890 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eb00b034-ba0e-4ae9-9b82-828104ae4af5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 1.2171040 Nov 24 04:13:46.152209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::f (64e83f65-05b7-41ea-8a57-8ebe680b1558/d67eb75e-81c0-40cb-a02b-2cc53700a7e1/7f5f7a2b-ae94-4e84-8707-cbcc2c92930d) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:46.155402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.159608 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34206) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:46.169154 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 09026ad1-da90-48e7-ae79-ff9c6f1b53b1 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:46.169548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.172187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1574321399'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:46.193215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 616e3b69-f1e3-4777-b5da-71577d4731ea triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:46.193708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.221920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Made reservation on behalf of 78915d964edf42f986813b67a4624be3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:46.225678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.259331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=8cabd167-9915-4547-9843-281d86189e2b,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:46.291676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:13:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bcbd0506-d1e4-4ff8-857a-8ee745ea0d1c x-openstack-request-id: req-bcbd0506-d1e4-4ff8-857a-8ee745ea0d1c {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:13:46.292270 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7a44151-8384-4ee1-997e-6273cc167dcc", "tag": "26aa7f6c-485f-4a13-a097-744803530749", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:13:46.292270 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-bcbd0506-d1e4-4ff8-857a-8ee745ea0d1c {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:13:46.292883 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'tag': '26aa7f6c-485f-4a13-a097-744803530749', 'status': 'completed', 'code': 200} Nov 24 04:13:46.306099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.321613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-690457db-2b22-4f9a-ab5e-9d2d835e564d None None] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:46.368587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.369113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Fanout notify agent at l3_agent the message router_deleted on router ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:13:46.385000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.387419 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bbffb9e3-6cde-4820-9fe5-6b46aa4770ef req-c2b6400a-c6e7-48a1-aeab-e1dfea0e1f68 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4218163 Nov 24 04:13:46.388653 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-df755651-2d60-4ec9-a951-001a85b75ee6 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/routers/ff4e64b8-3403-4d5d-8e5a-e791f6e5dc05 HTTP/1.1" status: 204 len: 168 time: 1.2550387 Nov 24 04:13:46.390497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34208) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:46.402749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.440808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-e3cc9969-2cbe-4a97-8606-e5e15267bf49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:46.442618 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-e3cc9969-2cbe-4a97-8606-e5e15267bf49 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 1097 time: 0.2504447 Nov 24 04:13:46.448001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b65b048-a01c-4c65-bd8b-d8af6046df7d service neutron] Pushing event updated for resources: {'Port': ['ID=26aa7f6c-485f-4a13-a097-744803530749,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:46.488364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0c6c6d66-f86b-4a03-ae3e-49fd7e554d14 None None] Provisioning complete for port 616e3b69-f1e3-4777-b5da-71577d4731ea triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:46.488895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0c6c6d66-f86b-4a03-ae3e-49fd7e554d14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.509801 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-bcd9ffb0-add4-43c1-a894-f8ff14637b61 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.20&port_id=26aa7f6c-485f-4a13-a097-744803530749 HTTP/1.1" status: 200 len: 217 time: 0.0468853 Nov 24 04:13:46.533584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 616e3b69-f1e3-4777-b5da-71577d4731ea, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=616e3b69-f1e3-4777-b5da-71577d4731ea,segment=NetworkSegment(ca21c01f-c3ea-49d9-9a49-3ee4026f7116),segment_id=ca21c01f-c3ea-49d9-9a49-3ee4026f7116)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:46.554575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.576027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.603751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.643353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 09026ad1-da90-48e7-ae79-ff9c6f1b53b1 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:46.684274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.687267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=616e3b69-f1e3-4777-b5da-71577d4731ea,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:46.693631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5addafb1-2c8a-4cf5-bf30-0fecf44d4f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:46.696051 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-5addafb1-2c8a-4cf5-bf30-0fecf44d4f31 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=b58537d8-e9f8-43e0-92cb-52a12f3fe9d6 HTTP/1.1" status: 200 len: 838 time: 0.1784337 Nov 24 04:13:46.763862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.781791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:46.813306 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:46.821624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.823297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:46.829707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Port': ['ID=cc889587-0362-4296-85ec-4d51003bcc7f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:46.873625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.895589 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] vlan segment allocate from pool success with {'vlan_id': 171, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:46.898963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-8cf291c9-64d2-4e26-a774-b43a76ab4508 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:46.900395 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-8cf291c9-64d2-4e26-a774-b43a76ab4508 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=61fb4de4-ff65-42d0-aed9-c58e7caab600&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1430821 Nov 24 04:13:46.924510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:46.924618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79893daf-c9f4-4247-80d1-0b7db1f8b252 None None] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:46.931237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:46.938921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:46.952296 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:46.953205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:46.985199 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.3184342 Nov 24 04:13:46.992791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34210) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:47.025163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-54f27b56-10d7-47fa-8741-b7c51201137b None None] Provisioning complete for port 8cabd167-9915-4547-9843-281d86189e2b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:47.026436 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-54f27b56-10d7-47fa-8741-b7c51201137b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.073859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0455d26-aab5-4038-9400-996929a0118f tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=7f5f7a2b-ae94-4e84-8707-cbcc2c92930d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:47.080037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Deleting port 2792e925-c250-4107-927e-d83a07802192 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:47.080383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.181473 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.202824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Calling delete_port for 2792e925-c250-4107-927e-d83a07802192 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:47.204307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eaa8151b-7dd1-407b-b6d8-662fbad78963,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:47.240223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92ea93a9-5633-45c5-a3ac-2bf8c241812d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:47.241824 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-92ea93a9-5633-45c5-a3ac-2bf8c241812d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 927 time: 0.2440448 Nov 24 04:13:47.247529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34212) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:47.326807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.327266 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Added segment 7f09a149-4996-45d5-b48e-737d19b25a86 of type vlan for network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 Nov 24 04:13:47.335191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-cbf8ce68-da07-4533-813e-d9d590fc30d9 None None] Provisioning complete for port 616e3b69-f1e3-4777-b5da-71577d4731ea triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:47.335865 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cbf8ce68-da07-4533-813e-d9d590fc30d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.343257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.386142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=09026ad1-da90-48e7-ae79-ff9c6f1b53b1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:47.404966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.449303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-171438c1-83b4-45a2-b1c5-43a054d28227 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:47.456717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-cbf8ce68-da07-4533-813e-d9d590fc30d9 None None] Could not find standard attr ID for object 09026ad1-da90-48e7-ae79-ff9c6f1b53b1. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:13:47.462417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-171438c1-83b4-45a2-b1c5-43a054d28227 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:47.470233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-171438c1-83b4-45a2-b1c5-43a054d28227 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:47.475307 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-171438c1-83b4-45a2-b1c5-43a054d28227 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2390 time: 0.2218413 Nov 24 04:13:47.475937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34216) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:47.488740 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-435769f4-0a17-4646-9716-d383db23f6ac service neutron] 10.222.0.21 "GET /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5763531 Nov 24 04:13:47.522126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.528338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:47.529173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.602464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Provisioning complete for port 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:47.602838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.612278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:47.630043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Network': ['ID=c20f17de-37f4-4dcf-bfbd-752fa5e6d356,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:47.773849 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-748fed9c-f620-4e3b-aa12-92a07bdbec34 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 1.6131194 Nov 24 04:13:47.783136 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event deleted for resources: {'Port': ['ID=2792e925-c250-4107-927e-d83a07802192,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:47.792698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34218) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:47.800869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'subnet': {'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:47.905524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:47.908167 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8cabd167-9915-4547-9843-281d86189e2b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:47.920252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc15f5be-3da7-43e2-8bb2-9e84213743f1 req-2c0c4c88-523e-4976-9628-af11b745ea08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:47.921887 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fc15f5be-3da7-43e2-8bb2-9e84213743f1 req-2c0c4c88-523e-4976-9628-af11b745ea08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 944 time: 0.3892188 Nov 24 04:13:48.057813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.061172 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5e2ef00e-84b3-4221-8a52-9e7bfa8292e1 tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/ports/2792e925-c250-4107-927e-d83a07802192 HTTP/1.1" status: 204 len: 168 time: 1.6632547 Nov 24 04:13:48.067458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:48.067862 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.077853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34220) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:48.089011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Port 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:48.111621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8cabd167-9915-4547-9843-281d86189e2b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:48.113646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.205467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Provisioning complete for port 1b369773-f02b-4d4e-b07b-11977e4190e0 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:48.205844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.232073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Made reservation on behalf of 78915d964edf42f986813b67a4624be3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:48.235662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.275528 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fc15f5be-3da7-43e2-8bb2-9e84213743f1 req-f01aab13-e895-46fc-bbd6-c420e63b4c1a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3154650 Nov 24 04:13:48.285464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.289943 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0ea699b9-320e-4b1d-8938-8d5a267092de tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/09026ad1-da90-48e7-ae79-ff9c6f1b53b1 HTTP/1.1" status: 204 len: 168 time: 2.6235209 Nov 24 04:13:48.295444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Port 1b369773-f02b-4d4e-b07b-11977e4190e0 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:48.296903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34222) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:48.322698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Deleting subnet 958504fd-5b6e-43e5-976b-817e580cdd34 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:48.340063 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.349331 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-d4da9c9d-8446-46c2-955d-a794ac96f156 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2217069 Nov 24 04:13:48.351720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Provisioning complete for port 8cabd167-9915-4547-9843-281d86189e2b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:48.352200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f714bd08-8b6c-429f-a56f-e83f102e7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.355154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 616e3b69-f1e3-4777-b5da-71577d4731ea up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:48.355637 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-93837c8f-ba23-40cf-b6de-3fa62ebeddfb tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:13:48.357311 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-93837c8f-ba23-40cf-b6de-3fa62ebeddfb tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/09026ad1-da90-48e7-ae79-ff9c6f1b53b1 HTTP/1.1" status: 404 len: 333 time: 0.0553648 Nov 24 04:13:48.360006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34224) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:48.371913 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a92f2e49-6f18-427c-951d-45544a5776e6 req-af223527-9268-4694-ad6b-9476f866f7bf service neutron] 10.222.0.21 "GET /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8579707 Nov 24 04:13:48.437521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.461533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:48.469639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 2b2caa5e-1110-46b8-b9b9-8cd8afcb8109 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:48.478940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.487742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.522304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.541828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 616e3b69-f1e3-4777-b5da-71577d4731ea triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:48.542378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.631706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.670190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f891760a-eddd-4427-90d7-51d3311dc4b1 None None] Provisioning complete for port 1b369773-f02b-4d4e-b07b-11977e4190e0 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:48.670190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f891760a-eddd-4427-90d7-51d3311dc4b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.691729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-77bba0a1-8dca-4c4c-8039-7724a3a93c1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:48.693152 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-77bba0a1-8dca-4c4c-8039-7724a3a93c1d service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 1097 time: 0.2172451 Nov 24 04:13:48.697283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a348710-da92-4789-ad68-b7e50071fb81 req-f6a21cde-2cdb-4bc6-8635-8e274fe5755a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:48.698832 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-f6a21cde-2cdb-4bc6-8635-8e274fe5755a service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1099 time: 0.1211264 Nov 24 04:13:48.707015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f891760a-eddd-4427-90d7-51d3311dc4b1 None None] Port 1b369773-f02b-4d4e-b07b-11977e4190e0 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:48.713149 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.717605 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f891760a-eddd-4427-90d7-51d3311dc4b1 None None] Provisioning complete for port 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:48.717988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f891760a-eddd-4427-90d7-51d3311dc4b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.754850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f891760a-eddd-4427-90d7-51d3311dc4b1 None None] Port 7f5f7a2b-ae94-4e84-8707-cbcc2c92930d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:48.799951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.843380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.845195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.894434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.896345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=7f5f7a2b-ae94-4e84-8707-cbcc2c92930d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:48.918380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.919557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Subnet': ['ID=5e77e950-2995-470e-aa0c-d18cbefa4711,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:48.942963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.948265 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/subnets/958504fd-5b6e-43e5-976b-817e580cdd34 HTTP/1.1" status: 204 len: 168 time: 0.8473244 Nov 24 04:13:48.950225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34228) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:48.952138 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d85cd8cb-c88b-492f-a4bd-2a5d8c2c632e None None] Network eece608a-2941-4024-9a30-f80ac327dc91 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:48.973426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:48.979491 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2af18e26-71e6-4f15-b1b4-9aea850d9059 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/7f5f7a2b-ae94-4e84-8707-cbcc2c92930d HTTP/1.1" status: 204 len: 168 time: 1.5016446 Nov 24 04:13:48.982501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34230) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:48.984593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250ddec2-3b10-460a-80d2-7e4a398fe85e tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event deleted for resources: {'Subnet': ['ID=958504fd-5b6e-43e5-976b-817e580cdd34,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:49.012428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Checking segment: {'id': '7f09a149-4996-45d5-b48e-737d19b25a86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:49.012914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network hostable DHCP agents. Network: c20f17de-37f4-4dcf-bfbd-752fa5e6d356, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:49.016924 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-fe81a322-72e7-4940-b795-38b19778f190 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:49.022261 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fe81a322-72e7-4940-b795-38b19778f190 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/7f5f7a2b-ae94-4e84-8707-cbcc2c92930d HTTP/1.1" status: 404 len: 333 time: 0.0385907 Nov 24 04:13:49.023575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34232) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:49.073464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a348710-da92-4789-ad68-b7e50071fb81 req-e33c9725-c5db-4688-937d-be028c173245 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.075334 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-e33c9725-c5db-4688-937d-be028c173245 service neutron] 10.222.0.21 "GET /v2.0/networks?id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 898 time: 0.3276696 Nov 24 04:13:49.076995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-190bd4c9-c877-4ce4-ae36-db59d4abe3c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.078583 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-190bd4c9-c877-4ce4-ae36-db59d4abe3c3 service neutron] 10.222.0.21 "GET /v2.0/networks?id=61fb4de4-ff65-42d0-aed9-c58e7caab600 HTTP/1.1" status: 200 len: 898 time: 0.3608992 Nov 24 04:13:49.096840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:49.114645 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, c20f17de-37f4-4dcf-bfbd-752fa5e6d356) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:49.122336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.122992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.131157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a520c223-48dc-4d2c-80d9-bd183349eb9a None None] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:49.145444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 1b369773-f02b-4d4e-b07b-11977e4190e0 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:49.145898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.157895 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e4f5c15b-1ba6-44fe-8e2d-9a0b0f0480da tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3628709 Nov 24 04:13:49.169032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34234) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:49.173751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'network': {'name': 'tempest-router-network01--1676032660'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:49.215801 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.235149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] DHCP port deletion for eece608a-2941-4024-9a30-f80ac327dc91 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:49.254838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Made reservation on behalf of 78915d964edf42f986813b67a4624be3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:49.258985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.294002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.312345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] vlan segment allocate from pool success with {'vlan_id': 178, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:49.315387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 1b369773-f02b-4d4e-b07b-11977e4190e0 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:49.331543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.331892 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Added segment fab7ed6a-d5e3-4dc3-8358-3207cf426ebf of type vlan for network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f Nov 24 04:13:49.379123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] Deleting port a5f1c74b-6dee-4797-ad76-28272679b369 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:49.379123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.415342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-c20f17de-37f4-4dcf-bfbd-752fa5e6d356', 'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356', 'tenant_id': '78915d964edf42f986813b67a4624be3', 'fixed_ips': [{'subnet_id': '5e77e950-2995-470e-aa0c-d18cbefa4711'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:49.416349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.427681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.450428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.467278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.473227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.473836 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.474497 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-439a42a4-4be2-479d-b4b1-9fb62244867b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.20&port_id=26aa7f6c-485f-4a13-a097-744803530749 HTTP/1.1" status: 200 len: 217 time: 0.3131824 Nov 24 04:13:49.477820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] For port a5f1c74b-6dee-4797-ad76-28272679b369, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a5f1c74b-6dee-4797-ad76-28272679b369,segment=NetworkSegment(866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8),segment_id=866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:49.478361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.539793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] Calling delete_port for a5f1c74b-6dee-4797-ad76-28272679b369 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:49.544210 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3739848 Nov 24 04:13:49.550688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34242) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:49.554583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=2b2caa5e-1110-46b8-b9b9-8cd8afcb8109,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:49.559228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.560673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'network': {'name': 'tempest-router-network02--1434853581'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:49.570913 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-09d2deee-c8da-4b60-90a6-5277f919916c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/2b2caa5e-1110-46b8-b9b9-8cd8afcb8109 HTTP/1.1" status: 204 len: 168 time: 1.2093422 Nov 24 04:13:49.581605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34244) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:49.605557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.607192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7f827f4-7c35-47e4-a98a-3b59f65c3935 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Network': ['ID=4567c839-ebc4-4f8a-bfc3-e0b491eeb35f,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:49.609968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82b93062-8788-4269-89c9-e0edb5c423fd None None] Network 477c5afc-4ace-4739-a3d8-bec54c1b40d4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:49.646954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=1b369773-f02b-4d4e-b07b-11977e4190e0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:49.666047 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-b65f10d1-5d93-49d9-a982-c55f3801bf0b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 200 len: 1002 time: 0.4934685 Nov 24 04:13:49.682461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:49.694216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Made reservation on behalf of 78915d964edf42f986813b67a4624be3 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:49.702852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.724906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.729839 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-186252f8-f1e2-43fa-bf2c-6f4cded8f24c tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/1b369773-f02b-4d4e-b07b-11977e4190e0 HTTP/1.1" status: 204 len: 168 time: 0.7050805 Nov 24 04:13:49.738286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-8a98ed19-3fd9-4841-ab63-3ae2fe075050 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.739998 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-8a98ed19-3fd9-4841-ab63-3ae2fe075050 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=b58537d8-e9f8-43e0-92cb-52a12f3fe9d6 HTTP/1.1" status: 200 len: 838 time: 0.2565181 Nov 24 04:13:49.740651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34246) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:49.760415 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a5f1c74b-6dee-4797-ad76-28272679b369 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:49.777868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafaa907-d7c6-4476-a00a-c6651e4815ec req-014cfbeb-3a01-49a7-8869-7e81a9a39bc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.779726 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-cafaa907-d7c6-4476-a00a-c6651e4815ec req-014cfbeb-3a01-49a7-8869-7e81a9a39bc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 944 time: 0.4099245 Nov 24 04:13:49.782865 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-24cba64d-0da6-40b5-bbd9-acc6df9c2618 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:13:49.786228 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-24cba64d-0da6-40b5-bbd9-acc6df9c2618 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/1b369773-f02b-4d4e-b07b-11977e4190e0 HTTP/1.1" status: 404 len: 333 time: 0.0426385 Nov 24 04:13:49.787943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34248) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:49.814634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 26aa7f6c-485f-4a13-a097-744803530749 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:13:49.841287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.850522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.859549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.869098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.877886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet d67eb75e-81c0-40cb-a02b-2cc53700a7e1 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:13:49.880211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] vlan segment allocate from pool success with {'vlan_id': 199, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:49.886234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.926114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.926780 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Added segment ba42279c-dd7e-4fcc-8353-a5b31ec18c2f of type vlan for network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d Nov 24 04:13:49.963853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] Pushing event deleted for resources: {'Port': ['ID=a5f1c74b-6dee-4797-ad76-28272679b369,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:49.968371 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a348710-da92-4789-ad68-b7e50071fb81 req-c7dd7ed8-17e3-474e-a08e-fd91faf178bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:49.969835 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-c7dd7ed8-17e3-474e-a08e-fd91faf178bb service neutron] 10.222.0.21 "GET /v2.0/subnets?id=c4348623-9729-4d15-a5cf-803eac33880a HTTP/1.1" status: 200 len: 834 time: 0.2920880 Nov 24 04:13:49.979687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:49.982511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3857fdbb-7280-4cec-9bc5-022d3b850586 None None] No DVR routers for this DVR port a5f1c74b-6dee-4797-ad76-28272679b369 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:49.995401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Allocated IP 172.20.0.2 (c20f17de-37f4-4dcf-bfbd-752fa5e6d356/5e77e950-2995-470e-aa0c-d18cbefa4711/0ba4d396-6d70-4078-91ef-27d8b0f3a544) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:50.014886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.027183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Deleting port a5f1c74b-6dee-4797-ad76-28272679b369 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:50.027183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.029944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No active binding found for port a5f1c74b-6dee-4797-ad76-28272679b369 {{(pid=103382) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 24 04:13:50.030617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a5f1c74b-6dee-4797-ad76-28272679b369 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:50.104446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.110743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-97d76eb0-aee5-4940-b781-a7306855b43f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:50.111074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:50.112810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.113079 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-97d76eb0-aee5-4940-b781-a7306855b43f service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=61fb4de4-ff65-42d0-aed9-c58e7caab600&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.3170130 Nov 24 04:13:50.134508 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-cafaa907-d7c6-4476-a00a-c6651e4815ec req-ecdbc1ee-78c2-4d00-bc27-6d71799c286a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3233395 Nov 24 04:13:50.149730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event updated for resources: {'Port': ['ID=cc889587-0362-4296-85ec-4d51003bcc7f,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:50.175510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 26aa7f6c-485f-4a13-a097-744803530749, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=26aa7f6c-485f-4a13-a097-744803530749,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:50.179376 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6276834 Nov 24 04:13:50.190786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34250) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:50.202098 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'subnet': {'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:50.218020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.238317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': '26aa7f6c-485f-4a13-a097-744803530749', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'port_id': '26aa7f6c-485f-4a13-a097-744803530749', 'mac_address': 'fa:16:3e:96:29:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 157, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'ip_address': '172.20.0.20'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:13:50.245577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.262851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] DHCP port deletion for 477c5afc-4ace-4739-a3d8-bec54c1b40d4 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:50.277490 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] For port a5f1c74b-6dee-4797-ad76-28272679b369, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:50.277856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.281793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ead4d66-2931-44f0-83ad-e2c80f0dd053 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Network': ['ID=11f1dfa5-c8f4-41e4-a211-395fe5e38d6d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:50.317561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:50.327742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Calling delete_port for a5f1c74b-6dee-4797-ad76-28272679b369 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:50.336967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a348710-da92-4789-ad68-b7e50071fb81 req-cc25438d-317c-4552-b17d-9b22d04be8f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:50.338086 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-cc25438d-317c-4552-b17d-9b22d04be8f7 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=becef48c-b834-483b-91dc-0f71ec58e834&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3255587 Nov 24 04:13:50.341147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.ipam_backend_mixin [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Port a5f1c74b-6dee-4797-ad76-28272679b369 was not found and therefore no delete operation was performed {{(pid=103381) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:13:50.352739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.364018 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.373898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Made reservation on behalf of 78915d964edf42f986813b67a4624be3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:50.378534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.457230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.464195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event deleted for resources: {'Port': ['ID=a5f1c74b-6dee-4797-ad76-28272679b369,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:50.468853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] No DVR routers for this DVR port a5f1c74b-6dee-4797-ad76-28272679b369 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:50.474894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 616e3b69-f1e3-4777-b5da-71577d4731ea {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:50.475244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.497271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=d67eb75e-81c0-40cb-a02b-2cc53700a7e1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:50.509143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.515509 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9ff8f3ff-51b0-45f8-9a23-2afe3e5e26eb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/d67eb75e-81c0-40cb-a02b-2cc53700a7e1 HTTP/1.1" status: 204 len: 168 time: 0.7251048 Nov 24 04:13:50.515920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34252) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:50.516975 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-c8553d49-d80f-4dbb-a0c3-9988be039a98 service neutron] 10.222.0.21 "GET /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3697994 Nov 24 04:13:50.562590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64fe7805-dacf-45b9-b484-687b882c1ac3 None None] Network 64e83f65-05b7-41ea-8a57-8ebe680b1558 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:50.571480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.573903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.595528 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Floating IP 06a6cce1-4f72-4389-a050-43d496e8504b associated. External IP: 172.26.5.41, port: c286a8f2-ac43-4387-b29d-abf0de1cbc16. Nov 24 04:13:50.630206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.647470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 26aa7f6c-485f-4a13-a097-744803530749 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:13:50.735089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.736030 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:50.754295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Pushing event updated for resources: {'Port': ['ID=0ba4d396-6d70-4078-91ef-27d8b0f3a544,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:50.765561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:50.791166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:50.794538 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] Deleting port 616e3b69-f1e3-4777-b5da-71577d4731ea {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:50.794538 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.795385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 8cabd167-9915-4547-9843-281d86189e2b {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:50.795719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.798722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 26aa7f6c-485f-4a13-a097-744803530749, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=26aa7f6c-485f-4a13-a097-744803530749,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:50.817786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Subnet': ['ID=9d8b1281-f4e3-471e-8cc5-872566184aad,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:50.820544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.885265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Checking segment: {'id': 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:50.885867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network hostable DHCP agents. Network: 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:50.889089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] For port 8cabd167-9915-4547-9843-281d86189e2b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8cabd167-9915-4547-9843-281d86189e2b,segment=NetworkSegment(4676eb6e-8189-41e6-b977-2c091b7a9a07),segment_id=4676eb6e-8189-41e6-b977-2c091b7a9a07)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:50.889544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.909247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 8cabd167-9915-4547-9843-281d86189e2b owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:50.927701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:50.969306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:50.980403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] For port 616e3b69-f1e3-4777-b5da-71577d4731ea, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=616e3b69-f1e3-4777-b5da-71577d4731ea,segment=NetworkSegment(ca21c01f-c3ea-49d9-9a49-3ee4026f7116),segment_id=ca21c01f-c3ea-49d9-9a49-3ee4026f7116)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:50.980805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.981149 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:50.981744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:50.996753 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0d1ee4a-a281-4e6d-a603-59a89050c7ea None None] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:51.013999 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-edc81935-8101-4183-ac7e-a05f2406bd6f tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8223403 Nov 24 04:13:51.014853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34254) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:51.023112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'subnet': {'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:51.043652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.088253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['26aa7f6c-485f-4a13-a097-744803530749'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:13:51.109611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=8cabd167-9915-4547-9843-281d86189e2b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:51.114961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No DVR routers for this DVR port 8cabd167-9915-4547-9843-281d86189e2b on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:51.123066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7094a6f-11f8-4bba-8df1-a69e9449608c None None] DHCP port deletion for 64e83f65-05b7-41ea-8a57-8ebe680b1558 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:13:51.128307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Attempting to bind port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:51.128685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Attempting to bind port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '7f09a149-4996-45d5-b48e-737d19b25a86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:51.129060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Attempting to bind port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 on network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:51.134432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.140803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] Calling delete_port for 616e3b69-f1e3-4777-b5da-71577d4731ea owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:51.141166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] For port 616e3b69-f1e3-4777-b5da-71577d4731ea, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=616e3b69-f1e3-4777-b5da-71577d4731ea,segment=NetworkSegment(ca21c01f-c3ea-49d9-9a49-3ee4026f7116),segment_id=ca21c01f-c3ea-49d9-9a49-3ee4026f7116)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:51.141593 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.146363 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-5deff777-ad79-4549-9b82-59264a909592 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7945642 Nov 24 04:13:51.175839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:51.176396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Checking segment: {'id': '7f09a149-4996-45d5-b48e-737d19b25a86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:51.176602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.176993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Bound using segment: {'id': '7f09a149-4996-45d5-b48e-737d19b25a86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:51.177473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Bound port: 0ba4d396-6d70-4078-91ef-27d8b0f3a544, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f09a149-4996-45d5-b48e-737d19b25a86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'c20f17de-37f4-4dcf-bfbd-752fa5e6d356'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:51.177852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.188156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=26aa7f6c-485f-4a13-a097-744803530749,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:51.216364 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.225728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Made reservation on behalf of 78915d964edf42f986813b67a4624be3 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:51.229035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 616e3b69-f1e3-4777-b5da-71577d4731ea owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:51.229602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.260396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eece608a-2941-4024-9a30-f80ac327dc91']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.297904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.298177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '866bfd3e-373c-4b74-b4ba-4a3c4f78e6d8') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.316916 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fa63c121-583b-4568-8fc2-02c11d585cb7 req-780ad0fa-b242-4ce6-aa4f-d386ef9713e7 service neutron] 10.222.0.21 "GET /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7644570 Nov 24 04:13:51.350605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.412677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.428570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Releasing vlan 163 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:51.429007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:51.436549 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:51.448789 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] For port 0ba4d396-6d70-4078-91ef-27d8b0f3a544, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:51.458855 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-4567c839-ebc4-4f8a-bfc3-e0b491eeb35f', 'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f', 'tenant_id': '78915d964edf42f986813b67a4624be3', 'fixed_ips': [{'subnet_id': '9d8b1281-f4e3-471e-8cc5-872566184aad'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:51.459674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.508305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.541444 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5a348710-da92-4789-ad68-b7e50071fb81 req-b289a62c-43d6-4574-8cfd-6d16e5cc30a8 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3357193 Nov 24 04:13:51.591792 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['64e83f65-05b7-41ea-8a57-8ebe680b1558']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.599040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.607119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] Pushing event deleted for resources: {'Port': ['ID=616e3b69-f1e3-4777-b5da-71577d4731ea,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:51.613234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.616649 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] 10.222.0.48 "DELETE /v2.0/networks/eece608a-2941-4024-9a30-f80ac327dc91 HTTP/1.1" status: 204 len: 168 time: 2.6595228 Nov 24 04:13:51.627470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] For port 0ba4d396-6d70-4078-91ef-27d8b0f3a544, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0ba4d396-6d70-4078-91ef-27d8b0f3a544,segment=NetworkSegment(7f09a149-4996-45d5-b48e-737d19b25a86),segment_id=7f09a149-4996-45d5-b48e-737d19b25a86)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:51.634426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd43120d-6a1d-449f-9395-43e8ea84bf0e None None] No DVR routers for this DVR port 616e3b69-f1e3-4777-b5da-71577d4731ea on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:51.635223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-233ec77c-b448-455a-a3ef-9763a9ee83be tempest-TagsExtTest-1022008947 tempest-TagsExtTest-1022008947-project] Pushing event deleted for resources: {'Network': ['ID=eece608a-2941-4024-9a30-f80ac327dc91,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:51.637281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4676eb6e-8189-41e6-b977-2c091b7a9a07') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.637582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4676eb6e-8189-41e6-b977-2c091b7a9a07') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.639509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.664642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.680960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.685686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=616e3b69-f1e3-4777-b5da-71577d4731ea,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:51.688519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No DVR routers for this DVR port 616e3b69-f1e3-4777-b5da-71577d4731ea on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:13:51.718558 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.719213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:13:51.734437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ec2e6c-d0ef-4ef4-9c68-89793166712c req-976fe374-48c1-457d-bee9-7014ba06397e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:51.736038 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e1ec2e6c-d0ef-4ef4-9c68-89793166712c req-976fe374-48c1-457d-bee9-7014ba06397e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 945 time: 0.1577923 Nov 24 04:13:51.747458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 159 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:51.747863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:51.753145 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:51.820134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Allocated IP 172.20.0.2 (4567c839-ebc4-4f8a-bfc3-e0b491eeb35f/9d8b1281-f4e3-471e-8cc5-872566184aad/9a9c3550-dec4-4809-99cc-544480ef2b10) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:51.840504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.870567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.872764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['477c5afc-4ace-4739-a3d8-bec54c1b40d4']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.898678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.909057 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/64e83f65-05b7-41ea-8a57-8ebe680b1558 HTTP/1.1" status: 204 len: 168 time: 1.3895674 Nov 24 04:13:51.914421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34260) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:51.921354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.921354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca21c01f-c3ea-49d9-9a49-3ee4026f7116') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:51.923811 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8984ed86-f7f7-475f-a6b9-ba45eb4f8566 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=64e83f65-05b7-41ea-8a57-8ebe680b1558,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:51.924406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-64464900'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:51.929352 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e1ec2e6c-d0ef-4ef4-9c68-89793166712c req-75672346-8de1-4c51-a4ea-5e524153a20b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1832697 Nov 24 04:13:51.958944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8cabd167-9915-4547-9843-281d86189e2b no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:51.975205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:51.994026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.020513 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 8cabd167-9915-4547-9843-281d86189e2b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:52.020868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8cabd167-9915-4547-9843-281d86189e2b not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:52.021274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 616e3b69-f1e3-4777-b5da-71577d4731ea no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:13:52.024782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:52.028866 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.032887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.054004 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:52.062316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dce19ea-758b-4bb0-a72d-7b10538c8ff2 None None] Pushing event updated for resources: {'Port': ['ID=0ba4d396-6d70-4078-91ef-27d8b0f3a544,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:52.073462 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] Sync routers for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:52.085031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 182 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:13:52.085520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.087579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 616e3b69-f1e3-4777-b5da-71577d4731ea {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:13:52.087934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 616e3b69-f1e3-4777-b5da-71577d4731ea not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:13:52.091768 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:13:52.100517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Checking segment: {'id': 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:52.101011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network hostable DHCP agents. Network: 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:52.106256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Subnet': ['ID=de810fa0-b37b-42fd-aa09-02b882dc8422,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:52.108853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.124970 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:52.125894 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:52.128537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:52.159357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:52.168036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:52.168904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.194601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5fe7add-881b-4d64-89da-80430a3eb289 None None] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:52.207560 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7638ccea-92af-4c4d-9af7-4e53ea4e59b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1867914 Nov 24 04:13:52.208317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34264) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:52.231462 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] vlan segment allocate from pool success with {'vlan_id': 192, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:52.240721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34266) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:52.250464 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f59144b2-fa61-4e7d-8090-15fd641e8f75 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 7.8028209 Nov 24 04:13:52.256132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:13:52.262196 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec457a01-20ac-4b97-879f-624a1c3c20ea" -d '{"events": [{"name": "network-changed", "server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:13:52.281251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.284011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.284354 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Added segment 2c036b21-57f7-492c-881b-8a1d86aa9841 of type vlan for network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 Nov 24 04:13:52.296752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.304958 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/477c5afc-4ace-4739-a3d8-bec54c1b40d4 HTTP/1.1" status: 204 len: 168 time: 2.6916106 Nov 24 04:13:52.312842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34274) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:52.337861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'name': 'tempest-PortsTestJSON-1249096529'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:52.354911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.366959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:13:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cbadfee-25ab-4a1c-8ae6-e2bdf87aa82f x-openstack-request-id: req-3cbadfee-25ab-4a1c-8ae6-e2bdf87aa82f {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:13:52.367322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:13:52.367504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-3cbadfee-25ab-4a1c-8ae6-e2bdf87aa82f {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:13:52.367905 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'status': 'completed', 'code': 200} Nov 24 04:13:52.369990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-953b56bd-a730-454d-a273-ab31b54088c2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=477c5afc-4ace-4739-a3d8-bec54c1b40d4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:52.403219 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:52.457817 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.556076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:52.566283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:52.568964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Pushing event updated for resources: {'Port': ['ID=9a9c3550-dec4-4809-99cc-544480ef2b10,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:52.571389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:52.640274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.693982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Attempting to bind port 9a9c3550-dec4-4809-99cc-544480ef2b10 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:52.694410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Attempting to bind port 9a9c3550-dec4-4809-99cc-544480ef2b10 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:52.694785 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Attempting to bind port 9a9c3550-dec4-4809-99cc-544480ef2b10 on network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:52.700588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:52.700972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Checking segment: {'id': 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:52.701386 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.701781 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Bound using segment: {'id': 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:52.705464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Bound port: 9a9c3550-dec4-4809-99cc-544480ef2b10, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '4567c839-ebc4-4f8a-bfc3-e0b491eeb35f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:52.705647 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4212664b-0eb2-4ef4-84c3-3a2fb280e136 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=700e4436a7fe450b93f258c3b345b106&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4602284 Nov 24 04:13:52.705753 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.705852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34276) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:52.719195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-11f1dfa5-c8f4-41e4-a211-395fe5e38d6d', 'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d', 'tenant_id': '78915d964edf42f986813b67a4624be3', 'fixed_ips': [{'subnet_id': 'de810fa0-b37b-42fd-aa09-02b882dc8422'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:52.720805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.740916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5961f01-56ed-41d2-bbb1-fea925773c1f req-b15d9103-c045-42d1-81a7-c4b6efcfa5c6 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:52.742360 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a5961f01-56ed-41d2-bbb1-fea925773c1f req-b15d9103-c045-42d1-81a7-c4b6efcfa5c6 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.2850895 Nov 24 04:13:52.747840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-4769b85c-c249-445b-af15-83fef5084960 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:52.749561 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-4769b85c-c249-445b-af15-83fef5084960 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1099 time: 0.3009403 Nov 24 04:13:52.783823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.788761 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:52.789355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.800748 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '06a6cce1-4f72-4389-a050-43d496e8504b', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'port_id': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1080, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'mac_address': 'fa:16:3e:cc:4a:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:13:47Z', 'updated_at': '2021-11-24T04:13:47Z', 'revision_number': 0, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:52.804498 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.834818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bef78a37-b452-4d02-8109-aad2fefaa559 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.847478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:52.851033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.854950 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] Checking router: b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:13:52.866178 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:52.867320 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:52.886790 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] For port 9a9c3550-dec4-4809-99cc-544480ef2b10, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:52.893922 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] For port 9a9c3550-dec4-4809-99cc-544480ef2b10, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9a9c3550-dec4-4809-99cc-544480ef2b10,segment=NetworkSegment(fab7ed6a-d5e3-4dc3-8358-3207cf426ebf),segment_id=fab7ed6a-d5e3-4dc3-8358-3207cf426ebf)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:52.899546 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.9839101 Nov 24 04:13:52.906708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34278) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:52.924145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:52.945369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port a835a7d4-261f-469f-bff4-21655c16b962 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:52.953586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:52.963797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bef78a37-b452-4d02-8109-aad2fefaa559 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.059634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bef78a37-b452-4d02-8109-aad2fefaa559 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.060192 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a5961f01-56ed-41d2-bbb1-fea925773c1f req-a567e18d-5e42-4a6c-80af-6246ff24c7ec tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3068805 Nov 24 04:13:53.065578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bef78a37-b452-4d02-8109-aad2fefaa559 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.068443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9a7496-a984-4251-9f69-8a8a9b4ac1a8 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Network': ['ID=cacc841c-d9b0-42a7-bd1a-b11bf3bbe764,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:53.105034 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:13:53.106508 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bef78a37-b452-4d02-8109-aad2fefaa559 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/1b7281f0-94ac-4e5f-a6bd-3a23478f6ead HTTP/1.1" status: 204 len: 168 time: 0.3984201 Nov 24 04:13:53.107498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34284) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:53.213452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef78a37-b452-4d02-8109-aad2fefaa559 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b7281f0-94ac-4e5f-a6bd-3a23478f6ead,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:53.229611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:53.284927 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8970d22-dd0f-48d2-b5e8-dd700bb35086 req-edb2d337-813c-41a2-a85c-99e7e446fd38 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:53.287225 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c8970d22-dd0f-48d2-b5e8-dd700bb35086 req-edb2d337-813c-41a2-a85c-99e7e446fd38 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 945 time: 0.2638030 Nov 24 04:13:53.367755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-4765c96d-e6aa-4f37-9466-283791b3d70a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:53.375251 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-4765c96d-e6aa-4f37-9466-283791b3d70a service neutron] 10.222.0.21 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 898 time: 0.6143851 Nov 24 04:13:53.420309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Allocated IP 172.20.0.2 (11f1dfa5-c8f4-41e4-a211-395fe5e38d6d/de810fa0-b37b-42fd-aa09-02b882dc8422/b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:53.442996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8b56bb0-0cc9-4062-a338-e6b010be9b49 None None] Pushing event updated for resources: {'Port': ['ID=9a9c3550-dec4-4809-99cc-544480ef2b10,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:53.476264 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c8970d22-dd0f-48d2-b5e8-dd700bb35086 req-2b177a22-2532-4a5d-998a-eb4508eff50d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1380136 Nov 24 04:13:53.515720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Allocated IP 172.20.0.1 (4567c839-ebc4-4f8a-bfc3-e0b491eeb35f/9d8b1281-f4e3-471e-8cc5-872566184aad/b5a1051b-b1ae-4bca-9242-3f18b569051d) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:53.565347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.666016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.698381 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b5341024-1d3d-49e5-89b3-423069a9035f tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/floatingips/06a6cce1-4f72-4389-a050-43d496e8504b HTTP/1.1" status: 200 len: 991 time: 0.5382257 Nov 24 04:13:53.715007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:53.722116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.731511 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '06a6cce1-4f72-4389-a050-43d496e8504b', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'port_id': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1080, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'mac_address': 'fa:16:3e:cc:4a:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:13:47Z', 'updated_at': '2021-11-24T04:13:47Z', 'revision_number': 0, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:53.805958 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61e41996-07c9-442a-bef5-3a66386a61c1 None None] The sync data for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv is: [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '06a6cce1-4f72-4389-a050-43d496e8504b', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'port_id': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1080, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'mac_address': 'fa:16:3e:cc:4a:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:13:47Z', 'updated_at': '2021-11-24T04:13:47Z', 'revision_number': 0, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:53.807956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 26aa7f6c-485f-4a13-a097-744803530749 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:53.812349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0ba4d396-6d70-4078-91ef-27d8b0f3a544 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:53.853052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.926054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc3b9550-7c1e-42b8-aedd-818e260b2b5b None None] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:53.928277 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:53.988883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:53.992456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:53.997138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:54.028657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Port': ['ID=b5a1051b-b1ae-4bca-9242-3f18b569051d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:54.054935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.177911 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=a835a7d4-261f-469f-bff4-21655c16b962,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:54.183261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.188458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.215387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.222336 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-5d5cae5e-8629-4f6b-955e-7c4b5c06ff96 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 999 time: 0.8323505 Nov 24 04:13:54.231993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:54.241149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:54.245420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:54.251152 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:54.251783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.257222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.300098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9dcdf10b-5145-4156-bc6b-d86bc7d7a9fa None None] Provisioning complete for port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:54.300574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9dcdf10b-5145-4156-bc6b-d86bc7d7a9fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.333298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:54.333712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.352301 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-99448672-28fa-4b26-9aca-4bfd594e7680 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 2.0240705 Nov 24 04:13:54.364304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34302) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:54.391526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:54.393706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-eaaa9b5f-4759-44b4-9cc7-b3821c0a4257 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:54.396042 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-eaaa9b5f-4759-44b4-9cc7-b3821c0a4257 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 200 len: 834 time: 0.1641126 Nov 24 04:13:54.410322 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:54.458182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Checking segment: {'id': '2c036b21-57f7-492c-881b-8a1d86aa9841', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:54.458590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network hostable DHCP agents. Network: cacc841c-d9b0-42a7-bd1a-b11bf3bbe764, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:54.469745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:54.514495 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=5334ecdc-83a8-40ec-b5bc-7747649eb177,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:54.541907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port 26aa7f6c-485f-4a13-a097-744803530749 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:13:54.546853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Pushing event updated for resources: {'Port': ['ID=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:54.557440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port 26aa7f6c-485f-4a13-a097-744803530749 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:54.557884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.600134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:54.609743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.621193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34308) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:54.635837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.692124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Attempting to bind port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:54.692638 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Attempting to bind port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:54.693110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Attempting to bind port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 on network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:54.698627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e964f64a-6095-4e90-9127-785e292a67b3 None None] New status for floating IP 06a6cce1-4f72-4389-a050-43d496e8504b: ACTIVE {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:13:54.703311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34312) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:54.728695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, cacc841c-d9b0-42a7-bd1a-b11bf3bbe764) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:54.738494 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:54.739113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.768463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-aa724fc1-bc41-4983-8335-e10f0a4c04ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:54.770382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-aa724fc1-bc41-4983-8335-e10f0a4c04ec service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=5056a387-4f26-43bd-ad60-c8135c9a7757&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3626266 Nov 24 04:13:54.828143 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-de81012a-b111-4b3d-9b19-909ddb4898c1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.9143934 Nov 24 04:13:54.844845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.853544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3a4e37b-1c73-4507-82e1-9a5fde364b24 None None] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:54.855428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34314) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:54.867164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-850279203-network', 'tenant_id': '1f9bf64d67774d1fb7ab8d25db416cdd'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:54.872288 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.878706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a15600-fabb-46b3-ab58-f528e4b66d1d req-306545ff-8227-4daa-b941-bab9ea05cb7c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:54.880294 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-77a15600-fabb-46b3-ab58-f528e4b66d1d req-306545ff-8227-4daa-b941-bab9ea05cb7c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 945 time: 0.2301450 Nov 24 04:13:54.891087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port a835a7d4-261f-469f-bff4-21655c16b962 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:54.891428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.957543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:54.957831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Checking segment: {'id': 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:54.958301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.958711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Bound using segment: {'id': 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:54.959577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Bound port: b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 199, 'network_id': '11f1dfa5-c8f4-41e4-a211-395fe5e38d6d'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:54.960014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:54.996245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-573898823', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:55.012731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Made reservation on behalf of 1f9bf64d67774d1fb7ab8d25db416cdd for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:55.016245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.044451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.059353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.062529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:55.070333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.085794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:55.088552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a7b7a49-e5ad-4326-814a-6da4601d363b None None] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:55.093604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Port': ['ID=b5a1051b-b1ae-4bca-9242-3f18b569051d,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:55.099505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for a835a7d4-261f-469f-bff4-21655c16b962 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:55.102774 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-d2b4b155-83af-4f09-9717-4106f9c08f09 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3160903 Nov 24 04:13:55.110227 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-77a15600-fabb-46b3-ab58-f528e4b66d1d req-8f8be80c-d736-40d7-94d6-064cd94e26c3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1672742 Nov 24 04:13:55.192774 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-138d725e-138c-41c4-b86d-01bf5f244482 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/floatingips/06a6cce1-4f72-4389-a050-43d496e8504b HTTP/1.1" status: 200 len: 991 time: 0.4331372 Nov 24 04:13:55.193686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.194866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.216738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9dcdf10b-5145-4156-bc6b-d86bc7d7a9fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.250697 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ec457a01-20ac-4b97-879f-624a1c3c20ea req-e950657c-5d2c-427a-ac14-5758b3c471b5 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1396205 Nov 24 04:13:55.275355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26aa7f6c-485f-4a13-a097-744803530749'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:13:55.278450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28c8e340-0fb0-4041-98f4-6e9f1352ac0e" -d '{"events": [{"server_uuid": "f7a44151-8384-4ee1-997e-6273cc167dcc", "name": "network-vif-plugged", "status": "completed", "tag": "26aa7f6c-485f-4a13-a097-744803530749"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:13:55.283785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.293500 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 0ba4d396-6d70-4078-91ef-27d8b0f3a544, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0ba4d396-6d70-4078-91ef-27d8b0f3a544,segment=NetworkSegment(7f09a149-4996-45d5-b48e-737d19b25a86),segment_id=7f09a149-4996-45d5-b48e-737d19b25a86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:55.320819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=a835a7d4-261f-469f-bff4-21655c16b962,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:55.326476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.329982 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d1ced5f7-c07b-4e4b-a88b-aac1bad88569 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/a835a7d4-261f-469f-bff4-21655c16b962 HTTP/1.1" status: 204 len: 168 time: 0.9493639 Nov 24 04:13:55.333227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34318) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:55.339323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'mac_address': 'fa:16:3e:b8:99:00', 'name': 'tempest-PortsTestJSON-1357860186'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:55.346437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:13:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34efde28-51d6-454a-a3bf-ea979944761b x-openstack-request-id: req-34efde28-51d6-454a-a3bf-ea979944761b {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:13:55.347011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7a44151-8384-4ee1-997e-6273cc167dcc", "name": "network-vif-plugged", "status": "completed", "tag": "26aa7f6c-485f-4a13-a097-744803530749", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:13:55.347011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-34efde28-51d6-454a-a3bf-ea979944761b {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:13:55.347351 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26aa7f6c-485f-4a13-a097-744803530749', 'code': 200} Nov 24 04:13:55.371271 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.372178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.381698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 26aa7f6c-485f-4a13-a097-744803530749, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=26aa7f6c-485f-4a13-a097-744803530749,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:55.386281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.389894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.403177 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.436942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.456734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] For port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:55.463826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] For port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,segment=NetworkSegment(ba42279c-dd7e-4fcc-8353-a5b31ec18c2f),segment_id=ba42279c-dd7e-4fcc-8353-a5b31ec18c2f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:55.465988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4520c5d-8714-4382-b447-66561e7fc1ff,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:55.482431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:55.482843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] vlan segment allocate from pool success with {'vlan_id': 172, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:55.494771 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Router cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:13:55.500411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.501815 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a976ee2a-b0af-48f3-9aa8-a5ee7c5fb5a7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.5104651 Nov 24 04:13:55.505135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34320) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:55.510354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764', 'name': 'tempest-PortsIpV6TestJSON-1803053041'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:55.531403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.531403 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Added segment 3d6fe194-5d56-4d69-bb30-b0e96721fe3f of type vlan for network acefce04-02aa-44cc-bb30-373d1b065eae Nov 24 04:13:55.534894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.563740 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=0ba4d396-6d70-4078-91ef-27d8b0f3a544,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:55.593178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.648093 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port aea05420-a946-419d-ab0d-e1d16255463e yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:55.672938 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-9dcdf10b-5145-4156-bc6b-d86bc7d7a9fa None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:13:55.672938 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-9dcdf10b-5145-4156-bc6b-d86bc7d7a9fa None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:13:55.700350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9a9c3550-dec4-4809-99cc-544480ef2b10 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:55.704171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.742271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:13:55.744407 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-cacc841c-d9b0-42a7-bd1a-b11bf3bbe764', 'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': '5334ecdc-83a8-40ec-b5bc-7747649eb177'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:13:55.745284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.756180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0b7c2ad9-51d8-4e6c-9f64-98d52d89a775 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5451546 Nov 24 04:13:55.763357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34322) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:55.774161 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] Sync routers for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:13:55.791215 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:55.793741 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:55.838245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.839367 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:55.840065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.859145 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:55.873608 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:13:55.875298 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:55.892016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:55.940363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.002566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:56.006675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.012045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eb2c062-0d82-46d8-8f09-79185a62c06d req-a4b02fed-1734-4283-81ac-893c9ddaf0bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:56.013833 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5eb2c062-0d82-46d8-8f09-79185a62c06d req-a4b02fed-1734-4283-81ac-893c9ddaf0bf service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 1099 time: 0.4249203 Nov 24 04:13:56.052496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:56.073463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=aea05420-a946-419d-ab0d-e1d16255463e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:56.076561 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.4514203 Nov 24 04:13:56.077920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea3790a-9671-49b3-ab40-0549c25b5612 admin admin] Pushing event updated for resources: {'Network': ['ID=acefce04-02aa-44cc-bb30-373d1b065eae,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:56.080301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:56.081052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34324) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:56.087930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:56.095055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:56.095690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.136869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Request body: {'subnet': {'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-850279203-subnet', 'tenant_id': '1f9bf64d67774d1fb7ab8d25db416cdd', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:56.153492 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:13:56.154316 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29979feb-531d-458f-9a72-af01da96bc10 None None] The sync data for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:13:56.176866 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b2bd84b1-662e-407e-b922-74a47afff736 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 0.8424935 Nov 24 04:13:56.181272 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5eb2c062-0d82-46d8-8f09-79185a62c06d req-a37b24ac-d364-45c4-a205-587b9a00f039 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1556849 Nov 24 04:13:56.181766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34328) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:56.200053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34330) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:56.217006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Made reservation on behalf of 1f9bf64d67774d1fb7ab8d25db416cdd for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:56.219099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.248007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network acefce04-02aa-44cc-bb30-373d1b065eae details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:56.260051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=26aa7f6c-485f-4a13-a097-744803530749,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:56.291399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port eea4d3fb-42bc-46b3-9231-afedebcafe11 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:56.298080 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7ced6ba-f436-4cb6-ba03-7a8dd9a52f4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:56.299822 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e7ced6ba-f436-4cb6-ba03-7a8dd9a52f4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/aea05420-a946-419d-ab0d-e1d16255463e HTTP/1.1" status: 200 len: 841 time: 0.1170251 Nov 24 04:13:56.302502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34332) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:56.356994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Allocated IP 2001:db8::2 (cacc841c-d9b0-42a7-bd1a-b11bf3bbe764/5334ecdc-83a8-40ec-b5bc-7747649eb177/9d7a5db2-85b9-4720-8f66-aab0dc4edca7) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:56.362367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c2fa7fc-9ae0-4e1d-aa0e-5722f4f18083 req-5d12d36e-09c8-4cb6-bc1c-288196ea347f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:56.364106 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3c2fa7fc-9ae0-4e1d-aa0e-5722f4f18083 req-5d12d36e-09c8-4cb6-bc1c-288196ea347f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.1165524 Nov 24 04:13:56.444211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd271e64-b491-4938-bebc-f4eda18d71f6 None None] Pushing event updated for resources: {'Port': ['ID=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:56.462101 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3c2fa7fc-9ae0-4e1d-aa0e-5722f4f18083 req-61d35173-1c2d-47f2-beea-76742fc279ac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0791519 Nov 24 04:13:56.475624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port aea05420-a946-419d-ab0d-e1d16255463e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:56.476075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.551046 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.565247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for aea05420-a946-419d-ab0d-e1d16255463e owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:56.605695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 9a9c3550-dec4-4809-99cc-544480ef2b10 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:56.605920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.675898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Provisioning complete for port 9a9c3550-dec4-4809-99cc-544480ef2b10 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:56.676277 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.780007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.808383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.824722 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c106aa71-12ce-4248-b256-e2c0804de00f tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/floatingips/06a6cce1-4f72-4389-a050-43d496e8504b HTTP/1.1" status: 200 len: 993 time: 0.6192188 Nov 24 04:13:56.928373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.930383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Pushing event updated for resources: {'Port': ['ID=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:56.937289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:56.989421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:57.006952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:57.014080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:57.061467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] For port 9a9c3550-dec4-4809-99cc-544480ef2b10, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9a9c3550-dec4-4809-99cc-544480ef2b10,segment=NetworkSegment(fab7ed6a-d5e3-4dc3-8358-3207cf426ebf),segment_id=fab7ed6a-d5e3-4dc3-8358-3207cf426ebf)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:57.084555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.097340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.133935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::352 (cacc841c-d9b0-42a7-bd1a-b11bf3bbe764/5334ecdc-83a8-40ec-b5bc-7747649eb177/eea4d3fb-42bc-46b3-9231-afedebcafe11) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:13:57.143380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=aea05420-a946-419d-ab0d-e1d16255463e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:57.149487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.152883 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1fac32fd-8339-4a7a-987a-ebeaaac1f273 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/aea05420-a946-419d-ab0d-e1d16255463e HTTP/1.1" status: 204 len: 168 time: 0.8493505 Nov 24 04:13:57.160472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34334) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:57.183249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Attempting to bind port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:13:57.183641 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Attempting to bind port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '2c036b21-57f7-492c-881b-8a1d86aa9841', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:13:57.184013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Attempting to bind port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 on network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:13:57.192623 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0d0a59ef-d20c-45e1-9246-ceb285de6b61 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:13:57.197811 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0d0a59ef-d20c-45e1-9246-ceb285de6b61 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/aea05420-a946-419d-ab0d-e1d16255463e HTTP/1.1" status: 404 len: 333 time: 0.0328643 Nov 24 04:13:57.198448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34336) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:57.203610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Provisioning complete for port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:57.203941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'name': 'tempest-PortsTestJSON-1235523767'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:57.204077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.267450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:13:57.267779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Checking segment: {'id': '2c036b21-57f7-492c-881b-8a1d86aa9841', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:57.268195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.268600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Bound using segment: {'id': '2c036b21-57f7-492c-881b-8a1d86aa9841', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:13:57.269100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Bound port: 9d7a5db2-85b9-4720-8f66-aab0dc4edca7, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c036b21-57f7-492c-881b-8a1d86aa9841', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 192, 'network_id': 'cacc841c-d9b0-42a7-bd1a-b11bf3bbe764'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:13:57.269556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.276313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:13:57.276675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:13:57.311087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e69d8bee-c98a-4425-94b6-63aa1712e305 None None] Pushing event updated for resources: {'Port': ['ID=9a9c3550-dec4-4809-99cc-544480ef2b10,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:57.390132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] For port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:13:57.394420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] For port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,segment=NetworkSegment(2c036b21-57f7-492c-881b-8a1d86aa9841),segment_id=2c036b21-57f7-492c-881b-8a1d86aa9841)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:13:57.399888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c06ce3e-deeb-40c6-8064-53b5a9319515 None None] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:57.405981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:57.411622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.415548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.432543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 78e76925-963c-4476-8263-9b3a7695dc84 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:13:57.515019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.517283 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-e0440dcf-8e4f-4c21-b443-05d064883363 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:13:57.522200 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0440dcf-8e4f-4c21-b443-05d064883363 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.7584026 Nov 24 04:13:57.523873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34340) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:57.537926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.571027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df892a4-fe0f-4b4b-b763-b1ec70609402 None None] Pushing event updated for resources: {'Port': ['ID=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:57.693410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Provisioning complete for port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:57.693784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.697878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=16303810-2955-433b-bb61-fa9692bb82ad,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:57.705016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.750966 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c73cf0e5-d7b2-4ebf-bf45-6a631e0d0369 req-d337e539-f839-4da7-bc7d-9c4b7b7cc88d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:57.752067 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c73cf0e5-d7b2-4ebf-bf45-6a631e0d0369 req-d337e539-f839-4da7-bc7d-9c4b7b7cc88d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.1441212 Nov 24 04:13:57.755785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Checking segment: {'id': '3d6fe194-5d56-4d69-bb30-b0e96721fe3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:13:57.756151 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Network hostable DHCP agents. Network: acefce04-02aa-44cc-bb30-373d1b065eae, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:13:57.773514 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:57.784320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:57.798480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:57.808029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:57.808710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.819280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=eea4d3fb-42bc-46b3-9231-afedebcafe11,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:57.833394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Network acefce04-02aa-44cc-bb30-373d1b065eae is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:13:57.852847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.863868 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-80bb2eb6-6248-4e4c-92bd-2c577f1eb98e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.3545179 Nov 24 04:13:57.867786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34342) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:57.900200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:57.993092 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, acefce04-02aa-44cc-bb30-373d1b065eae) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:57.997962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] For port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,segment=NetworkSegment(ba42279c-dd7e-4fcc-8353-a5b31ec18c2f),segment_id=ba42279c-dd7e-4fcc-8353-a5b31ec18c2f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:57.998385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.003931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8debe094-c063-4f7f-85b1-47c654dbc568 None None] Network acefce04-02aa-44cc-bb30-373d1b065eae requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:58.026621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:58.027226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.058420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:13:58.061967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:13:58.062974 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.065160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:13:58.070974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:58.071787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.123909 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 0.9219303 Nov 24 04:13:58.126440 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34344) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:58.136835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:58.144088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12bb6ce3-aa8f-4d42-986f-835aaece367c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=78e76925-963c-4476-8263-9b3a7695dc84,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:58.205699 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c73cf0e5-d7b2-4ebf-bf45-6a631e0d0369 req-4d5bda7f-0e65-4826-998b-2367feefdf14 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3920000 Nov 24 04:13:58.233405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Provisioning complete for port 9a9c3550-dec4-4809-99cc-544480ef2b10 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:58.233896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.237727 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ef384f22-4183-4fe5-b0f1-7a55c32c5bb1 admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.1100864 Nov 24 04:13:58.250051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.254492 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.327692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:58.399591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Pushing event updated for resources: {'Port': ['ID=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:58.500406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.509681 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69125beb-a0ab-47ff-a22d-faf488299d1e req-1eb7a13b-57f4-4cc3-9d8e-0b7144c6646e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:58.511338 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-69125beb-a0ab-47ff-a22d-faf488299d1e req-1eb7a13b-57f4-4cc3-9d8e-0b7144c6646e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.1421406 Nov 24 04:13:58.519455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4324fa35-6192-456c-ac6b-ca5b77a35940 None None] Network acefce04-02aa-44cc-bb30-373d1b065eae requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:58.560061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:58.560434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.730906 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-69125beb-a0ab-47ff-a22d-faf488299d1e req-79ccb595-0016-4fa3-91fc-84c436b0cd5f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1754708 Nov 24 04:13:58.859290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.887818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Provisioning complete for port b5a1051b-b1ae-4bca-9242-3f18b569051d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:58.888563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.910533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.928407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] In _notify_port_updated(), no bound segment for port 78e76925-963c-4476-8263-9b3a7695dc84 on network a288e794-7129-48ec-b278-2ea8bf1fe00e {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:13:58.934038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:58.934756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:58.938868 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/ports/78e76925-963c-4476-8263-9b3a7695dc84 HTTP/1.1" status: 200 len: 818 time: 0.8081822 Nov 24 04:13:58.940900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34364) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:58.956488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f67ecdfd-4855-4f1e-adc3-b08d1a7db7bc None None] Port b5a1051b-b1ae-4bca-9242-3f18b569051d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:13:59.010507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting port b5a1051b-b1ae-4bca-9242-3f18b569051d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:59.010852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.015475 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd1e490-ea32-4ac2-a54b-561df865445e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=78e76925-963c-4476-8263-9b3a7695dc84,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.103907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.122508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34368) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:59.131766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1629926310-network', 'tenant_id': 'b489f05684494105afe242125c1c12c4'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:59.145838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1d804682-a509-48c1-a048-d95fe58f3a68 None None] Provisioning complete for port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:59.146549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1d804682-a509-48c1-a048-d95fe58f3a68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.149132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.165704 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.167363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.192323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Calling delete_port for b5a1051b-b1ae-4bca-9242-3f18b569051d owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:59.194087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,segment=NetworkSegment(2c036b21-57f7-492c-881b-8a1d86aa9841),segment_id=2c036b21-57f7-492c-881b-8a1d86aa9841)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:13:59.194326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Made reservation on behalf of b489f05684494105afe242125c1c12c4 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:13:59.196876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.203467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.204269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0ba4d396-6d70-4078-91ef-27d8b0f3a544 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:59.215010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.249401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 78e76925-963c-4476-8263-9b3a7695dc84 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:13:59.250269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.254093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0fb3444-d374-41ba-a801-183dd3e0b2ac None None] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:13:59.326338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=eea4d3fb-42bc-46b3-9231-afedebcafe11,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.374008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.401631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.410331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.418382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.424538 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:59.424931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.452669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] vlan segment allocate from pool success with {'vlan_id': 175, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:13:59.456189 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 78e76925-963c-4476-8263-9b3a7695dc84 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:13:59.497161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ba7d7e7-e777-4b67-9643-5b6f62746761,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.502714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.503069 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Added segment 4c9112c2-9ccd-4c5f-b77c-702b7a00d4b2 of type vlan for network 78868d08-ded4-49d9-b11d-39b526ef8dd7 Nov 24 04:13:59.537135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.556035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.560024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.580344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:59.582036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5bfcdff4-5399-4b80-a04a-d7b93dcd4954 None None] Provisioning complete for port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:59.582440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5bfcdff4-5399-4b80-a04a-d7b93dcd4954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.611071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Port': ['ID=b5a1051b-b1ae-4bca-9242-3f18b569051d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.663443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.664408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:13:59.665159 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.686739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:59.687070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.693208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.746391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.747258 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6220028 Nov 24 04:13:59.752587 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/78e76925-963c-4476-8263-9b3a7695dc84 HTTP/1.1" status: 204 len: 168 time: 0.8033373 Nov 24 04:13:59.752587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34370) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:59.752587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.759907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Request body: {'subnet': {'network_id': '78868d08-ded4-49d9-b11d-39b526ef8dd7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1629926310-subnet', 'tenant_id': 'b489f05684494105afe242125c1c12c4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:13:59.763206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34372) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:13:59.764945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4f0a87-4fc4-47e3-bb9b-6a5093b7302d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=78e76925-963c-4476-8263-9b3a7695dc84,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.823874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9a9c3550-dec4-4809-99cc-544480ef2b10 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:13:59.852515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655b7012-2b30-4590-b9bf-58452d92855d admin admin] Pushing event updated for resources: {'Network': ['ID=78868d08-ded4-49d9-b11d-39b526ef8dd7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:13:59.869073 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 78868d08-ded4-49d9-b11d-39b526ef8dd7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:13:59.971679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:13:59.976949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 9a9c3550-dec4-4809-99cc-544480ef2b10 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:13:59.977460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.089018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Made reservation on behalf of b489f05684494105afe242125c1c12c4 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:00.091370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.105999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2c6c573d-9f6e-44f9-94ca-cf784afe118d None None] Provisioning complete for port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:00.106603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c6c573d-9f6e-44f9-94ca-cf784afe118d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.166450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74bb55f9-a34b-4c57-a61e-22f558ecb156 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:00.170842 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-74bb55f9-a34b-4c57-a61e-22f558ecb156 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.3998585 Nov 24 04:14:00.172819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34374) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:00.225041 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-9660c426-3f98-4156-a910-b19cf0646c9d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:00.226546 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9660c426-3f98-4156-a910-b19cf0646c9d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/78e76925-963c-4476-8263-9b3a7695dc84 HTTP/1.1" status: 404 len: 333 time: 0.0508661 Nov 24 04:14:00.231631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34376) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:00.240464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-64384840'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:00.253244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Router cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:00.272700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:00.279375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2c6c573d-9f6e-44f9-94ca-cf784afe118d None None] Provisioning complete for port eea4d3fb-42bc-46b3-9231-afedebcafe11 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:00.280225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c6c573d-9f6e-44f9-94ca-cf784afe118d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.306611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34378) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:00.309293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.314237 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:00.319573 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.358350 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.359058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.359502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2c6c573d-9f6e-44f9-94ca-cf784afe118d None None] Port eea4d3fb-42bc-46b3-9231-afedebcafe11 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:00.384784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:00.385996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.417161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 168, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:00.433784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:00.447005 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-64fe91d8-87e0-4516-837a-a8ca6ddc55de tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9218423 Nov 24 04:14:00.447685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34380) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:00.456518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] Sync routers for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:00.506089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=eea4d3fb-42bc-46b3-9231-afedebcafe11,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:00.506368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:00.507961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:00.509136 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-84f9b4b7-a484-40dd-ad2e-be6cd4e0dd68 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] delete failed (client error): The resource could not be found. Nov 24 04:14:00.516907 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-84f9b4b7-a484-40dd-ad2e-be6cd4e0dd68 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/routers/tempest-non_exist_router-1379794739 HTTP/1.1" status: 404 len: 335 time: 0.0661547 Nov 24 04:14:00.527135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34382) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:00.531623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a2b9c926-5958-47ed-8c64-6ab38a0f62b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'router': {'external_gateway_info': {'network_id': 'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:00.531812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.532065 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment db17eb1c-7ff3-4579-a58a-69fd568abbbc of type vlan for network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b Nov 24 04:14:00.566414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f1220984-32e2-4c5e-ac05-6f189fa8edd2 None None] Provisioning complete for port eea4d3fb-42bc-46b3-9231-afedebcafe11 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:00.567032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f1220984-32e2-4c5e-ac05-6f189fa8edd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.571844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:00.613841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.650349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:00.651227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:00.664969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.694572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:00.699036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:00.699950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2b66a99-718f-4759-afe6-fc06e6c431a0 None None] The sync data for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:00.719673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:00.744969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:00.753622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Pushing event updated for resources: {'Subnet': ['ID=e57451b9-29ef-4d61-b156-8d23758eeccd,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:00.760403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Checking segment: {'id': '4c9112c2-9ccd-4c5f-b77c-702b7a00d4b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '78868d08-ded4-49d9-b11d-39b526ef8dd7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:00.760776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Network hostable DHCP agents. Network: 78868d08-ded4-49d9-b11d-39b526ef8dd7, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:00.801190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f1220984-32e2-4c5e-ac05-6f189fa8edd2 None None] Port eea4d3fb-42bc-46b3-9231-afedebcafe11 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:00.803456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.809623 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:00.810354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.865713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:00.866188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.920228 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=fc5dc081-8d2b-45b2-99dd-22f6f2daf05b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:00.939793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:00.950064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Network 78868d08-ded4-49d9-b11d-39b526ef8dd7 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:00.961294 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-de73acc7-1a21-469b-9f56-553c020b98ff tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.7279677 Nov 24 04:14:00.964418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34384) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:00.973170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:00.977193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 78868d08-ded4-49d9-b11d-39b526ef8dd7) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:00.992320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:00.992918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:00.998508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-432c6971-3756-4c71-9333-6b2fae57aa6c None None] Network 78868d08-ded4-49d9-b11d-39b526ef8dd7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:01.050208 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2143c366-3d42-4989-832b-b49534883bda admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2922289 Nov 24 04:14:01.153453 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Router 15d9eb56-ed2f-4b2a-a33f-480074b7cf5a is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:14:01.161126 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-fd7c8972-e8d6-427f-a1e9-960d6d83744f None None] Provisioning complete for port eea4d3fb-42bc-46b3-9231-afedebcafe11 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:01.161824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd7c8972-e8d6-427f-a1e9-960d6d83744f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:01.170806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:01.174783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:01.286410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fd7c8972-e8d6-427f-a1e9-960d6d83744f None None] Port eea4d3fb-42bc-46b3-9231-afedebcafe11 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:01.292113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:01.302990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a2b9c926-5958-47ed-8c64-6ab38a0f62b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:01.303621 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] Sync routers for ids ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:01.314012 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] Routers {'15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:01.315750 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:01.351256 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:01.361334 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] Routers {'15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:01.362734 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:01.380410 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-a2b9c926-5958-47ed-8c64-6ab38a0f62b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] update failed (client error): The resource could not be found. Nov 24 04:14:01.386557 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a2b9c926-5958-47ed-8c64-6ab38a0f62b4 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 HTTP/1.1" status: 404 len: 339 time: 0.8582330 Nov 24 04:14:01.387849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34390) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:01.404489 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:01.411959 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83f27fb9-648f-43c7-8180-0be9a900428b None None] The sync data for ids ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:01.421264 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7f86e389-f935-4333-a482-8437b9e51817 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/routers/15d9eb56-ed2f-4b2a-a33f-480074b7cf5a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5495245 Nov 24 04:14:01.421264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34396) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:01.437662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a47db9a-0df2-40f3-a6ad-423e56c41214 None None] Network 78868d08-ded4-49d9-b11d-39b526ef8dd7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:01.508774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-02b74a08-1bc7-4000-872c-8aca4701cc17 None None] Provisioning complete for port eea4d3fb-42bc-46b3-9231-afedebcafe11 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:01.508774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-02b74a08-1bc7-4000-872c-8aca4701cc17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:01.522123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dc5deef-3be1-4863-895c-bca8c1288431 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:01.526666 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9dc5deef-3be1-4863-895c-bca8c1288431 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports?device_id=15d9eb56-ed2f-4b2a-a33f-480074b7cf5a HTTP/1.1" status: 200 len: 989 time: 0.1019363 Nov 24 04:14:01.550402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34398) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:01.590074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-02b74a08-1bc7-4000-872c-8aca4701cc17 None None] Port eea4d3fb-42bc-46b3-9231-afedebcafe11 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:01.896411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.032225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.185191 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=dc62de2c-9577-40a7-b660-29d60bf1e5d7,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:02.252728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Allocated IP 172.20.0.1 (c20f17de-37f4-4dcf-bfbd-752fa5e6d356/5e77e950-2995-470e-aa0c-d18cbefa4711/d97555d5-7803-44ef-8c43-bdd87a8cc7a1) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:02.274563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.325269 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-db08e811-eebd-4249-afc3-39c7c9e52840 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:02.327168 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-db08e811-eebd-4249-afc3-39c7c9e52840 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/networks?id=acefce04-02aa-44cc-bb30-373d1b065eae HTTP/1.1" status: 200 len: 811 time: 0.6343725 Nov 24 04:14:02.328346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': 'db17eb1c-7ff3-4579-a58a-69fd568abbbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:02.328904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: fc5dc081-8d2b-45b2-99dd-22f6f2daf05b, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:02.393110 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-dffaddf1-0ce9-47f0-b48c-c7a6332fa503 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/quotas/1f9bf64d67774d1fb7ab8d25db416cdd HTTP/1.1" status: 200 len: 375 time: 0.0574038 Nov 24 04:14:02.415951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:02.467308 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-bf1203aa-115f-4040-ba88-cf62aa345e6a tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=1f9bf64d67774d1fb7ab8d25db416cdd&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0650728 Nov 24 04:14:02.468022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.482629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, fc5dc081-8d2b-45b2-99dd-22f6f2daf05b) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:02.493488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:02.493920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.496573 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af880367-1551-4b95-9d98-1d270ed823df None None] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:02.555280 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-032fc357-530f-47da-b02b-3522a862a1f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5896969 Nov 24 04:14:02.559147 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34410) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:02.566921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:02.588010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.642764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:02.654447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:02.659989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:02.662227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Port': ['ID=d97555d5-7803-44ef-8c43-bdd87a8cc7a1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:02.726517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': 'dc62de2c-9577-40a7-b660-29d60bf1e5d7'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:02.727114 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.741726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.798159 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.17 (61fb4de4-ff65-42d0-aed9-c58e7caab600/b58537d8-e9f8-43e0-92cb-52a12f3fe9d6/b8985b51-3822-48f2-b6c3-2c24bd2cfbc3) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:02.880897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Allocated IP 172.20.0.2 (fc5dc081-8d2b-45b2-99dd-22f6f2daf05b/dc62de2c-9577-40a7-b660-29d60bf1e5d7/8e194228-35be-4708-9c68-6375ba04f14c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:02.881703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.923037 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-1436a87c-a9a1-4431-99fd-262ecbc73218 service neutron] 10.222.0.48 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4459357 Nov 24 04:14:02.959400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:02.962719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:02.991201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.061103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.086381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.092585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.132588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:03.137155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:03.145121 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:03.186953 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet dc62de2c-9577-40a7-b660-29d60bf1e5d7 (CIDR: 172.20.0.0/28) Nov 24 04:14:03.187796 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eadf2704-1b95-41d7-855a-f47a49e94945 None None] Provisioning complete for port d97555d5-7803-44ef-8c43-bdd87a8cc7a1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:03.188131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eadf2704-1b95-41d7-855a-f47a49e94945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.189707 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-a215e652-b856-4fac-8a6e-83582a38c004 service neutron] 10.222.0.48 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2398176 Nov 24 04:14:03.189851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Pushing event updated for resources: {'Port': ['ID=8e194228-35be-4708-9c68-6375ba04f14c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:03.193278 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:03.194121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:03.217409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.224873 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5d9fd2bc-dea8-4f58-8b61-a19fb7822958 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6643560 Nov 24 04:14:03.226846 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34412) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:03.231874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:03.241664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Attempting to bind port 8e194228-35be-4708-9c68-6375ba04f14c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:03.242012 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Attempting to bind port 8e194228-35be-4708-9c68-6375ba04f14c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'db17eb1c-7ff3-4579-a58a-69fd568abbbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:03.242409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Attempting to bind port 8e194228-35be-4708-9c68-6375ba04f14c on network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:03.249936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:03.250317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Checking segment: {'id': 'db17eb1c-7ff3-4579-a58a-69fd568abbbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:03.250982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.251092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Bound using segment: {'id': 'db17eb1c-7ff3-4579-a58a-69fd568abbbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:03.251574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Bound port: 8e194228-35be-4708-9c68-6375ba04f14c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db17eb1c-7ff3-4579-a58a-69fd568abbbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 168, 'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:03.251991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.279348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eadf2704-1b95-41d7-855a-f47a49e94945 None None] Port d97555d5-7803-44ef-8c43-bdd87a8cc7a1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:03.329688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:03.337463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] For port 8e194228-35be-4708-9c68-6375ba04f14c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:03.341494 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:03.344076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:03.354348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] For port 8e194228-35be-4708-9c68-6375ba04f14c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8e194228-35be-4708-9c68-6375ba04f14c,segment=NetworkSegment(db17eb1c-7ff3-4579-a58a-69fd568abbbc),segment_id=db17eb1c-7ff3-4579-a58a-69fd568abbbc)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:03.360372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:03.371481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.386558 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:14:03.393777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:03.397397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.484905 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.561568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port eea4d3fb-42bc-46b3-9231-afedebcafe11 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:03.562064 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.579439 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-01497280-cc29-454a-a680-ab3fd3f30a9f req-997b16ea-8bb6-4745-8199-94638a481069 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 210 time: 0.1092260 Nov 24 04:14:03.612292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.626024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.706330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event updated for resources: {'Port': ['ID=d97555d5-7803-44ef-8c43-bdd87a8cc7a1,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:03.728134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.768046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675417cf-0677-42d7-a950-c67a4ce82eca None None] Pushing event updated for resources: {'Port': ['ID=8e194228-35be-4708-9c68-6375ba04f14c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:03.776910 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for eea4d3fb-42bc-46b3-9231-afedebcafe11 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:03.777151 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-09a5a4d3-9cef-4328-9422-5aba3a4a72d6 None None] Provisioning complete for port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:03.777442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09a5a4d3-9cef-4328-9422-5aba3a4a72d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.814704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-09a5a4d3-9cef-4328-9422-5aba3a4a72d6 None None] Port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:03.845325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.860800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.890102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:03.960672 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:03.973768 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:03.978794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:03.979419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:04.004165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=05dba9df-3609-4d18-ab51-84036eec15e8,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:04.024396 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6a5cc304-5c45-43d7-964e-18ba96d311bc tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.7964540 Nov 24 04:14:04.028101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34424) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:04.039068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'fixed_ips': [{'subnet_id': 'dc62de2c-9577-40a7-b660-29d60bf1e5d7'}, {'subnet_id': '05dba9df-3609-4d18-ab51-84036eec15e8'}], 'name': 'tempest-PortsTestJSON-927428419'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:04.096884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:04.127092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:04.135565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=eea4d3fb-42bc-46b3-9231-afedebcafe11,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:04.284850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:04.486797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Router 15d9eb56-ed2f-4b2a-a33f-480074b7cf5a has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:04.558488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:04.574320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:04.583372 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-164214c2-d8d2-4498-b06e-1ffeff455eed tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/routers/15d9eb56-ed2f-4b2a-a33f-480074b7cf5a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0316136 Nov 24 04:14:04.583800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34426) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:04.587363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] Sync routers for ids ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:04.601084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] Routers {'15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:04.601994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:04.608195 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-553b6878-04ab-4e9e-8669-caeccb24de51 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:14:04.613499 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-553b6878-04ab-4e9e-8669-caeccb24de51 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/eea4d3fb-42bc-46b3-9231-afedebcafe11 HTTP/1.1" status: 404 len: 333 time: 0.0286646 Nov 24 04:14:04.614125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34428) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:04.710217 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:04.729016 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] Routers {'15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:04.729682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:04.782635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:04.784397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5e7903d-bb86-48c2-9d24-1a5796cdc610 None None] The sync data for ids ['15d9eb56-ed2f-4b2a-a33f-480074b7cf5a'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:04.847589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Router cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:04.859898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:04.966388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0c5620a9-59d8-44f9-8fbe-0729c4102ef7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:04.996247 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8f7201d8-7b58-46e5-bc85-4ed454eb1fef None None] Provisioning complete for port d97555d5-7803-44ef-8c43-bdd87a8cc7a1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:04.996657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8f7201d8-7b58-46e5-bc85-4ed454eb1fef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.061872 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8f7201d8-7b58-46e5-bc85-4ed454eb1fef None None] Port d97555d5-7803-44ef-8c43-bdd87a8cc7a1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:05.185183 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-63946293-63e4-4650-8122-2390ebbbd8b0 req-8f0f4f1a-6b00-44af-b9a4-d19cfa1ec75f tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 210 time: 0.0356512 Nov 24 04:14:05.188135 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.194745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.209876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.217988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-a16dcfc9-5e6d-440c-b985-53029e4e0b78 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:05.219686 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-a16dcfc9-5e6d-440c-b985-53029e4e0b78 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.21 "GET /v2.0/networks?id=acefce04-02aa-44cc-bb30-373d1b065eae HTTP/1.1" status: 200 len: 811 time: 0.3746583 Nov 24 04:14:05.223805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.269815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Request body: {'port': {'device_id': '603e8bd7-e303-481c-aac8-5f973041c636', 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae', 'admin_state_up': True, 'tenant_id': '1f9bf64d67774d1fb7ab8d25db416cdd'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:05.280497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:05.294745 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] Sync routers for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:05.313668 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:05.315272 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:05.329878 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-75689460-d265-4b60-9b17-83db216277e8 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9360025 Nov 24 04:14:05.331438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 5719781e-a80c-456c-9263-d3a80027d91f yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:05.344871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34436) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:05.362047 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:05.372451 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:05.373496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.374972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.375114 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:05.389687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a763fe9e-ae1d-4a5c-90c9-e7bf450527e3 None None] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:05.420012 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:05.420991 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00b1d5db-2325-49fa-9500-d3975fdfb755 None None] The sync data for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:05.428336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.429389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Fanout notify agent at l3_agent the message router_deleted on router 15d9eb56-ed2f-4b2a-a33f-480074b7cf5a {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:14:05.437560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.438754 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c9323b13-9023-4afa-bd05-e5ac41d524b1 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/routers/15d9eb56-ed2f-4b2a-a33f-480074b7cf5a HTTP/1.1" status: 204 len: 168 time: 0.8236666 Nov 24 04:14:05.441883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34438) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:05.499913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 5334ecdc-83a8-40ec-b5bc-7747649eb177 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:05.503793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.518916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b3375d9a-8204-47eb-93be-3c85f956637b None None] Provisioning complete for port 8e194228-35be-4708-9c68-6375ba04f14c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:05.519308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b3375d9a-8204-47eb-93be-3c85f956637b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.522700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.546918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.550837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-89e8843f-7117-49fe-945f-c66ffc89dc16 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.565420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:05.641157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.653619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b3375d9a-8204-47eb-93be-3c85f956637b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.714740 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.722955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b3375d9a-8204-47eb-93be-3c85f956637b None None] For port 8e194228-35be-4708-9c68-6375ba04f14c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8e194228-35be-4708-9c68-6375ba04f14c,segment=NetworkSegment(db17eb1c-7ff3-4579-a58a-69fd568abbbc),segment_id=db17eb1c-7ff3-4579-a58a-69fd568abbbc)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:05.726750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] Update dhcp port {'port': {'network_id': 'fc5dc081-8d2b-45b2-99dd-22f6f2daf05b', 'fixed_ips': [{'subnet_id': 'dc62de2c-9577-40a7-b660-29d60bf1e5d7', 'ip_address': '172.20.0.2'}, {'subnet_id': '05dba9df-3609-4d18-ab51-84036eec15e8'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '8e194228-35be-4708-9c68-6375ba04f14c'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:14:05.729952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b3375d9a-8204-47eb-93be-3c85f956637b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.747851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=5334ecdc-83a8-40ec-b5bc-7747649eb177,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:05.749967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.756212 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0e1156d9-837f-4b40-97fe-124be8d0b50b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/5334ecdc-83a8-40ec-b5bc-7747649eb177 HTTP/1.1" status: 204 len: 168 time: 0.3132834 Nov 24 04:14:05.756928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34440) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:05.783675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.789155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6772b63-cc46-4743-9669-39ff0348e7c8 None None] Network cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:05.822218 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-89e8843f-7117-49fe-945f-c66ffc89dc16 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 24 04:14:05.823272 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-89e8843f-7117-49fe-945f-c66ffc89dc16 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 HTTP/1.1" status: 409 len: 329 time: 0.4730234 Nov 24 04:14:05.830818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34442) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:05.833108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3375d9a-8204-47eb-93be-3c85f956637b None None] Pushing event updated for resources: {'Port': ['ID=8e194228-35be-4708-9c68-6375ba04f14c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:05.851033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Made reservation on behalf of 1f9bf64d67774d1fb7ab8d25db416cdd for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:05.854936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:05.873696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:05.881629 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:05.914344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.078069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:06.078847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.151150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] DHCP port deletion for cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:06.188038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] For port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,segment=NetworkSegment(2c036b21-57f7-492c-881b-8a1d86aa9841),segment_id=2c036b21-57f7-492c-881b-8a1d86aa9841)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:06.188492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.222379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:06.252586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] Deleting port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:06.252586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.282721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:06.324050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Allocated IP 172.20.0.13 (acefce04-02aa-44cc-bb30-373d1b065eae/16303810-2955-433b-bb61-fa9692bb82ad/ce904412-401d-4df1-801f-c17322c730b9) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:06.331582 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ea24ba16-9537-415a-b4f7-657f11cc8f59 req-d22e5223-34c4-47d6-9b0e-6dd3dbb5ead8 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 210 time: 0.0528512 Nov 24 04:14:06.332612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.11 (fc5dc081-8d2b-45b2-99dd-22f6f2daf05b/dc62de2c-9577-40a7-b660-29d60bf1e5d7/5719781e-a80c-456c-9263-d3a80027d91f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:06.348463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.23 (fc5dc081-8d2b-45b2-99dd-22f6f2daf05b/05dba9df-3609-4d18-ab51-84036eec15e8/5719781e-a80c-456c-9263-d3a80027d91f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:06.360381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] For port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,segment=NetworkSegment(2c036b21-57f7-492c-881b-8a1d86aa9841),segment_id=2c036b21-57f7-492c-881b-8a1d86aa9841)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:06.360809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.362310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.381350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8e194228-35be-4708-9c68-6375ba04f14c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:06.395661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:06.400727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No DVR routers for this DVR port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:06.409031 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.421559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] Calling delete_port for 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:06.428541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-fde59ea0-da34-4043-970c-08f2b2842e53 None None] Provisioning complete for port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:06.429180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fde59ea0-da34-4043-970c-08f2b2842e53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.513770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fde59ea0-da34-4043-970c-08f2b2842e53 None None] Port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:06.549306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8e194228-35be-4708-9c68-6375ba04f14c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:06.550019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.556532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.582359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cacc841c-d9b0-42a7-bd1a-b11bf3bbe764']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:06.586569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.618839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] Pushing event deleted for resources: {'Port': ['ID=9d7a5db2-85b9-4720-8f66-aab0dc4edca7,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:06.623027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2c036b21-57f7-492c-881b-8a1d86aa9841') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:06.623193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2c036b21-57f7-492c-881b-8a1d86aa9841') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:06.624168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af3744ac-29b5-4fb0-818d-a3f9a60308c9 None None] No DVR routers for this DVR port 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:06.651288 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.652529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:06.664218 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-467a7b2c-382f-45fe-b3ab-edb8d43c773a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/0fe6e120-10fd-4f02-8be4-2afcf5422729/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3248758 Nov 24 04:14:06.675729 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.686661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 192 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:06.687103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.691915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:06.708430 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:06.713973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.714697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:06.715553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:13:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:06.728471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.793903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.799280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.815587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.822606 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/cacc841c-d9b0-42a7-bd1a-b11bf3bbe764 HTTP/1.1" status: 204 len: 168 time: 1.0641897 Nov 24 04:14:06.824522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5695d8a0-60b3-4665-a93a-a9dcb39a8cd7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=cacc841c-d9b0-42a7-bd1a-b11bf3bbe764,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:06.828949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34450) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:06.859643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:06.865915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:06.886640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=5719781e-a80c-456c-9263-d3a80027d91f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:06.891674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] Allocated IP 172.20.0.18 (fc5dc081-8d2b-45b2-99dd-22f6f2daf05b/05dba9df-3609-4d18-ab51-84036eec15e8/8e194228-35be-4708-9c68-6375ba04f14c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:06.901583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7341e559-ec88-49fe-8d23-8b8aa43452d7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:06.914218 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7341e559-ec88-49fe-8d23-8b8aa43452d7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/f856284c-e3d7-42b5-b16f-4799edadaa2e HTTP/1.1" status: 200 len: 845 time: 0.0840681 Nov 24 04:14:06.914795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34454) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:06.915875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:06.929175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:06.967430 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8e11145c-7823-4897-bc35-1b5608726189 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/f856284c-e3d7-42b5-b16f-4799edadaa2e?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0481608 Nov 24 04:14:06.975908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34456) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:06.981885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:06.985538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Network acefce04-02aa-44cc-bb30-373d1b065eae is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:06.986111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:06.997818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:07.005295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:07.005945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting port d97555d5-7803-44ef-8c43-bdd87a8cc7a1 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:07.006344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.025458 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:07.025955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d7a5db2-85b9-4720-8f66-aab0dc4edca7 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:07.075920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] For port 8e194228-35be-4708-9c68-6375ba04f14c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8e194228-35be-4708-9c68-6375ba04f14c,segment=NetworkSegment(db17eb1c-7ff3-4579-a58a-69fd568abbbc),segment_id=db17eb1c-7ff3-4579-a58a-69fd568abbbc)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:07.086982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:07.152449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.167851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.184337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.188449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Calling delete_port for d97555d5-7803-44ef-8c43-bdd87a8cc7a1 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:07.206508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:07.210132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.341886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d75c58-dde0-44c1-a0ab-23c0ca13af1e None None] Pushing event updated for resources: {'Port': ['ID=8e194228-35be-4708-9c68-6375ba04f14c,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:07.434111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Pushing event updated for resources: {'Port': ['ID=ce904412-401d-4df1-801f-c17322c730b9,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:07.463672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:03Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:13:06Z', 'revision_number': 1, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b8985b51-3822-48f2-b6c3-2c24bd2cfbc3', 'name': '', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:b5:d6:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 1121, 'fixed_ips': [{'subnet_id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:02Z', 'updated_at': '2021-11-24T04:14:04Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:07.468198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:07.469332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.491833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:14:07.492491 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Updating router 0fe6e120-10fd-4f02-8be4-2afcf5422729 port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:14:07.526347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.540659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:07.541982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.558793 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4102a407-72c7-4b89-8a8a-1ba911ae301f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1004 time: 3.5265360 Nov 24 04:14:07.560241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34462) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:07.573582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'dc62de2c-9577-40a7-b660-29d60bf1e5d7'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:07.576041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.604897 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-74ce1146-5c35-4149-9c33-12dc2f3610e1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3426845 Nov 24 04:14:07.608396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Port': ['ID=d97555d5-7803-44ef-8c43-bdd87a8cc7a1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:07.612743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.617445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac069136-d4f7-4a55-b668-c33cc8cd751b req-e0923ca3-8faf-4d71-b271-7d7c23021f5a tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:07.625118 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ac069136-d4f7-4a55-b668-c33cc8cd751b req-e0923ca3-8faf-4d71-b271-7d7c23021f5a tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 932 time: 0.1391749 Nov 24 04:14:07.645205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Request body: {'port': {'device_id': '603e8bd7-e303-481c-aac8-5f973041c636', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:07.662437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:07.687227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:07.737205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:07.737825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.758361 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ac069136-d4f7-4a55-b668-c33cc8cd751b req-3d21d40c-30c3-4a23-b4b3-3206dfb357d1 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1322825 Nov 24 04:14:07.776023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=0d87b69d-e133-4dca-9dc7-1a72f89ecfa6,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:07.793767 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8b4ef581-3290-40bd-870c-de92349d7552 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8109565 Nov 24 04:14:07.793911 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34464) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:07.801319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'security_group': {'name': 'tempest-secgroup-940757465'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:07.840596 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72d1b9ed-4ab6-460b-9d41-84aff028697c None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:07.861737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.878636 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.892140 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:07.910198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.070222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4ed268b1-5fdf-4e7c-8ec3-a1152e9c4ef2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.095978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Router cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:08.178943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f4784bd-a3b8-43aa-8019-aa3ac57c10b3 None None] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:08.186507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:08.203986 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] Sync routers for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:08.207675 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7ffd1c6f-56be-4443-a383-4a193d6d28e5 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3759444 Nov 24 04:14:08.212840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34466) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:08.215302 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:08.215710 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:08.252275 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:08.261464 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] Routers {'cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:08.262394 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:08.263892 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-dd0b6215-9fef-45ad-97d2-4a92840cd4f7 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] show failed (client error): The resource could not be found. Nov 24 04:14:08.270476 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dd0b6215-9fef-45ad-97d2-4a92840cd4f7 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "GET /v2.0/routers/tempest-non_exist_router-1128116487 HTTP/1.1" status: 404 len: 335 time: 0.0565691 Nov 24 04:14:08.271670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34468) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:08.276169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a2b62d41-dc93-4a38-903d-fbb693818a3c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Request body: {'router': {'name': 'new_name'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:08.290721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.303112 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:08.304120 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5f1bc97-0527-4ab2-b1cc-fc0efbc51956 None None] The sync data for ids ['cebcb204-42ff-43aa-8f69-a2a8cd45a5a6'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:08.313749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8e194228-35be-4708-9c68-6375ba04f14c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:08.322463 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-a2b62d41-dc93-4a38-903d-fbb693818a3c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] update failed (client error): The resource could not be found. Nov 24 04:14:08.327588 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a2b62d41-dc93-4a38-903d-fbb693818a3c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "PUT /v2.0/routers/tempest-non_exist_router-417256549 HTTP/1.1" status: 404 len: 334 time: 0.0517035 Nov 24 04:14:08.328311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34470) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:08.336227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.347589 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.394642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting subnet de810fa0-b37b-42fd-aa09-02b882dc8422 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:08.397235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.398536 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.408556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e7b33afe-9ce8-4036-85ad-2bda6726c206 None None] Provisioning complete for port 8e194228-35be-4708-9c68-6375ba04f14c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:08.408821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7b33afe-9ce8-4036-85ad-2bda6726c206 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.426326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.430367 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6374154 Nov 24 04:14:08.430974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34472) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:08.440448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b54219-5cf4-42a1-b92d-c9c77a743e91 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5d5efe92-eef0-4d69-b049-c50b315d86ac,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:08.448800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.459536 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'security_group': {'name': 'tempest-secgroup-698371132'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:08.524291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1140cd8-8cd1-424b-baa9-b680e7f7d0bc None None] Pushing event updated for resources: {'Port': ['ID=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:08.531781 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'tenant_id': '372dd3329b1c46059a975406a09b4bcc', 'fixed_ips': [{'subnet_id': '0d87b69d-e133-4dca-9dc7-1a72f89ecfa6'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:08.532594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.538513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.555145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.608919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Delete allocated IP 172.20.0.23 (fc5dc081-8d2b-45b2-99dd-22f6f2daf05b/05dba9df-3609-4d18-ab51-84036eec15e8) {{(pid=103381) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 04:14:08.626472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8e194228-35be-4708-9c68-6375ba04f14c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:08.627575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.656821 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.673974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ce904412-401d-4df1-801f-c17322c730b9 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:14:08.692983 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Subnet': ['ID=de810fa0-b37b-42fd-aa09-02b882dc8422,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:08.699334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.701219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.707151 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a33f9db6-f65c-4386-a4fe-063608c6e706 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/subnets/de810fa0-b37b-42fd-aa09-02b882dc8422 HTTP/1.1" status: 204 len: 168 time: 0.3775284 Nov 24 04:14:08.708014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34474) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:08.733471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-902ab973-fb5a-467a-bf6a-fa489a79ee26 None None] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:08.752828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Attempting to bind port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:08.753319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Attempting to bind port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:08.753692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Attempting to bind port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 on network 61fb4de4-ff65-42d0-aed9-c58e7caab600 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:08.770654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Transition to ACTIVE for port object ce904412-401d-4df1-801f-c17322c730b9 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:14:08.775270 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.781274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting subnet 9d8b1281-f4e3-471e-8cc5-872566184aad {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:08.790290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.792744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.799751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.835583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:08.835957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Checking segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:08.836357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.836748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Bound using segment: {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:08.837220 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Bound port: b8985b51-3822-48f2-b6c3-2c24bd2cfbc3, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd92fbff6-b634-454f-b4b7-5f45f8744fac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:08.837609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.868486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.887701 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Pushing event updated for resources: {'Port': ['ID=ce904412-401d-4df1-801f-c17322c730b9,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:08.909418 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.909418 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4675381 Nov 24 04:14:08.910189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:08.917797 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34478) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:08.924548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-442389819', 'security_groups': ['326f1697-9c3d-4305-b468-47fc3247a4a0'], 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '0d87b69d-e133-4dca-9dc7-1a72f89ecfa6'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:08.952806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c888833-83ec-49d4-a96b-ac43a6fa4db0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=326f1697-9c3d-4305-b468-47fc3247a4a0,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:08.973166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.024238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.063105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.074662 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f90f3f2e-e338-4182-8ac5-fa7922d2d666 req-5924617c-46a8-41cd-8859-b393d7367926 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:09.085797 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f90f3f2e-e338-4182-8ac5-fa7922d2d666 req-5924617c-46a8-41cd-8859-b393d7367926 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 944 time: 0.0891726 Nov 24 04:14:09.093990 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.118563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Allocated IP 2001:db8::2 (721c2ec6-3abd-47ff-80e2-24b3c8106daa/0d87b69d-e133-4dca-9dc7-1a72f89ecfa6/41d439ed-bbec-4ce1-ae8e-751809219ca2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:09.136145 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Attempting to bind port ce904412-401d-4df1-801f-c17322c730b9 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:09.136478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Attempting to bind port ce904412-401d-4df1-801f-c17322c730b9 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '3d6fe194-5d56-4d69-bb30-b0e96721fe3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:09.136807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Attempting to bind port ce904412-401d-4df1-801f-c17322c730b9 on network acefce04-02aa-44cc-bb30-373d1b065eae {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:09.139343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Subnet': ['ID=9d8b1281-f4e3-471e-8cc5-872566184aad,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:09.149356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.153066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] For port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:09.163248 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1499aad3-8904-49e7-a3bf-76eadf837a75 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/subnets/9d8b1281-f4e3-471e-8cc5-872566184aad HTTP/1.1" status: 204 len: 168 time: 0.4520774 Nov 24 04:14:09.166061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5454510-0185-42e9-b7ac-728230c5f6fb None None] Network 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:09.168523 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34480) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:09.190789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Port ce904412-401d-4df1-801f-c17322c730b9 on network acefce04-02aa-44cc-bb30-373d1b065eae not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:14:09.191127 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Attempting to bind port ce904412-401d-4df1-801f-c17322c730b9 on network acefce04-02aa-44cc-bb30-373d1b065eae {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:09.196000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=5719781e-a80c-456c-9263-d3a80027d91f,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:09.201927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] For port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:09.216103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e82d8043-c87a-4035-acce-1ba65f9c5ca5 None None] Provisioning complete for port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:09.216478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e82d8043-c87a-4035-acce-1ba65f9c5ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.228542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:09.228886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Checking segment: {'id': '3d6fe194-5d56-4d69-bb30-b0e96721fe3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:09.229280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Bound using segment: {'id': '3d6fe194-5d56-4d69-bb30-b0e96721fe3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:09.229738 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Bound port: ce904412-401d-4df1-801f-c17322c730b9, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3d6fe194-5d56-4d69-bb30-b0e96721fe3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 172, 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:09.230100 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.244336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.249023 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f90f3f2e-e338-4182-8ac5-fa7922d2d666 req-d5e72059-24ec-41ba-83cc-72f5e6f676ef tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1622519 Nov 24 04:14:09.314119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.371425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] For port ce904412-401d-4df1-801f-c17322c730b9, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:09.376075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] For port ce904412-401d-4df1-801f-c17322c730b9, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=ce904412-401d-4df1-801f-c17322c730b9,segment=NetworkSegment(3d6fe194-5d56-4d69-bb30-b0e96721fe3f),segment_id=3d6fe194-5d56-4d69-bb30-b0e96721fe3f)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:09.379957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] In _notify_port_updated(), no bound segment for port 5719781e-a80c-456c-9263-d3a80027d91f on network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:14:09.388612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:09.389333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.390917 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2f2bd9b1-ff9c-4753-9229-fda88656b938 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/ports/5719781e-a80c-456c-9263-d3a80027d91f HTTP/1.1" status: 200 len: 919 time: 1.8240695 Nov 24 04:14:09.393514 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:09.395652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34484) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:09.399223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:09.399540 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.402081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] DHCP port deletion for 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:09.402314 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.405464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'dc62de2c-9577-40a7-b660-29d60bf1e5d7'}, {'subnet_id': '05dba9df-3609-4d18-ab51-84036eec15e8'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:09.496841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:09.497470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:09.569106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1140cd8-8cd1-424b-baa9-b680e7f7d0bc None None] Pushing event updated for resources: {'Port': ['ID=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:09.597827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:09.598510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.599976 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] 10.222.0.21 "PUT /v2.0/ports/ce904412-401d-4df1-801f-c17322c730b9 HTTP/1.1" status: 200 len: 1094 time: 1.9589880 Nov 24 04:14:09.604567 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.607450 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '603e8bd7-e303-481c-aac8-5f973041c636', 'tag': 'ce904412-401d-4df1-801f-c17322c730b9'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:09.609784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a" -d '{"events": [{"name": "network-changed", "server_uuid": "603e8bd7-e303-481c-aac8-5f973041c636", "tag": "ce904412-401d-4df1-801f-c17322c730b9"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:09.616043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a7aba9-ea05-415e-a7a7-fb1649281a10 service neutron] Pushing event updated for resources: {'Port': ['ID=ce904412-401d-4df1-801f-c17322c730b9,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:09.638484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] For port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,segment=NetworkSegment(ba42279c-dd7e-4fcc-8353-a5b31ec18c2f),segment_id=ba42279c-dd7e-4fcc-8353-a5b31ec18c2f)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:09.638841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.646025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 02c75bec-d47b-4bab-a997-b35a0d72ae0c yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:09.674560 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Calling delete_port for b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:09.825406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c8568fc-5700-4161-8f70-6718a55f6189 x-openstack-request-id: req-9c8568fc-5700-4161-8f70-6718a55f6189 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:09.825917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "603e8bd7-e303-481c-aac8-5f973041c636", "tag": "ce904412-401d-4df1-801f-c17322c730b9", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:09.826019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-9c8568fc-5700-4161-8f70-6718a55f6189 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:09.826626 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '603e8bd7-e303-481c-aac8-5f973041c636', 'tag': 'ce904412-401d-4df1-801f-c17322c730b9', 'status': 'completed', 'code': 200} Nov 24 04:14:09.835840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-b3a600fc-8a52-4ab5-a2a8-b5d1a4ecd2fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:09.837987 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-b3a600fc-8a52-4ab5-a2a8-b5d1a4ecd2fa service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=1f9bf64d67774d1fb7ab8d25db416cdd&device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 1097 time: 0.1730285 Nov 24 04:14:09.874962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.887121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:09.909293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-cda7aa72-ee32-4fe7-bf90-67fad5664aa1 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ce904412-401d-4df1-801f-c17322c730b9 HTTP/1.1" status: 200 len: 217 time: 0.0572054 Nov 24 04:14:09.921242 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Port': ['ID=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:09.931734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] No DVR routers for this DVR port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:09.972678 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-6ba72f32-d501-4fb8-84e3-1e0b26f09e54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:09.974690 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-6ba72f32-d501-4fb8-84e3-1e0b26f09e54 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=16303810-2955-433b-bb61-fa9692bb82ad HTTP/1.1" status: 200 len: 851 time: 0.0620713 Nov 24 04:14:10.019721 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-c29fc3d6-91d2-43a0-898b-43d95856a236 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=acefce04-02aa-44cc-bb30-373d1b065eae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0355895 Nov 24 04:14:10.023429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.038123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e82d8043-c87a-4035-acce-1ba65f9c5ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.058470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.061793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Deleting port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:10.062180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.093518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.148467 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['11f1dfa5-c8f4-41e4-a211-395fe5e38d6d']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:10.179885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:10.180199 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ba42279c-dd7e-4fcc-8353-a5b31ec18c2f') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:10.194026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.201885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::1de (721c2ec6-3abd-47ff-80e2-24b3c8106daa/0d87b69d-e133-4dca-9dc7-1a72f89ecfa6/02c75bec-d47b-4bab-a997-b35a0d72ae0c) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:10.216045 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.221174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] DHCP port deletion for 4567c839-ebc4-4f8a-bfc3-e0b491eeb35f request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:10.226193 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-7fbdd022-cd78-4b99-8f99-d0594695039a service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1984568 Nov 24 04:14:10.231923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Releasing vlan 199 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:10.232328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:10.235658 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:10.262486 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:10.272683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:10.325505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:10.330948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] For port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:10.331646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.373735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:10.374107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.374279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:10.375894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.389874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:10.393239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:10.404948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e82d8043-c87a-4035-acce-1ba65f9c5ca5 None None] For port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:10.405977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.408841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Pushing event updated for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:10.409828 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/networks/11f1dfa5-c8f4-41e4-a211-395fe5e38d6d HTTP/1.1" status: 204 len: 168 time: 1.2334676 Nov 24 04:14:10.415505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d269cab-bb19-400c-baae-0afb0593db7c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Network': ['ID=11f1dfa5-c8f4-41e4-a211-395fe5e38d6d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:10.417172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34494) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:10.418492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Calling delete_port for b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:10.434507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:14:10.436514 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e82d8043-c87a-4035-acce-1ba65f9c5ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.455496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.459065 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e623f491-2127-4702-9b48-cc36f4fafe48 req-00b9b7f8-56b6-48bd-b226-ed6edc657652 service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2237329 Nov 24 04:14:10.534666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.568385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.575370 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Network 11f1dfa5-c8f4-41e4-a211-395fe5e38d6d is not hosted by any dhcp agent {{(pid=103382) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:14:10.575834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] No DVR routers for this DVR port b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:10.621413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Attempting to bind port 41d439ed-bbec-4ce1-ae8e-751809219ca2 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:10.622006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Attempting to bind port 41d439ed-bbec-4ce1-ae8e-751809219ca2 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'b386343f-6228-4702-a514-5fe49462e4e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:10.622211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Attempting to bind port 41d439ed-bbec-4ce1-ae8e-751809219ca2 on network 721c2ec6-3abd-47ff-80e2-24b3c8106daa {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:10.625376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-9e21620b-fdc0-48e0-99fc-c777740ae430 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:10.627494 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-9e21620b-fdc0-48e0-99fc-c777740ae430 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=1f9bf64d67774d1fb7ab8d25db416cdd&device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 1097 time: 0.1114340 Nov 24 04:14:10.647537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Provisioning complete for port 5719781e-a80c-456c-9263-d3a80027d91f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:10.647916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.651829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:10.652325 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Checking segment: {'id': 'b386343f-6228-4702-a514-5fe49462e4e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:10.652610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.653009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Bound using segment: {'id': 'b386343f-6228-4702-a514-5fe49462e4e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:10.653643 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Bound port: 41d439ed-bbec-4ce1-ae8e-751809219ca2, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b386343f-6228-4702-a514-5fe49462e4e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:10.654043 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.677600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] Deleting port 9a9c3550-dec4-4809-99cc-544480ef2b10 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:10.678444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.679723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82d8043-c87a-4035-acce-1ba65f9c5ca5 None None] Pushing event updated for resources: {'Port': ['ID=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:10.687501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.763655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74f7d67-bbfd-4b29-a356-85475aabdbde None None] Pushing event deleted for resources: {'Port': ['ID=b67c7b8b-b008-4aae-873f-4fbe8b0d3ee8,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:10.775518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting port 9a9c3550-dec4-4809-99cc-544480ef2b10 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:10.775858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.806831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:10.824487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=02c75bec-d47b-4bab-a997-b35a0d72ae0c,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:10.830587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:10.835454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:10.841095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:10.841717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.847294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-a0e00eca-8962-4d14-9698-8ac30660afd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:10.848753 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-a0e00eca-8962-4d14-9698-8ac30660afd8 service neutron] 10.222.0.21 "GET /v2.0/networks?id=acefce04-02aa-44cc-bb30-373d1b065eae HTTP/1.1" status: 200 len: 912 time: 0.2087815 Nov 24 04:14:10.857240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.21 (fc5dc081-8d2b-45b2-99dd-22f6f2daf05b/05dba9df-3609-4d18-ab51-84036eec15e8/5719781e-a80c-456c-9263-d3a80027d91f) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:10.858240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Port 5719781e-a80c-456c-9263-d3a80027d91f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:10.884408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] For port 9a9c3550-dec4-4809-99cc-544480ef2b10, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9a9c3550-dec4-4809-99cc-544480ef2b10,segment=NetworkSegment(fab7ed6a-d5e3-4dc3-8358-3207cf426ebf),segment_id=fab7ed6a-d5e3-4dc3-8358-3207cf426ebf)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:10.884408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.907622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a675835-3d71-4fb5-8694-c0855c78c183 req-e3f514e6-4a69-4456-ab15-3989d54d67c6 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:10.918415 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7a675835-3d71-4fb5-8694-c0855c78c183 req-e3f514e6-4a69-4456-ab15-3989d54d67c6 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 944 time: 0.5838096 Nov 24 04:14:10.920936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] Calling delete_port for 9a9c3550-dec4-4809-99cc-544480ef2b10 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:10.921112 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-f08b9224-ebc4-4c8d-94e1-31df65769c02 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ce904412-401d-4df1-801f-c17322c730b9 HTTP/1.1" status: 200 len: 217 time: 0.0422831 Nov 24 04:14:10.926385 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-924a1100-0859-4f40-b99e-80684caa8cf7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.0066123 Nov 24 04:14:10.930105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34496) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:10.934805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:10.937891 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.940524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] For port 9a9c3550-dec4-4809-99cc-544480ef2b10, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9a9c3550-dec4-4809-99cc-544480ef2b10,segment=NetworkSegment(fab7ed6a-d5e3-4dc3-8358-3207cf426ebf),segment_id=fab7ed6a-d5e3-4dc3-8358-3207cf426ebf)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:10.941029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.964008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Provisioning complete for port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:10.964418 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:10.972913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:11.007202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Calling delete_port for 9a9c3550-dec4-4809-99cc-544480ef2b10 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:11.026245 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7a675835-3d71-4fb5-8694-c0855c78c183 req-752af913-8036-4fa8-b8b9-239645a3bac9 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064613 Nov 24 04:14:11.056515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-6885f8fa-79eb-43c0-9ad9-e791d37ddb00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:11.058059 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-6885f8fa-79eb-43c0-9ad9-e791d37ddb00 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=16303810-2955-433b-bb61-fa9692bb82ad HTTP/1.1" status: 200 len: 851 time: 0.1145122 Nov 24 04:14:11.060556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=41d439ed-bbec-4ce1-ae8e-751809219ca2,segment=NetworkSegment(b386343f-6228-4702-a514-5fe49462e4e7),segment_id=b386343f-6228-4702-a514-5fe49462e4e7)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:11.075388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.077739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.081401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.132067 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-2c0b4c89-9f70-4ea6-8240-b70eb11d8b49 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=acefce04-02aa-44cc-bb30-373d1b065eae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0345726 Nov 24 04:14:11.206693 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=5719781e-a80c-456c-9263-d3a80027d91f,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:11.216562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40374fa3-4a73-4010-9f35-6dd5840f2d0a None None] Pushing event updated for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:11.227798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:03Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:13:06Z', 'revision_number': 1, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b8985b51-3822-48f2-b6c3-2c24bd2cfbc3', 'name': '', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:b5:d6:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 1121, 'fixed_ips': [{'subnet_id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:02Z', 'updated_at': '2021-11-24T04:14:09Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:11.235264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] In _notify_port_updated(), no bound segment for port 5719781e-a80c-456c-9263-d3a80027d91f on network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:14:11.241400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:11.242304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.253237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34498) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:11.255327 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8a940b48-7228-444a-8661-dc2491666c5e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/ports/5719781e-a80c-456c-9263-d3a80027d91f HTTP/1.1" status: 200 len: 999 time: 1.8582101 Nov 24 04:14:11.294499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b43ca987-819e-49b9-ae24-2fa2fadf4ff5 None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:03Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:13:06Z', 'revision_number': 1, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b8985b51-3822-48f2-b6c3-2c24bd2cfbc3', 'name': '', 'network_id': '61fb4de4-ff65-42d0-aed9-c58e7caab600', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:b5:d6:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 1121, 'fixed_ips': [{'subnet_id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:02Z', 'updated_at': '2021-11-24T04:14:09Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'b58537d8-e9f8-43e0-92cb-52a12f3fe9d6', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:11.297934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.370478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] No DVR routers for this DVR port 9a9c3550-dec4-4809-99cc-544480ef2b10 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:11.378847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a860991-4210-4924-8b12-11b71ad22582 None None] Pushing event deleted for resources: {'Port': ['ID=9a9c3550-dec4-4809-99cc-544480ef2b10,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:11.391385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Provisioning complete for port 8e194228-35be-4708-9c68-6375ba04f14c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:11.391766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-24e289c0-f449-40e9-baa5-53d2e4445ff0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.412249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:11.416015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.423167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.495028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Port': ['ID=9a9c3550-dec4-4809-99cc-544480ef2b10,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:11.506489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] No DVR routers for this DVR port 9a9c3550-dec4-4809-99cc-544480ef2b10 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:11.521863 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-ba3db8b7-d558-4da2-85f5-2360c4bf48bb service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3802414 Nov 24 04:14:11.683359 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2fb9cb4b-3d0f-49ab-ae7f-3ffe56fab50e None None] Provisioning complete for port 5719781e-a80c-456c-9263-d3a80027d91f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:11.683621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2fb9cb4b-3d0f-49ab-ae7f-3ffe56fab50e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.710348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 5719781e-a80c-456c-9263-d3a80027d91f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:11.710809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.729032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2fb9cb4b-3d0f-49ab-ae7f-3ffe56fab50e None None] Port 5719781e-a80c-456c-9263-d3a80027d91f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:11.766480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:11.851373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device ce904412-401d-4df1-801f-c17322c730b9 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:14:11.973720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port ce904412-401d-4df1-801f-c17322c730b9, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=ce904412-401d-4df1-801f-c17322c730b9,segment=NetworkSegment(3d6fe194-5d56-4d69-bb30-b0e96721fe3f),segment_id=3d6fe194-5d56-4d69-bb30-b0e96721fe3f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:11.991261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'ce904412-401d-4df1-801f-c17322c730b9', 'network_id': 'acefce04-02aa-44cc-bb30-373d1b065eae', 'port_id': 'ce904412-401d-4df1-801f-c17322c730b9', 'mac_address': 'fa:16:3e:22:f7:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16303810-2955-433b-bb61-fa9692bb82ad', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:14:12.031998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.046614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ce904412-401d-4df1-801f-c17322c730b9 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:14:12.067707 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port ce904412-401d-4df1-801f-c17322c730b9, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=ce904412-401d-4df1-801f-c17322c730b9,segment=NetworkSegment(3d6fe194-5d56-4d69-bb30-b0e96721fe3f),segment_id=3d6fe194-5d56-4d69-bb30-b0e96721fe3f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:12.076059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.167780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.175099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=ce904412-401d-4df1-801f-c17322c730b9,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:12.201863 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.ipam_backend_mixin [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 0d87b69d-e133-4dca-9dc7-1a72f89ecfa6 (CIDR: 2001:db8::/64) Nov 24 04:14:12.225455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:12.225948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:12.232736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4567c839-ebc4-4f8a-bfc3-e0b491eeb35f']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:12.279114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:12.279414 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fab7ed6a-d5e3-4dc3-8358-3207cf426ebf') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:12.311089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:12.313216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.334936 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9fb17fdf-4e76-4c42-9ba1-3b93ad03cc9a req-f7492a66-8418-4453-b71c-88cf3b80dec3 service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7545738 Nov 24 04:14:12.338037 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-829d3be0-02e0-44d9-a0ae-62126d1a8124 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.4070678 Nov 24 04:14:12.341007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34504) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:12.348035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:12.366369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.376229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5966d25c-9d94-41de-b062-90abd4b4e016 req-420cabcf-15d0-4e41-bfa8-20b85557f9d2 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:12.377790 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5966d25c-9d94-41de-b062-90abd4b4e016 req-420cabcf-15d0-4e41-bfa8-20b85557f9d2 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 945 time: 0.2048168 Nov 24 04:14:12.381907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.384266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:12.384907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.391330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Releasing vlan 178 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:12.391868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:12.403124 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:12.428112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 5719781e-a80c-456c-9263-d3a80027d91f owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:12.507842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:12.513107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.540944 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.552534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.555893 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/networks/4567c839-ebc4-4f8a-bfc3-e0b491eeb35f HTTP/1.1" status: 204 len: 168 time: 2.1377108 Nov 24 04:14:12.559367 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34506) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:12.559961 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5966d25c-9d94-41de-b062-90abd4b4e016 req-dcd442a0-5570-40ff-8277-8567d99847a8 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1641207 Nov 24 04:14:12.571697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8edd7e-078d-45e0-9fa0-47f446ed6f57 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Network': ['ID=4567c839-ebc4-4f8a-bfc3-e0b491eeb35f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:12.600281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['ce904412-401d-4df1-801f-c17322c730b9'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:14:12.684833 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f8c307f0-9608-476d-b087-e3d4f71ff0b4 None None] Provisioning complete for port f856284c-e3d7-42b5-b16f-4799edadaa2e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:12.685730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8c307f0-9608-476d-b087-e3d4f71ff0b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.690838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting subnet 5e77e950-2995-470e-aa0c-d18cbefa4711 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:12.697308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.716298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.757035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.764316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=5719781e-a80c-456c-9263-d3a80027d91f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:12.776214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f8c307f0-9608-476d-b087-e3d4f71ff0b4 None None] Port f856284c-e3d7-42b5-b16f-4799edadaa2e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:12.801536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.839700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f8c307f0-9608-476d-b087-e3d4f71ff0b4 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:12.840222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8c307f0-9608-476d-b087-e3d4f71ff0b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.911325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.917968 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9f5ea9f0-98e5-4893-838d-b86ffc47ea2d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/5719781e-a80c-456c-9263-d3a80027d91f HTTP/1.1" status: 204 len: 168 time: 1.6633937 Nov 24 04:14:12.918729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34508) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:12.937855 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=41d439ed-bbec-4ce1-ae8e-751809219ca2,segment=NetworkSegment(b386343f-6228-4702-a514-5fe49462e4e7),segment_id=b386343f-6228-4702-a514-5fe49462e4e7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:12.948571 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9282db2-cb2c-4d5e-bf70-901e5d45004e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:12.953342 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c9282db2-cb2c-4d5e-bf70-901e5d45004e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/5719781e-a80c-456c-9263-d3a80027d91f HTTP/1.1" status: 404 len: 333 time: 0.0335615 Nov 24 04:14:12.954003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34510) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:12.956331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.969471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:12.971134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:13.020858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 05dba9df-3609-4d18-ab51-84036eec15e8 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:13.024637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.080662 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.091653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.130436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Subnet': ['ID=5e77e950-2995-470e-aa0c-d18cbefa4711,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:13.132701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.145874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:13.154733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0419dbc-c9e0-46ee-ad74-a5e43d7b872d None None] Network c20f17de-37f4-4dcf-bfbd-752fa5e6d356 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:13.163799 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.167068 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4127d536-9737-497a-9150-bdeae50e0021 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/subnets/5e77e950-2995-470e-aa0c-d18cbefa4711 HTTP/1.1" status: 204 len: 168 time: 0.6068783 Nov 24 04:14:13.170731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34514) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:13.191408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:13.191911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.193926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.225261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=a923e012-ebc0-4328-95fb-36c372b05b6f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:13.232125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:13.236451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:13.253131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45c3f875-4e42-489c-bd08-89396a9d104a None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:13.269074 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:13.269673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.269912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.293072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.298593 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7ddf84c9-1807-42ea-9188-200b32eb4674 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 0.9551487 Nov 24 04:14:13.301388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34516) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:13.302706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=05dba9df-3609-4d18-ab51-84036eec15e8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:13.306818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-2023382479', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'a923e012-ebc0-4328-95fb-36c372b05b6f'}], 'security_groups': ['5d5efe92-eef0-4d69-b049-c50b315d86ac']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:13.308407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.315032 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c149c22b-0d62-4916-b30c-e94a7b7437be tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/05dba9df-3609-4d18-ab51-84036eec15e8 HTTP/1.1" status: 204 len: 168 time: 0.3594625 Nov 24 04:14:13.315646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34518) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:13.352956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4269e17e-4d60-47d8-b933-070fd7788c15 None None] Network fc5dc081-8d2b-45b2-99dd-22f6f2daf05b requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:13.373226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet dc62de2c-9577-40a7-b660-29d60bf1e5d7 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:13.377394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.420425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.465944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Deleting port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:13.465944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.477532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-fc22ef33-e89d-4b5f-b05f-16bfb2186101 None None] Provisioning complete for port 02c75bec-d47b-4bab-a997-b35a0d72ae0c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:13.477877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fc22ef33-e89d-4b5f-b05f-16bfb2186101 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.512282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.531066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] For port 0ba4d396-6d70-4078-91ef-27d8b0f3a544, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=0ba4d396-6d70-4078-91ef-27d8b0f3a544,segment=NetworkSegment(7f09a149-4996-45d5-b48e-737d19b25a86),segment_id=7f09a149-4996-45d5-b48e-737d19b25a86)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:13.531444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.544116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Calling delete_port for 0ba4d396-6d70-4078-91ef-27d8b0f3a544 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:13.578305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fc22ef33-e89d-4b5f-b05f-16bfb2186101 None None] Port 02c75bec-d47b-4bab-a997-b35a0d72ae0c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:13.586699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.589898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.669136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=dc62de2c-9577-40a7-b660-29d60bf1e5d7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:13.680750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.690195 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c7f0094a-9608-4555-b64e-e325bbbcade8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/dc62de2c-9577-40a7-b660-29d60bf1e5d7 HTTP/1.1" status: 204 len: 168 time: 0.3734756 Nov 24 04:14:13.691113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34522) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:13.718336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9a9c3550-dec4-4809-99cc-544480ef2b10 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:13.723011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bb73cd2-1513-4d68-8edb-c397e2e75f0d None None] DHCP port deletion for c20f17de-37f4-4dcf-bfbd-752fa5e6d356 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:13.748622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 9a9c3550-dec4-4809-99cc-544480ef2b10 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:13.748982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9a9c3550-dec4-4809-99cc-544480ef2b10 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:13.763827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.791199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1bb73cd2-1513-4d68-8edb-c397e2e75f0d None None] The port '0ba4d396-6d70-4078-91ef-27d8b0f3a544' was deleted {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Nov 24 04:14:13.814626 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] DHCP port deletion for fc5dc081-8d2b-45b2-99dd-22f6f2daf05b request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:13.820198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Update dhcp port {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'fixed_ips': [{'subnet_id': '0d87b69d-e133-4dca-9dc7-1a72f89ecfa6', 'ip_address': '2001:db8::2'}, {'subnet_id': 'a923e012-ebc0-4328-95fb-36c372b05b6f'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '41d439ed-bbec-4ce1-ae8e-751809219ca2'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:14:13.836552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.839406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Port': ['ID=0ba4d396-6d70-4078-91ef-27d8b0f3a544,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:13.843986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] No DVR routers for this DVR port 0ba4d396-6d70-4078-91ef-27d8b0f3a544 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:13.864406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.880627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device ce904412-401d-4df1-801f-c17322c730b9 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:13.900741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 8e194228-35be-4708-9c68-6375ba04f14c {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:13.901088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:13.940157 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f66b849-f58e-4c29-9067-3702fc335830 req-c033d177-9667-45e5-9074-ea1f52d88910 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:13.941690 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-5f66b849-f58e-4c29-9067-3702fc335830 req-c033d177-9667-45e5-9074-ea1f52d88910 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 945 time: 0.2209065 Nov 24 04:14:13.994374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] For port 8e194228-35be-4708-9c68-6375ba04f14c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8e194228-35be-4708-9c68-6375ba04f14c,segment=NetworkSegment(db17eb1c-7ff3-4579-a58a-69fd568abbbc),segment_id=db17eb1c-7ff3-4579-a58a-69fd568abbbc)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:13.994747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.008006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 8e194228-35be-4708-9c68-6375ba04f14c owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:14.028675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.034921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] Deleting port 8e194228-35be-4708-9c68-6375ba04f14c {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:14.035372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.097170 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-5f66b849-f58e-4c29-9067-3702fc335830 req-9458d6e2-788b-43a1-9dc0-f6c6ee019c9e tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1455848 Nov 24 04:14:14.098800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c20f17de-37f4-4dcf-bfbd-752fa5e6d356']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:14.118368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port ce904412-401d-4df1-801f-c17322c730b9 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:14:14.118572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7f09a149-4996-45d5-b48e-737d19b25a86') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:14.118572 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7f09a149-4996-45d5-b48e-737d19b25a86') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:14.118800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.120064 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port ce904412-401d-4df1-801f-c17322c730b9 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:14.120484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.131375 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.147873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] For port 8e194228-35be-4708-9c68-6375ba04f14c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8e194228-35be-4708-9c68-6375ba04f14c,segment=NetworkSegment(db17eb1c-7ff3-4579-a58a-69fd568abbbc),segment_id=db17eb1c-7ff3-4579-a58a-69fd568abbbc)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:14.148275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.169482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] Calling delete_port for 8e194228-35be-4708-9c68-6375ba04f14c owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:14.172719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.173079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No DVR routers for this DVR port 8e194228-35be-4708-9c68-6375ba04f14c on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:14.189543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Releasing vlan 171 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:14.190009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:14.193421 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:14.210305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=8e194228-35be-4708-9c68-6375ba04f14c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:14.268176 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:14.274575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Delete allocated IP 2001:db8::1de (721c2ec6-3abd-47ff-80e2-24b3c8106daa/0d87b69d-e133-4dca-9dc7-1a72f89ecfa6) {{(pid=103380) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 04:14:14.288670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8:0:1::327 (721c2ec6-3abd-47ff-80e2-24b3c8106daa/a923e012-ebc0-4328-95fb-36c372b05b6f/02c75bec-d47b-4bab-a997-b35a0d72ae0c) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:14.296849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.300792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.306430 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.309605 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/networks/c20f17de-37f4-4dcf-bfbd-752fa5e6d356 HTTP/1.1" status: 204 len: 168 time: 1.1343396 Nov 24 04:14:14.315653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34526) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:14.317412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.327257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Pushing event deleted for resources: {'Network': ['ID=c20f17de-37f4-4dcf-bfbd-752fa5e6d356,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:14.342650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.343296 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.343821 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.344325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.344834 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.345896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.346422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.346943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.347454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.347948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.348455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.348948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2937626-dda2-4fd3-af7c-0d9a9aee6488 tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:14.352008 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3626b20f-7186-4b13-a663-7dbd186857cc tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "GET /v2.0/ports?device_id=cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 HTTP/1.1" status: 200 len: 205 time: 0.0352368 Nov 24 04:14:14.354397 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34528) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:14.360923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '603e8bd7-e303-481c-aac8-5f973041c636', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce904412-401d-4df1-801f-c17322c730b9'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:14.364488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c224f310-de9c-42e0-88c9-4e38f8fb1c20" -d '{"events": [{"server_uuid": "603e8bd7-e303-481c-aac8-5f973041c636", "name": "network-vif-plugged", "status": "completed", "tag": "ce904412-401d-4df1-801f-c17322c730b9"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:14.366762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc5dc081-8d2b-45b2-99dd-22f6f2daf05b']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:14.378584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.391577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port ce904412-401d-4df1-801f-c17322c730b9, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=ce904412-401d-4df1-801f-c17322c730b9,segment=NetworkSegment(3d6fe194-5d56-4d69-bb30-b0e96721fe3f),segment_id=3d6fe194-5d56-4d69-bb30-b0e96721fe3f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:14.395495 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db17eb1c-7ff3-4579-a58a-69fd568abbbc') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:14.395748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db17eb1c-7ff3-4579-a58a-69fd568abbbc') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:14.410059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.413634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] Pushing event deleted for resources: {'Port': ['ID=8e194228-35be-4708-9c68-6375ba04f14c,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:14.416588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.420846 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16da5f95-2598-45d3-a7a9-3f4067a172e8 None None] No DVR routers for this DVR port 8e194228-35be-4708-9c68-6375ba04f14c on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:14.430720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:14.431344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.431496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.442652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 168 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:14.443114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.460252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:14.468846 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:14.517965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66e7a9a2-ec0a-4694-96dc-026532390d18 x-openstack-request-id: req-66e7a9a2-ec0a-4694-96dc-026532390d18 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:14.518695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "603e8bd7-e303-481c-aac8-5f973041c636", "name": "network-vif-plugged", "status": "completed", "tag": "ce904412-401d-4df1-801f-c17322c730b9", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:14.519108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-66e7a9a2-ec0a-4694-96dc-026532390d18 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:14.519685 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '603e8bd7-e303-481c-aac8-5f973041c636', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce904412-401d-4df1-801f-c17322c730b9', 'code': 200} Nov 24 04:14:14.526827 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=ce904412-401d-4df1-801f-c17322c730b9,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:14.541658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.554214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.568881 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/fc5dc081-8d2b-45b2-99dd-22f6f2daf05b HTTP/1.1" status: 204 len: 168 time: 0.8660176 Nov 24 04:14:14.578382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34534) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:14.595601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84db5447-7e04-4b60-8977-d853b4f8b822 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=fc5dc081-8d2b-45b2-99dd-22f6f2daf05b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:14.642000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4710b50b-6da3-4ec0-9841-ece9ea0ad1a0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:14.648041 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4710b50b-6da3-4ec0-9841-ece9ea0ad1a0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.0672166 Nov 24 04:14:14.648683 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34536) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:14.664567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0ba4d396-6d70-4078-91ef-27d8b0f3a544 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:14.686481 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 0ba4d396-6d70-4078-91ef-27d8b0f3a544 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:14.686700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 0ba4d396-6d70-4078-91ef-27d8b0f3a544 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:14.687122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8e194228-35be-4708-9c68-6375ba04f14c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:14.705975 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 8e194228-35be-4708-9c68-6375ba04f14c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:14.706347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8e194228-35be-4708-9c68-6375ba04f14c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:14.731266 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-431ad7c1-c999-4915-acb3-de1832747699 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.0814855 Nov 24 04:14:14.734723 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34538) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:14.742497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a584e9f-31fb-4171-ba08-a5bb3a67e3bc req-65b0cc18-9385-4822-a3dd-80ae85108d9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:14.743949 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7a584e9f-31fb-4171-ba08-a5bb3a67e3bc req-65b0cc18-9385-4822-a3dd-80ae85108d9c service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 1099 time: 0.0604038 Nov 24 04:14:14.744293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-409956424'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:14.752749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.756416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.789581 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7a584e9f-31fb-4171-ba08-a5bb3a67e3bc req-4b31f8c3-ddf8-4c0d-a813-dad64c883cb6 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370445 Nov 24 04:14:14.823202 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.823706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Fanout notify agent at l3_agent the message router_deleted on router cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:14:14.830043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:14.833566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.842345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.843449 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3568b495-2b39-420d-914d-0dcfc94c0a0c tempest-RoutersNegativeTest-1179398408 tempest-RoutersNegativeTest-1179398408-project] 10.222.0.48 "DELETE /v2.0/routers/cebcb204-42ff-43aa-8f69-a2a8cd45a5a6 HTTP/1.1" status: 204 len: 168 time: 0.4881248 Nov 24 04:14:14.846897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.854679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.916988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Allocated IP 2001:db8:0:1::2 (721c2ec6-3abd-47ff-80e2-24b3c8106daa/a923e012-ebc0-4328-95fb-36c372b05b6f/41d439ed-bbec-4ce1-ae8e-751809219ca2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:14.928083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 151, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:14.933531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] In _notify_port_updated(), no bound segment for port 02c75bec-d47b-4bab-a997-b35a0d72ae0c on network 721c2ec6-3abd-47ff-80e2-24b3c8106daa {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:14:14.939215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:14.939781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.941101 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/ports/02c75bec-d47b-4bab-a997-b35a0d72ae0c HTTP/1.1" status: 200 len: 931 time: 1.6384611 Nov 24 04:14:14.944987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b116c9c6-636d-4542-84dd-4ddd3e6a5525 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=02c75bec-d47b-4bab-a997-b35a0d72ae0c,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:14.946131 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34542) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:14.956456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:14.956456 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment 8f741cab-4cc9-4aa9-871d-e1fb2bbbe516 of type vlan for network 67bc197d-602a-4841-af57-ea492e9bb71d Nov 24 04:14:15.011663 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.026484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=41d439ed-bbec-4ce1-ae8e-751809219ca2,segment=NetworkSegment(b386343f-6228-4702-a514-5fe49462e4e7),segment_id=b386343f-6228-4702-a514-5fe49462e4e7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:15.045018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.055043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:15.056002 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.066875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.073882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.088366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 02c75bec-d47b-4bab-a997-b35a0d72ae0c {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:15.088366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.105881 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.3700249 Nov 24 04:14:15.109049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34546) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.148222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:15.195955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3637a68-63f3-499d-bca7-c26038f01f3b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=67bc197d-602a-4841-af57-ea492e9bb71d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:15.205401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Pushing event updated for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:15.215769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 67bc197d-602a-4841-af57-ea492e9bb71d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:15.221631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.222181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.223345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.223804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.224247 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.225365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.225831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.226330 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.226776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.227235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.228311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.228756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6a1efa-4894-4268-be51-900c6ce8115a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:15.253961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.275000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34550) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.289377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 02c75bec-d47b-4bab-a997-b35a0d72ae0c owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:15.357970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:15.363387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.514582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.559648 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b84db1f3-5ad0-4548-984d-0feed734893f admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=78915d964edf42f986813b67a4624be3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2833402 Nov 24 04:14:15.560685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34554) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.566493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=02c75bec-d47b-4bab-a997-b35a0d72ae0c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:15.597329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1910fbe8-787d-447c-9b58-de243c42bf27 req-1fc30252-6677-421f-8203-53e9fca9df62 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:15.604298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.604994 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1910fbe8-787d-447c-9b58-de243c42bf27 req-1fc30252-6677-421f-8203-53e9fca9df62 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1127260 Nov 24 04:14:15.607570 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4e28684d-8735-401b-b056-6814f8df99a0 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/02c75bec-d47b-4bab-a997-b35a0d72ae0c HTTP/1.1" status: 204 len: 168 time: 0.6475046 Nov 24 04:14:15.612661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34556) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.638547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.654869 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-5b1dfe82-63f0-47eb-95ab-be41b302a148 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:14:15.656327 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5b1dfe82-63f0-47eb-95ab-be41b302a148 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/02c75bec-d47b-4bab-a997-b35a0d72ae0c HTTP/1.1" status: 404 len: 333 time: 0.0427547 Nov 24 04:14:15.660391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34558) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.688106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac0b0305-f14c-4d57-a4bd-6f34a4a2f7fc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.703085 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1910fbe8-787d-447c-9b58-de243c42bf27 req-fb8cb64b-92bd-4367-9741-15ed8e571c7c tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968161 Nov 24 04:14:15.720928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:15.728503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac0b0305-f14c-4d57-a4bd-6f34a4a2f7fc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.742543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:15.743146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: 67bc197d-602a-4841-af57-ea492e9bb71d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:15.757454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0735d72b-85ff-4ca9-86f8-f0988cbebbac tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.765722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 67bc197d-602a-4841-af57-ea492e9bb71d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:15.779641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 67bc197d-602a-4841-af57-ea492e9bb71d) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:15.784616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:15.784907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.792571 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0735d72b-85ff-4ca9-86f8-f0988cbebbac tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.799539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3563195d-1348-4d67-a4c7-42f2a9b28014 None None] Network 67bc197d-602a-4841-af57-ea492e9bb71d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:15.805441 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9461659c-9cbc-4fbc-990b-76d5f73a7053 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6957421 Nov 24 04:14:15.808301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34560) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.814479 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d', 'name': 'tempest-PortsTestJSON-1813711472'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:15.843969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac0b0305-f14c-4d57-a4bd-6f34a4a2f7fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.847616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ac0b0305-f14c-4d57-a4bd-6f34a4a2f7fc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.851563 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ac0b0305-f14c-4d57-a4bd-6f34a4a2f7fc admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/eaa8151b-7dd1-407b-b6d8-662fbad78963 HTTP/1.1" status: 204 len: 168 time: 0.2806311 Nov 24 04:14:15.869617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0735d72b-85ff-4ca9-86f8-f0988cbebbac tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.872616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0735d72b-85ff-4ca9-86f8-f0988cbebbac tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.873916 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0735d72b-85ff-4ca9-86f8-f0988cbebbac tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/security-groups/326f1697-9c3d-4305-b468-47fc3247a4a0 HTTP/1.1" status: 204 len: 168 time: 0.2125995 Nov 24 04:14:15.880408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34564) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:15.891511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac0b0305-f14c-4d57-a4bd-6f34a4a2f7fc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eaa8151b-7dd1-407b-b6d8-662fbad78963,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:15.915946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0735d72b-85ff-4ca9-86f8-f0988cbebbac tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=326f1697-9c3d-4305-b468-47fc3247a4a0,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:15.955997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5b52bdb-e2b8-4613-a114-e1361d660c18 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:15.987991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5b52bdb-e2b8-4613-a114-e1361d660c18 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.037816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:16.042574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.066477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5b52bdb-e2b8-4613-a114-e1361d660c18 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.070348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a5b52bdb-e2b8-4613-a114-e1361d660c18 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.073910 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a5b52bdb-e2b8-4613-a114-e1361d660c18 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/security-groups/5d5efe92-eef0-4d69-b049-c50b315d86ac HTTP/1.1" status: 204 len: 168 time: 0.1900144 Nov 24 04:14:16.078535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34570) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:16.094547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port c2f85059-2ba7-42c6-b91d-ce34ab88b6ab yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:16.096443 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b52bdb-e2b8-4613-a114-e1361d660c18 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d5efe92-eef0-4d69-b049-c50b315d86ac,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:16.202779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4e9179d2-bc95-4385-8fe7-6943ea1cedd9 None None] Provisioning complete for port f856284c-e3d7-42b5-b16f-4799edadaa2e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:16.203154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4e9179d2-bc95-4385-8fe7-6943ea1cedd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.214689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 0d87b69d-e133-4dca-9dc7-1a72f89ecfa6 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:16.221329 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.288002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.289625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.11 (67bc197d-602a-4841-af57-ea492e9bb71d/7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8/c2f85059-2ba7-42c6-b91d-ce34ab88b6ab) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:16.323286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:16.377388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4e9179d2-bc95-4385-8fe7-6943ea1cedd9 None None] Port f856284c-e3d7-42b5-b16f-4799edadaa2e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:16.428464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4e9179d2-bc95-4385-8fe7-6943ea1cedd9 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:16.428841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4e9179d2-bc95-4385-8fe7-6943ea1cedd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.434839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-67bc197d-602a-4841-af57-ea492e9bb71d', 'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': '7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:16.435681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.481610 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.505822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:16.506047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.506172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.568893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.575326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.605401 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=0d87b69d-e133-4dca-9dc7-1a72f89ecfa6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:16.609380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.613725 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/0d87b69d-e133-4dca-9dc7-1a72f89ecfa6 HTTP/1.1" status: 204 len: 168 time: 0.5331838 Nov 24 04:14:16.621302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34580) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:16.632420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.633483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.634115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.634638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.635478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.635981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.636473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.637107 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.637736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.638398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.638881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.639361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f98184eb-6689-4918-a912-48c1e65979ef tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:14:16.647995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:16.676491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 67bc197d-602a-4841-af57-ea492e9bb71d is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:16.679480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:16.693068 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92118081-f6f7-4b24-ac8a-96983440f08c None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:16.705784 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:16.750433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=c2f85059-2ba7-42c6-b91d-ce34ab88b6ab,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:16.801132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:16.802294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.829732 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ed92bc14-fc4d-4620-a7a0-7281a0f9712e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 1.0198128 Nov 24 04:14:16.830733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4e9179d2-bc95-4385-8fe7-6943ea1cedd9 None None] Could not find standard attr ID for object 02c75bec-d47b-4bab-a997-b35a0d72ae0c. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:16.833979 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34590) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:16.839720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d', 'name': 'tempest-PortsTestJSON-1401382451'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:16.841805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Allocated IP 172.20.0.2 (67bc197d-602a-4841-af57-ea492e9bb71d/7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8/ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:16.874770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:16.879616 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:16.892299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ada111a-259c-4109-be90-1a414ebb0aa2 req-e8273e49-10fa-47cc-87df-e31a1b4e973b tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:16.893643 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6ada111a-259c-4109-be90-1a414ebb0aa2 req-e8273e49-10fa-47cc-87df-e31a1b4e973b tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.0991168 Nov 24 04:14:16.992375 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34594) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:17.007141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d8af3487-99a9-40f3-a0b1-b224a965d404 None None] Could not find standard attr ID for object 02c75bec-d47b-4bab-a997-b35a0d72ae0c. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:17.011116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:17.017718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.036497 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6ada111a-259c-4109-be90-1a414ebb0aa2 req-44dc9381-360a-4144-9c61-464196c7ccc8 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1287546 Nov 24 04:14:17.038088 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port fbf4e1b8-fa0f-499f-b41b-dc896569c826 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:17.164091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3243988d-a9cd-49a2-bde4-7a0a23460334 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:17.164765 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-3243988d-a9cd-49a2-bde4-7a0a23460334 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 24 04:14:17.165451 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-3243988d-a9cd-49a2-bde4-7a0a23460334 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 04:14:17.166619 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3243988d-a9cd-49a2-bde4-7a0a23460334 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1731060 Nov 24 04:14:17.170874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34600) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:17.177866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--211091006'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:17.210805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.218457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.260178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.264537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Network 67bc197d-602a-4841-af57-ea492e9bb71d is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:17.268595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:17.272743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:17.284588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.298219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Pushing event updated for resources: {'Port': ['ID=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.315202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.316500 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6120c7e7-558a-4595-837f-6e837fa86c91 req-5ee2f34f-27cb-4c43-9726-226af307e133 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:17.318046 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6120c7e7-558a-4595-837f-6e837fa86c91 req-5ee2f34f-27cb-4c43-9726-226af307e133 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1259334 Nov 24 04:14:17.320235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.13 (67bc197d-602a-4841-af57-ea492e9bb71d/7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8/fbf4e1b8-fa0f-499f-b41b-dc896569c826) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:17.368783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Attempting to bind port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:17.369534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Attempting to bind port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:17.370336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Attempting to bind port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 on network 67bc197d-602a-4841-af57-ea492e9bb71d {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:17.375243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:17.378622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:17.379058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Checking segment: {'id': '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:17.379527 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.379926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Bound using segment: {'id': '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:17.380636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Bound port: ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '67bc197d-602a-4841-af57-ea492e9bb71d'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:17.381042 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.385099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:17.389905 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:17.390902 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.394431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=6fe10406-bbec-4bff-9fd6-20c49727626a,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.416438 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fb3a1df7-4bce-45bd-8fce-e99ebbf4c570 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7939723 Nov 24 04:14:17.422676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34602) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:17.428229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'security_group': {'name': 'tempest-secgroup-66572150'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:17.462661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.478515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] For port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:17.482849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] For port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,segment=NetworkSegment(8f741cab-4cc9-4aa9-871d-e1fb2bbbe516),segment_id=8f741cab-4cc9-4aa9-871d-e1fb2bbbe516)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:17.489861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.502313 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6120c7e7-558a-4595-837f-6e837fa86c91 req-6ace0fbd-ced6-46e0-8c16-7db9f4e10907 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1738057 Nov 24 04:14:17.573828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.574369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.583940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.607355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.621847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e03a7b-8822-42da-87b5-90dd779be684 None None] Pushing event updated for resources: {'Port': ['ID=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.639511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3fde5947-4300-45ce-b4fd-0a58ec9b75df,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.645648 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.649552 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-88a57b02-5d32-44c4-80b1-0a7ec2d259be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.2231991 Nov 24 04:14:17.650256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34606) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:17.655814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'security_group': {'name': 'tempest-secgroup-1012094961'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:17.700028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.739521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.747117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.760813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.776974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3ab6a18e-5628-4f67-aa47-ed4200fd8c35,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.823715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.823959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.827918 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6530118 Nov 24 04:14:17.828225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34612) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:17.834292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'ed22daa2-8a81-4eb8-aaec-8e789491ad0d', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:17.839969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.887413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=30329d92-f621-4567-a88c-97534ef84e7d,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.887984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9118ddf6-5957-4eec-b082-7f537a80f12d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ed22daa2-8a81-4eb8-aaec-8e789491ad0d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:17.902605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.907097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34616) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:17.915153 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-769f6933-1cd1-4004-b077-b04417f81873 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2641711 Nov 24 04:14:17.930254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'security_group': {'name': 'tempest-secgroup-611019744'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:17.941817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.971232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4423ad45-3df4-4984-9583-dcbde613e48e req-c76bf906-b7e5-48c8-a086-31db36118bfd tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:17.972891 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4423ad45-3df4-4984-9583-dcbde613e48e req-c76bf906-b7e5-48c8-a086-31db36118bfd tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1563926 Nov 24 04:14:17.984538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:17.999518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.014353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.022477 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.068104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a13016fd-98f1-43dc-b2e8-c592d01a9b3a,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:18.075476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.080924 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-96c7383f-5975-4358-bde3-b1036dbe3669 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2507153 Nov 24 04:14:18.081709 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.092942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-e79bbbdc-5c19-451f-966c-e5cb40e7cf8d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'ed22daa2-8a81-4eb8-aaec-8e789491ad0d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:18.153103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e79bbbdc-5c19-451f-966c-e5cb40e7cf8d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.195336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d571088-b651-4b3b-aac2-40aa8787f594 None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:18.298863 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-e79bbbdc-5c19-451f-966c-e5cb40e7cf8d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 04:14:18.299965 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e79bbbdc-5c19-451f-966c-e5cb40e7cf8d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.2166457 Nov 24 04:14:18.302811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34630) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.336790 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:18.395129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-354237e6-7165-4509-a353-6d49a6f1c0cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.403190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b0168703-1d65-4601-a9d4-707b71511c7a None None] Provisioning complete for port f856284c-e3d7-42b5-b16f-4799edadaa2e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:18.403931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b0168703-1d65-4601-a9d4-707b71511c7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.454956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-354237e6-7165-4509-a353-6d49a6f1c0cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.519542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b8d18ab-849b-43c4-84bf-ead34a52dc9f req-3c06db07-1dce-4aae-a354-bdba18bba86a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:18.524203 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1b8d18ab-849b-43c4-84bf-ead34a52dc9f req-3c06db07-1dce-4aae-a354-bdba18bba86a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0999794 Nov 24 04:14:18.540967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b0168703-1d65-4601-a9d4-707b71511c7a None None] Port f856284c-e3d7-42b5-b16f-4799edadaa2e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:18.546949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-354237e6-7165-4509-a353-6d49a6f1c0cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.550124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-354237e6-7165-4509-a353-6d49a6f1c0cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.562247 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-354237e6-7165-4509-a353-6d49a6f1c0cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/ed22daa2-8a81-4eb8-aaec-8e789491ad0d HTTP/1.1" status: 204 len: 168 time: 0.2582815 Nov 24 04:14:18.579355 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34640) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.584579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b0168703-1d65-4601-a9d4-707b71511c7a None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:18.585107 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b0168703-1d65-4601-a9d4-707b71511c7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.596303 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 67bc197d-602a-4841-af57-ea492e9bb71d is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:18.607945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:18.611637 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:18.622804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:18.623198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.626575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=fbf4e1b8-fa0f-499f-b41b-dc896569c826,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:18.627918 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-354237e6-7165-4509-a353-6d49a6f1c0cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed22daa2-8a81-4eb8-aaec-8e789491ad0d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:18.680572 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4423ad45-3df4-4984-9583-dcbde613e48e req-0765a668-da31-47e1-b1f1-c3f837e3442b tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6909091 Nov 24 04:14:18.698340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34642) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.698586 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7818a88b-57c8-4e24-8598-b9a4889afe6a tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1101692 Nov 24 04:14:18.715798 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1b8d18ab-849b-43c4-84bf-ead34a52dc9f req-b0f87f0b-17c4-4ca6-9eee-06b87034188d tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1746581 Nov 24 04:14:18.717043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--2129472640'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:18.760141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:18.760833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.770892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.803247 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ffb6aa85-a027-4e3b-9333-07c8a7150c64 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 1.9679036 Nov 24 04:14:18.807535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34644) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.814989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.823398 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.878001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.882062 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.9570713 Nov 24 04:14:18.884851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34646) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.887413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-164cf216-beda-4a16-981b-e3c5796017df tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:18.893055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] Update dhcp port {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'fixed_ips': [{'subnet_id': 'a923e012-ebc0-4328-95fb-36c372b05b6f', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '6fe10406-bbec-4bff-9fd6-20c49727626a'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '41d439ed-bbec-4ce1-ae8e-751809219ca2'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:14:18.893266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1288311895', 'security_groups': ['26a57360-9306-4d6e-8e7f-6d5f91ebc1f7'], 'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '6fe10406-bbec-4bff-9fd6-20c49727626a'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:18.893386 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-164cf216-beda-4a16-981b-e3c5796017df tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.11 HTTP/1.1" status: 200 len: 923 time: 0.0846148 Nov 24 04:14:18.895130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34648) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:18.896716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-667ec2f7-fcf1-4e6f-b872-f0ad01437b47 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'SecurityGroup': ['ID=26a57360-9306-4d6e-8e7f-6d5f91ebc1f7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:18.931140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:18.933279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.002585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.007320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,segment=NetworkSegment(8f741cab-4cc9-4aa9-871d-e1fb2bbbe516),segment_id=8f741cab-4cc9-4aa9-871d-e1fb2bbbe516)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:19.011640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.043478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port fbf4e1b8-fa0f-499f-b41b-dc896569c826 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:19.043770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.068491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.072536 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3686090 Nov 24 04:14:19.072795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34650) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.080590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c4d41755-c6fd-4b15-af2b-6fc66c51a1a8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'f7ccedb9-2525-462f-8211-cad649f17d9c', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:19.081361 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-c4d41755-c6fd-4b15-af2b-6fc66c51a1a8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Nov 24 04:14:19.081864 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-c4d41755-c6fd-4b15-af2b-6fc66c51a1a8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:19.082892 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c4d41755-c6fd-4b15-af2b-6fc66c51a1a8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0092199 Nov 24 04:14:19.083604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa16963-18a9-44ce-b496-b1b127780995 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f7ccedb9-2525-462f-8211-cad649f17d9c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.085854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34652) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.107518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.111803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:19.206173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] Allocated IP 2001:db8::2 (721c2ec6-3abd-47ff-80e2-24b3c8106daa/6fe10406-bbec-4bff-9fd6-20c49727626a/41d439ed-bbec-4ce1-ae8e-751809219ca2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:19.208273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.225831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.226343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6ce6d5a-b8a0-4e6f-9d24-31edde7e04c6 None None] Network 67bc197d-602a-4841-af57-ea492e9bb71d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:19.231097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4797b365-d4a7-4b2e-bf06-4da07fa01414 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.233968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.249225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] device_id is not set on port 86207174-84ce-4ddd-85c5-85cebfa75486 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:19.256876 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for fbf4e1b8-fa0f-499f-b41b-dc896569c826 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:19.273919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4797b365-d4a7-4b2e-bf06-4da07fa01414 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.364064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4797b365-d4a7-4b2e-bf06-4da07fa01414 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.367008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4797b365-d4a7-4b2e-bf06-4da07fa01414 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.370614 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4797b365-d4a7-4b2e-bf06-4da07fa01414 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/f7ccedb9-2525-462f-8211-cad649f17d9c HTTP/1.1" status: 204 len: 168 time: 0.2811780 Nov 24 04:14:19.371707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34654) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.387914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4797b365-d4a7-4b2e-bf06-4da07fa01414 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7ccedb9-2525-462f-8211-cad649f17d9c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.428071 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1e9cd127-ae1a-4f9a-951f-1febdd3c0ac9 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0502760 Nov 24 04:14:19.428071 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34656) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.431924 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--1304468355'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:19.456586 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.457895 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.488843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=fbf4e1b8-fa0f-499f-b41b-dc896569c826,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.534496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.539992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.547946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a2603f46-0dd9-41be-9eae-c7238b59f513 None None] Provisioning complete for port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:19.548600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a2603f46-0dd9-41be-9eae-c7238b59f513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.566864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.572805 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ff13023a-4844-4b88-babb-a8ae5593f4b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/fbf4e1b8-fa0f-499f-b41b-dc896569c826 HTTP/1.1" status: 204 len: 168 time: 0.6740093 Nov 24 04:14:19.573201 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34658) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.586909 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.588068 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1596854 Nov 24 04:14:19.591176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34660) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.596333 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-fffdf696-07f7-4ee7-bca2-866d6a9c6e4e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'ab897242-8b3f-46c1-b98c-9f81e4a0f7a7', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:19.596902 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-fffdf696-07f7-4ee7-bca2-866d6a9c6e4e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Nov 24 04:14:19.597405 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-fffdf696-07f7-4ee7-bca2-866d6a9c6e4e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:19.601608 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fffdf696-07f7-4ee7-bca2-866d6a9c6e4e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0061991 Nov 24 04:14:19.601779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34662) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.603904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f16300f3-5abf-4612-b5a5-4a784281093e tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ab897242-8b3f-46c1-b98c-9f81e4a0f7a7,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.607150 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-bc0a091b-6fb7-45d2-9f25-932771591c83 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:19.611852 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bc0a091b-6fb7-45d2-9f25-932771591c83 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/fbf4e1b8-fa0f-499f-b41b-dc896569c826 HTTP/1.1" status: 404 len: 333 time: 0.0327048 Nov 24 04:14:19.611852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34664) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.644795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=41d439ed-bbec-4ce1-ae8e-751809219ca2,segment=NetworkSegment(b386343f-6228-4702-a514-5fe49462e4e7),segment_id=b386343f-6228-4702-a514-5fe49462e4e7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:19.669732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cc00ad49-d848-498b-af87-825d10b145cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.693147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cc00ad49-d848-498b-af87-825d10b145cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.701460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.703939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port c2f85059-2ba7-42c6-b91d-ce34ab88b6ab {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:19.705126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.729730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.758020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cc00ad49-d848-498b-af87-825d10b145cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.762679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cc00ad49-d848-498b-af87-825d10b145cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.768561 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cc00ad49-d848-498b-af87-825d10b145cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/ab897242-8b3f-46c1-b98c-9f81e4a0f7a7 HTTP/1.1" status: 204 len: 168 time: 0.1655705 Nov 24 04:14:19.769302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34670) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.798439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc00ad49-d848-498b-af87-825d10b145cf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab897242-8b3f-46c1-b98c-9f81e4a0f7a7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.867105 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2bedb03e-70bf-48e2-b1b7-df59d2f32287 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0883765 Nov 24 04:14:19.867355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b72c9e-eeda-426e-82c2-1eb976bea9cd None None] Pushing event updated for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=6']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:19.881443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:19.883007 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34672) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:19.888340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--1075179609'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:19.895997 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for c2f85059-2ba7-42c6-b91d-ce34ab88b6ab owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:19.948624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae36218-df9d-449f-b872-a21758ae76de req-524669d6-2bc0-49e1-9bca-217a8bbf4eef tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:19.950201 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fae36218-df9d-449f-b872-a21758ae76de req-524669d6-2bc0-49e1-9bca-217a8bbf4eef tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1138608 Nov 24 04:14:19.959307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.065378 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fae36218-df9d-449f-b872-a21758ae76de req-eca71159-c931-437f-bb27-6ee61da8414d tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0876310 Nov 24 04:14:20.102258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8::18c (721c2ec6-3abd-47ff-80e2-24b3c8106daa/6fe10406-bbec-4bff-9fd6-20c49727626a/86207174-84ce-4ddd-85c5-85cebfa75486) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:20.118471 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.124013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.129197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8760b37-e4c4-40c7-ae0c-94787411919b req-6a860f0d-e7b0-49cc-99c0-30616e305a7f tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:20.130830 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a8760b37-e4c4-40c7-ae0c-94787411919b req-6a860f0d-e7b0-49cc-99c0-30616e305a7f tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.3384502 Nov 24 04:14:20.143825 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9285a36e-4f84-4c9e-ae78-47802c709552 None None] Could not find standard attr ID for object c2f85059-2ba7-42c6-b91d-ce34ab88b6ab. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:20.147651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.168890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9285a36e-4f84-4c9e-ae78-47802c709552 None None] Provisioning complete for port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:20.169476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9285a36e-4f84-4c9e-ae78-47802c709552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.190483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.191866 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3070092 Nov 24 04:14:20.196497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34674) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.204172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7761e8bf-5127-48d5-a22f-22c89a689a47 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'aef14d42-d688-4741-ab83-1ac2484940b8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:20.205689 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-7761e8bf-5127-48d5-a22f-22c89a689a47 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Nov 24 04:14:20.206452 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-7761e8bf-5127-48d5-a22f-22c89a689a47 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:20.207766 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7761e8bf-5127-48d5-a22f-22c89a689a47 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0102134 Nov 24 04:14:20.216155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34676) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.228415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4f788612-5bcd-4063-949e-d8769b72c754 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'aef14d42-d688-4741-ab83-1ac2484940b8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:20.232031 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-4f788612-5bcd-4063-949e-d8769b72c754 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Nov 24 04:14:20.232677 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-4f788612-5bcd-4063-949e-d8769b72c754 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:20.236361 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4f788612-5bcd-4063-949e-d8769b72c754 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0142941 Nov 24 04:14:20.239829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34678) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.245981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3ebb8307-78a8-4bb7-8522-2f2b94d2fe5f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'aef14d42-d688-4741-ab83-1ac2484940b8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:20.263839 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-3ebb8307-78a8-4bb7-8522-2f2b94d2fe5f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Nov 24 04:14:20.264526 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-3ebb8307-78a8-4bb7-8522-2f2b94d2fe5f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:20.265887 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3ebb8307-78a8-4bb7-8522-2f2b94d2fe5f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0247376 Nov 24 04:14:20.267334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6305fbbe-68d7-4fbd-a2b5-112ac0490b87 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aef14d42-d688-4741-ab83-1ac2484940b8,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:20.270459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34680) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.277977 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-32615623-aad8-4b92-b642-203f9499fedb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': 'aef14d42-d688-4741-ab83-1ac2484940b8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:20.280110 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-32615623-aad8-4b92-b642-203f9499fedb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Nov 24 04:14:20.280722 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-32615623-aad8-4b92-b642-203f9499fedb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:20.281846 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-32615623-aad8-4b92-b642-203f9499fedb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0102966 Nov 24 04:14:20.284824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34682) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.288763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=c2f85059-2ba7-42c6-b91d-ce34ab88b6ab,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:20.307648 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:20.365035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7201437-5d9c-4b80-a45f-1065cb446877 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.390898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:20.391273 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.398344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7201437-5d9c-4b80-a45f-1065cb446877 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.436420 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a8760b37-e4c4-40c7-ae0c-94787411919b req-4d9ec648-447d-4c46-9f7c-34f4d8399b5e tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2907779 Nov 24 04:14:20.450010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.454199 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0fa3ea72-c77e-426b-a1d4-8a6411a5580c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/c2f85059-2ba7-42c6-b91d-ce34ab88b6ab HTTP/1.1" status: 204 len: 168 time: 0.8410959 Nov 24 04:14:20.456718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34686) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.517900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7201437-5d9c-4b80-a45f-1065cb446877 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.529146 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7201437-5d9c-4b80-a45f-1065cb446877 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.531437 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c7201437-5d9c-4b80-a45f-1065cb446877 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/aef14d42-d688-4741-ab83-1ac2484940b8 HTTP/1.1" status: 204 len: 168 time: 0.2453399 Nov 24 04:14:20.533882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34690) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.536463 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-60f63a94-8c1d-41ea-a7b0-d4e6df075ac7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:20.538129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:20.540349 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-60f63a94-8c1d-41ea-a7b0-d4e6df075ac7 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/c2f85059-2ba7-42c6-b91d-ce34ab88b6ab HTTP/1.1" status: 404 len: 333 time: 0.0827081 Nov 24 04:14:20.544533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34692) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.590565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.604653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-356984ae-2f09-49b6-a9bf-92cae80f1ddb None None] Could not find standard attr ID for object c2f85059-2ba7-42c6-b91d-ce34ab88b6ab. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:20.621461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:20.622269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.646233 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fd92c13b-30a5-4d5e-bdcd-87c6351e5364 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1071012 Nov 24 04:14:20.653060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34694) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:20.663108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--507949551'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:20.700045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:20.715594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.761482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7201437-5d9c-4b80-a45f-1065cb446877 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aef14d42-d688-4741-ab83-1ac2484940b8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:20.800781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.813334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.839063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.887809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065833be-95b1-4c5f-9507-d3010226b689 req-a17ea794-cd1e-421b-9204-916a49c5544d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:20.889440 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-a17ea794-cd1e-421b-9204-916a49c5544d service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=1f9bf64d67774d1fb7ab8d25db416cdd&device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 1099 time: 0.1062880 Nov 24 04:14:20.890461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:20.902492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a2ad55-d98d-436a-b7ef-2e72ba178376 req-11b5151d-29ff-42c9-8715-9901192d70b7 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:20.903902 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-49a2ad55-d98d-436a-b7ef-2e72ba178376 req-11b5151d-29ff-42c9-8715-9901192d70b7 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1495297 Nov 24 04:14:20.913574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:20.925732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:20.930449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ddcf0fb6-dece-4a36-a9b9-10e506bac461 None None] Could not find standard attr ID for object fbf4e1b8-fa0f-499f-b41b-dc896569c826. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:20.931787 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:20.932452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.934886 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=86207174-84ce-4ddd-85c5-85cebfa75486,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:20.953774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ddcf0fb6-dece-4a36-a9b9-10e506bac461 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:20.954374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ddcf0fb6-dece-4a36-a9b9-10e506bac461 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:20.988032 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e3862a82-f4dc-4951-8cf0-7c78ad9a2295 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.0980554 Nov 24 04:14:20.990758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34698) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.000575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.062620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.097920 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-49a2ad55-d98d-436a-b7ef-2e72ba178376 req-275562e1-0aa0-4cae-8add-0184e6a51cda tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1805744 Nov 24 04:14:21.129636 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.130763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ddcf0fb6-dece-4a36-a9b9-10e506bac461 None None] Provisioning complete for port f856284c-e3d7-42b5-b16f-4799edadaa2e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:21.130893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ddcf0fb6-dece-4a36-a9b9-10e506bac461 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.139853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.163621 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065833be-95b1-4c5f-9507-d3010226b689 req-030e3c1a-01c5-415a-8df6-7564b0f4731d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:21.165045 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-030e3c1a-01c5-415a-8df6-7564b0f4731d service neutron] 10.222.0.21 "GET /v2.0/networks?id=acefce04-02aa-44cc-bb30-373d1b065eae HTTP/1.1" status: 200 len: 912 time: 0.2655184 Nov 24 04:14:21.191948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2c96d943-263f-4642-ba39-3f4611c25537,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:21.212049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ddcf0fb6-dece-4a36-a9b9-10e506bac461 None None] Port f856284c-e3d7-42b5-b16f-4799edadaa2e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:21.219009 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-616baffe-5544-454c-9549-91189aebe236 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ce904412-401d-4df1-801f-c17322c730b9 HTTP/1.1" status: 200 len: 217 time: 0.0446410 Nov 24 04:14:21.236963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.238490 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-57f3d741-7048-4530-a744-b16ab3d8a0c6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5844469 Nov 24 04:14:21.242235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34702) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.248734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-65b063de-8550-4d8e-b8ba-71ee59b9707f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.249222 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-65b063de-8550-4d8e-b8ba-71ee59b9707f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 24 04:14:21.249715 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-65b063de-8550-4d8e-b8ba-71ee59b9707f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.250741 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-65b063de-8550-4d8e-b8ba-71ee59b9707f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0054731 Nov 24 04:14:21.254044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34704) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.258647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-72bd6f52-3335-4d2f-bbce-5a1124244a54 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.278073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:21.281783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.299731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.342909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:21.350186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065833be-95b1-4c5f-9507-d3010226b689 req-e5e62af7-5abf-4f6f-9923-82eae5942d8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:21.351752 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-e5e62af7-5abf-4f6f-9923-82eae5942d8a service neutron] 10.222.0.21 "GET /v2.0/subnets?id=16303810-2955-433b-bb61-fa9692bb82ad HTTP/1.1" status: 200 len: 851 time: 0.1214888 Nov 24 04:14:21.352889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.358504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7ababe12-5aae-4c8f-a59f-5495dc57a307 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8 HTTP/1.1" status: 204 len: 168 time: 0.8065341 Nov 24 04:14:21.360467 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34706) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.364252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee49e17-ba24-4803-a1c9-18604fdbe4bb req-24de2338-fbb6-4d4d-9dd6-c0aa11753f45 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:21.365791 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aee49e17-ba24-4803-a1c9-18604fdbe4bb req-24de2338-fbb6-4d4d-9dd6-c0aa11753f45 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1488092 Nov 24 04:14:21.397426 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-e89bf778-9692-4427-a597-321931ef0041 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=acefce04-02aa-44cc-bb30-373d1b065eae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0306134 Nov 24 04:14:21.425366 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-72bd6f52-3335-4d2f-bbce-5a1124244a54 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.426472 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-72bd6f52-3335-4d2f-bbce-5a1124244a54 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1714139 Nov 24 04:14:21.436005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a8a80be4-db3d-443f-9c84-2f97e901f3a1 None None] Provisioning complete for port 86207174-84ce-4ddd-85c5-85cebfa75486 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:21.436553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a8a80be4-db3d-443f-9c84-2f97e901f3a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.438950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34708) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.455203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-84b11d98-b3b9-482f-965c-1898e4c1eaca tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.455686 dv-neutron-819049-1-hyperv neutron-server[103381]: WARNING neutron.api.v2.base [None req-84b11d98-b3b9-482f-965c-1898e4c1eaca tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Nov 24 04:14:21.456177 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-84b11d98-b3b9-482f-965c-1898e4c1eaca tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.457168 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-84b11d98-b3b9-482f-965c-1898e4c1eaca tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0172393 Nov 24 04:14:21.460194 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34710) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.468505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c85e8471-aead-4a16-af31-6a5ee6bf67bc tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.478623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a8a80be4-db3d-443f-9c84-2f97e901f3a1 None None] Port 86207174-84ce-4ddd-85c5-85cebfa75486 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:21.488030 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 6fe10406-bbec-4bff-9fd6-20c49727626a (CIDR: 2001:db8::/64) Nov 24 04:14:21.496448 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.496918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:21.505738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.545062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc00bbf2-481d-44f7-93d9-2bc711c74c0e None None] Network 67bc197d-602a-4841-af57-ea492e9bb71d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:21.556673 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-859f8cca-74fc-4f88-819c-e41923d0ea5d tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5607989 Nov 24 04:14:21.562184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34712) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.569820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.588610 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-c85e8471-aead-4a16-af31-6a5ee6bf67bc tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.589957 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c85e8471-aead-4a16-af31-6a5ee6bf67bc tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1287961 Nov 24 04:14:21.595252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34714) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.602054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-74e925b3-3725-4000-a6b5-8c9eec537b75 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.602852 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-74e925b3-3725-4000-a6b5-8c9eec537b75 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 24 04:14:21.604208 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-74e925b3-3725-4000-a6b5-8c9eec537b75 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.605389 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-74e925b3-3725-4000-a6b5-8c9eec537b75 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0080347 Nov 24 04:14:21.613221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34716) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.621143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c0b3d126-4546-424f-97d6-de8401499c14 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.704598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:21.704951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.725014 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-c0b3d126-4546-424f-97d6-de8401499c14 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Project 3e548383c4c6445fad1558d30088f9fd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:14:21.756362 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] DHCP port deletion for 67bc197d-602a-4841-af57-ea492e9bb71d request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:21.777652 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-c0b3d126-4546-424f-97d6-de8401499c14 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.778752 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c0b3d126-4546-424f-97d6-de8401499c14 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1632473 Nov 24 04:14:21.785364 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34718) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.799119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c7446047-237c-47de-b966-c228a662f3fb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.799611 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-c7446047-237c-47de-b966-c228a662f3fb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Nov 24 04:14:21.800105 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-c7446047-237c-47de-b966-c228a662f3fb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:21.801102 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c7446047-237c-47de-b966-c228a662f3fb tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0134277 Nov 24 04:14:21.805639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34720) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:21.815723 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-bd378714-f7e3-4698-8dfe-7ca26d5db5f1 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:21.821621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] For port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,segment=NetworkSegment(8f741cab-4cc9-4aa9-871d-e1fb2bbbe516),segment_id=8f741cab-4cc9-4aa9-871d-e1fb2bbbe516)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:21.821806 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] Deleting port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:21.822217 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.822340 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.838534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:21.843748 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:21.847806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.849478 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aee49e17-ba24-4803-a1c9-18604fdbe4bb req-c9195f05-edf0-4a1f-98b3-0d6274355c44 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4740539 Nov 24 04:14:21.880458 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-f7f98b34-308e-4578-8e39-f9e9c5eecf7e service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4730380 Nov 24 04:14:21.910909 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] For port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,segment=NetworkSegment(8f741cab-4cc9-4aa9-871d-e1fb2bbbe516),segment_id=8f741cab-4cc9-4aa9-871d-e1fb2bbbe516)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:21.911212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:21.928427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] Calling delete_port for ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:21.957311 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-bd378714-f7e3-4698-8dfe-7ca26d5db5f1 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Project 3e548383c4c6445fad1558d30088f9fd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:14:21.996327 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-065833be-95b1-4c5f-9507-d3010226b689 req-6d516d13-a441-4ef6-929a-54d93d473baa service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1081815 Nov 24 04:14:22.000160 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-bd378714-f7e3-4698-8dfe-7ca26d5db5f1 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:22.001775 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bd378714-f7e3-4698-8dfe-7ca26d5db5f1 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.1937137 Nov 24 04:14:22.006656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34722) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.011195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9b097853-3fbd-4d12-9904-a64f77d3bb86 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '2c96d943-263f-4642-ba39-3f4611c25537', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.012973 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet a923e012-ebc0-4328-95fb-36c372b05b6f (CIDR: 2001:db8:0:1::/64) Nov 24 04:14:22.018013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.022417 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:22.022880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:22.034061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.042914 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-9b097853-3fbd-4d12-9904-a64f77d3bb86 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Project 3e548383c4c6445fad1558d30088f9fd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:14:22.051305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] Pushing event deleted for resources: {'Port': ['ID=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.054835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bcfdaec-080c-4e5f-ab91-261068b03ad4 None None] No DVR routers for this DVR port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:22.058801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.068732 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fab132b4-a9d8-49b3-9226-bbbf310e6224 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.5027206 Nov 24 04:14:22.068732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No DVR routers for this DVR port ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:22.069490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34724) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.074383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'subnet': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.075679 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-9b097853-3fbd-4d12-9904-a64f77d3bb86 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:22.078182 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9b097853-3fbd-4d12-9904-a64f77d3bb86 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0694618 Nov 24 04:14:22.080509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34726) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.134645 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b4d91161-cb70-487b-b29d-29922f4d798f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.163235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b4d91161-cb70-487b-b29d-29922f4d798f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.218837 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.221320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:22.224768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b4d91161-cb70-487b-b29d-29922f4d798f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.227575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b4d91161-cb70-487b-b29d-29922f4d798f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.231238 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b4d91161-cb70-487b-b29d-29922f4d798f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/2c96d943-263f-4642-ba39-3f4611c25537 HTTP/1.1" status: 204 len: 168 time: 0.1472208 Nov 24 04:14:22.232104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34730) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.248318 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:22.248758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ddf9d310-a2dd-4fc5-8826-d6fcd81f95d2 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:22.254056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d91161-cb70-487b-b29d-29922f4d798f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c96d943-263f-4642-ba39-3f4611c25537,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.284434 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-15d8f6e7-6228-4778-b7e8-6f441bc92c27 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0500422 Nov 24 04:14:22.286035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['67bc197d-602a-4841-af57-ea492e9bb71d']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:22.289017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34732) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.292799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--219112502'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.304747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:22.305046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f741cab-4cc9-4aa9-871d-e1fb2bbbe516') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:22.318961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.322047 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.324306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.db.api [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 04:14:22.324306 dv-neutron-819049-1-hyperv neutron-server[103380]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 24 04:14:22.324306 dv-neutron-819049-1-hyperv neutron-server[103380]: [parameters: {'project_id': '372dd3329b1c46059a975406a09b4bcc', 'id': '5adaf920-e869-476b-9c3e-d86cc79e4433', 'expiration': datetime.datetime(2021, 11, 24, 4, 16, 22, 308021)}] Nov 24 04:14:22.324306 dv-neutron-819049-1-hyperv neutron-server[103380]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103380) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:14:22.324711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG oslo_db.api [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:14:22.337304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7618b4f5-729e-4785-94fc-34177ac816dd req-2870ace3-3d81-4b71-ab58-6b6157ce5c19 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:22.338825 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7618b4f5-729e-4785-94fc-34177ac816dd req-2870ace3-3d81-4b71-ab58-6b6157ce5c19 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1236496 Nov 24 04:14:22.352865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.366959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 151 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:22.367587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: self.session.flush() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:22.370608 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:22.389827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.394645 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.426720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.427921 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1387708 Nov 24 04:14:22.430831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34734) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.434999 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-516489d8-ca85-42f3-9c69-7fc276b7c5b8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '6b432b76-df92-451e-ac85-24416ed26d18', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.443513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29aa3ba3-3945-4fd3-9f15-d22f49b41c72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6b432b76-df92-451e-ac85-24416ed26d18,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.445229 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7618b4f5-729e-4785-94fc-34177ac816dd req-4b042fc1-9684-4484-8d61-902bdaebde6e tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991907 Nov 24 04:14:22.455147 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.463855 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.467044 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/67bc197d-602a-4841-af57-ea492e9bb71d HTTP/1.1" status: 204 len: 168 time: 1.1050153 Nov 24 04:14:22.471276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34736) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.477116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-756796655'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.479271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80510736-8ccd-4d3b-8335-8054f5a55159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=67bc197d-602a-4841-af57-ea492e9bb71d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.510281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:22.514121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.523461 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-516489d8-ca85-42f3-9c69-7fc276b7c5b8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The resource could not be found. Nov 24 04:14:22.524454 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-516489d8-ca85-42f3-9c69-7fc276b7c5b8 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.0927312 Nov 24 04:14:22.528018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34738) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.532391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8aa81c44-311e-4c54-8791-12945151a349 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '6b432b76-df92-451e-ac85-24416ed26d18', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': '2cdadaa2-458f-4ea8-bf74-6012b8dd2e2f'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.555554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 166, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:22.568122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.568463 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment 4cf1b5ff-984c-41d9-87fd-e613c81612f9 of type vlan for network a95d5001-fb6e-49e5-845e-f7c973250bb7 Nov 24 04:14:22.616269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.623356 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-8aa81c44-311e-4c54-8791-12945151a349 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The resource could not be found. Nov 24 04:14:22.624394 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8aa81c44-311e-4c54-8791-12945151a349 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0954413 Nov 24 04:14:22.627768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34740) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.668791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.674783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:22.675375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.720821 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.2480288 Nov 24 04:14:22.723524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34742) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.728732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.766836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5d274b2-a16e-47c6-bd1f-c9aa2c10fa69 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.769280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad6a0da-fd21-4dc6-aa28-acd27d17e672 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=a95d5001-fb6e-49e5-845e-f7c973250bb7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.781403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:22.791735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5d274b2-a16e-47c6-bd1f-c9aa2c10fa69 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.823600 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:22.827145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.841177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5d274b2-a16e-47c6-bd1f-c9aa2c10fa69 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.843910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e5d274b2-a16e-47c6-bd1f-c9aa2c10fa69 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:22.847619 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e5d274b2-a16e-47c6-bd1f-c9aa2c10fa69 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/6b432b76-df92-451e-ac85-24416ed26d18 HTTP/1.1" status: 204 len: 168 time: 0.2165067 Nov 24 04:14:22.850053 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34746) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.862585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d274b2-a16e-47c6-bd1f-c9aa2c10fa69 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b432b76-df92-451e-ac85-24416ed26d18,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:22.921982 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6b091172-23bc-4de8-b1e4-268fdcb81656 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0705788 Nov 24 04:14:22.927040 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34750) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:22.932301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-14b49703-ec68-4443-b861-c448490eb635 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '3ae6dbda-5d32-4a84-9529-abc6b09336a4', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:22.937673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Made reservation on behalf of 372dd3329b1c46059a975406a09b4bcc for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:22.942525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.004869 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-14b49703-ec68-4443-b861-c448490eb635 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The resource could not be found. Nov 24 04:14:23.005834 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-14b49703-ec68-4443-b861-c448490eb635 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0776553 Nov 24 04:14:23.013055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34752) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:23.014161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4c490b-1153-42cc-9229-073cfe2704ed req-04c8f558-2ab0-4459-bfb6-0537bf5542ce tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:23.015631 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7d4c490b-1153-42cc-9229-073cfe2704ed req-04c8f558-2ab0-4459-bfb6-0537bf5542ce tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0678408 Nov 24 04:14:23.022032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--322850332'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:23.071916 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7d4c490b-1153-42cc-9229-073cfe2704ed req-8597e770-4602-465a-b738-dfc40a02d698 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485001 Nov 24 04:14:23.105818 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.179062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.309938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:23.332411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.337697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.344451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': '4cf1b5ff-984c-41d9-87fd-e613c81612f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:23.345484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: a95d5001-fb6e-49e5-845e-f7c973250bb7, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:23.408399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.409621 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3956220 Nov 24 04:14:23.412630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34754) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:23.413449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002a008a-da35-4bfb-829e-dbb19cb40bf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=092c78a3-ec28-47a7-8f6a-786506de6e9b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:23.418406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--1265133474'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:23.428563 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:23.443374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.447328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, a95d5001-fb6e-49e5-845e-f7c973250bb7) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:23.452033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:23.453049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.457908 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.458797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f484ed1-1b64-4af9-9e30-157c1146ec80 None None] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:23.519977 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dc1df8a8-a5dc-484c-a8b4-4e8866e4ab88 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7947032 Nov 24 04:14:23.522685 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:23.527416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34758) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:23.530300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.533859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7', 'name': 'tempest-PortsTestJSON-288543720', 'fixed_ips': [{'subnet_id': 'a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06', 'ip_address': '172.20.0.10'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:23.536089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.541066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:23.543258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:23.544029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.554695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5860828a-1d87-4b0d-ba8d-9b53f0f0d690 None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:23.568982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.572791 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1560338 Nov 24 04:14:23.572791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e71b14b-3e22-4f1b-94c6-bc7febce6906 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4282de2b-0143-41d4-853d-edaa3fd943fd,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:23.574311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34760) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:23.579705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5121fa1d-e1f1-439f-ab07-8da640c329bf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '092c78a3-ec28-47a7-8f6a-786506de6e9b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '4282de2b-0143-41d4-853d-edaa3fd943fd'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:23.626891 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-5121fa1d-e1f1-439f-ab07-8da640c329bf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:23.631566 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5121fa1d-e1f1-439f-ab07-8da640c329bf tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.0536273 Nov 24 04:14:23.631727 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.5602899 Nov 24 04:14:23.631727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00fea6d7-358b-423d-9e36-e1b83c263dfb tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Subnet': ['ID=184a4566-153d-4dfe-9683-1936347d996c,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:23.634001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34762) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:23.634575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34764) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:23.648666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-155779019', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '184a4566-153d-4dfe-9683-1936347d996c'}], 'security_groups': ['3fde5947-4300-45ce-b4fd-0a58ec9b75df', '30329d92-f621-4567-a88c-97534ef84e7d']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:23.695292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0ec1d2-7915-46c5-8b2e-8dd22bea5bb6 req-9f3b954d-e865-4520-af8a-3702fb8c756d tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:23.702504 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0b0ec1d2-7915-46c5-8b2e-8dd22bea5bb6 req-9f3b954d-e865-4520-af8a-3702fb8c756d tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1537061 Nov 24 04:14:23.721224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a95d5001-fb6e-49e5-845e-f7c973250bb7', 'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': 'a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:23.722256 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.770829 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0b0ec1d2-7915-46c5-8b2e-8dd22bea5bb6 req-82070ee8-7946-4a8a-938f-a7209dfcf2e4 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674341 Nov 24 04:14:23.772188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:23.793061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d16bc109-1d1c-4901-991a-a8d864261a7f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.832292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d16bc109-1d1c-4901-991a-a8d864261a7f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.898804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.903389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:23.942490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port dda04eb8-66a7-4239-89fa-729252577b76 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:23.961303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Allocated IP 172.20.0.2 (a95d5001-fb6e-49e5-845e-f7c973250bb7/a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06/e216d7de-3fc8-46cc-acb3-2a4eaa026102) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:23.988521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] Update dhcp port {'port': {'network_id': '721c2ec6-3abd-47ff-80e2-24b3c8106daa', 'fixed_ips': [{'subnet_id': 'a923e012-ebc0-4328-95fb-36c372b05b6f', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': '6fe10406-bbec-4bff-9fd6-20c49727626a', 'ip_address': '2001:db8::2'}, {'subnet_id': '184a4566-153d-4dfe-9683-1936347d996c'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '41d439ed-bbec-4ce1-ae8e-751809219ca2'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:14:24.006949 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d16bc109-1d1c-4901-991a-a8d864261a7f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.014993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d16bc109-1d1c-4901-991a-a8d864261a7f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.025203 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d16bc109-1d1c-4901-991a-a8d864261a7f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/4282de2b-0143-41d4-853d-edaa3fd943fd HTTP/1.1" status: 204 len: 168 time: 0.3894298 Nov 24 04:14:24.026116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34770) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:24.055751 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.075777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d16bc109-1d1c-4901-991a-a8d864261a7f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4282de2b-0143-41d4-853d-edaa3fd943fd,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:24.131376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbcaddb-93af-4fc3-80d5-3f67f4694882 req-3345ffc5-f008-4171-bc16-03fdcab33167 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:24.133088 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-acbcaddb-93af-4fc3-80d5-3f67f4694882 req-3345ffc5-f008-4171-bc16-03fdcab33167 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.0647712 Nov 24 04:14:24.155509 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f9f6571d-675f-4cf7-a39e-12af8a519009 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.1177883 Nov 24 04:14:24.156109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34774) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:24.191964 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-acbcaddb-93af-4fc3-80d5-3f67f4694882 req-f25d042d-58e4-4974-b635-40200276db4f tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527472 Nov 24 04:14:24.297224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.303631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.339409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c026cb-f8c9-4d5e-aea2-1be3d29271ef req-e4358304-43d8-44fc-91a0-be8bdf8e491c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:24.340821 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b2c026cb-f8c9-4d5e-aea2-1be3d29271ef req-e4358304-43d8-44fc-91a0-be8bdf8e491c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1243746 Nov 24 04:14:24.343734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27b77587-40e6-46ea-b79c-f7ddd455965f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.348786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:24.353788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:24.358297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:24.366553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Pushing event updated for resources: {'Port': ['ID=e216d7de-3fc8-46cc-acb3-2a4eaa026102,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:24.368809 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.10 (a95d5001-fb6e-49e5-845e-f7c973250bb7/a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06/dda04eb8-66a7-4239-89fa-729252577b76) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:24.402508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27b77587-40e6-46ea-b79c-f7ddd455965f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.488082 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b2c026cb-f8c9-4d5e-aea2-1be3d29271ef req-fb201ccf-61c5-4ca2-b33e-0e28cb4bfac2 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1396806 Nov 24 04:14:24.516467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Delete allocated IP 2001:db8::18c (721c2ec6-3abd-47ff-80e2-24b3c8106daa/6fe10406-bbec-4bff-9fd6-20c49727626a) {{(pid=103381) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 04:14:24.523881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27b77587-40e6-46ea-b79c-f7ddd455965f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.527214 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-27b77587-40e6-46ea-b79c-f7ddd455965f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.531311 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-27b77587-40e6-46ea-b79c-f7ddd455965f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/092c78a3-ec28-47a7-8f6a-786506de6e9b HTTP/1.1" status: 204 len: 168 time: 0.3717356 Nov 24 04:14:24.531774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34776) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:24.537171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Allocated IP 2001:db8:0:2::38 (721c2ec6-3abd-47ff-80e2-24b3c8106daa/184a4566-153d-4dfe-9683-1936347d996c/86207174-84ce-4ddd-85c5-85cebfa75486) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:24.552689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b77587-40e6-46ea-b79c-f7ddd455965f tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=092c78a3-ec28-47a7-8f6a-786506de6e9b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:24.588554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.595706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Attempting to bind port e216d7de-3fc8-46cc-acb3-2a4eaa026102 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:24.596011 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Attempting to bind port e216d7de-3fc8-46cc-acb3-2a4eaa026102 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '4cf1b5ff-984c-41d9-87fd-e613c81612f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:24.596212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Attempting to bind port e216d7de-3fc8-46cc-acb3-2a4eaa026102 on network a95d5001-fb6e-49e5-845e-f7c973250bb7 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:24.605146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:24.605457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Checking segment: {'id': '4cf1b5ff-984c-41d9-87fd-e613c81612f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:24.605915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.606336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Bound using segment: {'id': '4cf1b5ff-984c-41d9-87fd-e613c81612f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:24.606818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Bound port: e216d7de-3fc8-46cc-acb3-2a4eaa026102, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4cf1b5ff-984c-41d9-87fd-e613c81612f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:24.607225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.632784 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9cc889d0-31ef-40a1-bcdd-44f7ab853df6 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0942307 Nov 24 04:14:24.633744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34778) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:24.641056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--1679941501'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:24.656007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.681416 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] For port e216d7de-3fc8-46cc-acb3-2a4eaa026102, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:24.684613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] For port e216d7de-3fc8-46cc-acb3-2a4eaa026102, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e216d7de-3fc8-46cc-acb3-2a4eaa026102,segment=NetworkSegment(4cf1b5ff-984c-41d9-87fd-e613c81612f9),segment_id=4cf1b5ff-984c-41d9-87fd-e613c81612f9)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:24.689768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.701658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:24.707061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:24.711659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:24.720368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.745619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=dda04eb8-66a7-4239-89fa-729252577b76,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:24.759721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4446a94-83c2-4a12-b215-6557510ec2fd None None] Pushing event updated for resources: {'Port': ['ID=e216d7de-3fc8-46cc-acb3-2a4eaa026102,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:24.780516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:24.781354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.800948 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a64241e0-898c-4c8a-9aeb-6315874e5aa9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.2699428 Nov 24 04:14:24.802480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34780) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:24.806788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.812567 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': 'a95d5001-fb6e-49e5-845e-f7c973250bb7', 'name': 'tempest-PortsTestJSON-1766591387', 'fixed_ips': [{'subnet_id': 'a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06', 'ip_address': '172.20.0.9'}]}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:24.820665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.869672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] Allocated IP 2001:db8:0:2::2 (721c2ec6-3abd-47ff-80e2-24b3c8106daa/184a4566-153d-4dfe-9683-1936347d996c/41d439ed-bbec-4ce1-ae8e-751809219ca2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:24.931066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.991327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] In _notify_port_updated(), no bound segment for port 86207174-84ce-4ddd-85c5-85cebfa75486 on network 721c2ec6-3abd-47ff-80e2-24b3c8106daa {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:14:24.996884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:24.997546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:24.998894 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "PUT /v2.0/ports/86207174-84ce-4ddd-85c5-85cebfa75486 HTTP/1.1" status: 200 len: 968 time: 1.3620293 Nov 24 04:14:25.002038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34784) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.003934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9cc1971-0537-483c-94c4-ea65deba6f58 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event updated for resources: {'Port': ['ID=86207174-84ce-4ddd-85c5-85cebfa75486,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:25.004278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=41d439ed-bbec-4ce1-ae8e-751809219ca2,segment=NetworkSegment(b386343f-6228-4702-a514-5fe49462e4e7),segment_id=b386343f-6228-4702-a514-5fe49462e4e7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:25.006575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.061283 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.068498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.069207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.072840 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4359987 Nov 24 04:14:25.078595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34786) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.093012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6a6b7443-7537-4353-bec6-4be840ed6499 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '890e1dee-5fd9-45d2-b1e3-791aa24e5c03', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:25.116394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f858c8f-0c53-4cb2-a39e-a00c721c1237 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=890e1dee-5fd9-45d2-b1e3-791aa24e5c03,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:25.156817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:25.163979 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-6a6b7443-7537-4353-bec6-4be840ed6499 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:25.167894 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a6b7443-7537-4353-bec6-4be840ed6499 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.0840378 Nov 24 04:14:25.174653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port 86207174-84ce-4ddd-85c5-85cebfa75486 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:25.175171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.176015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34788) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.180402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4d0206a0-c5e6-40e0-b06c-2b97f8256a7c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group_rule': {'security_group_id': '890e1dee-5fd9-45d2-b1e3-791aa24e5c03', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:25.206467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34790) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.216800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f28ea38-dcf7-4b5e-859e-9549ebf53ba1 None None] Pushing event updated for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=7']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:25.307981 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.343953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for 86207174-84ce-4ddd-85c5-85cebfa75486 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:25.374977 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-4d0206a0-c5e6-40e0-b06c-2b97f8256a7c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:25.376697 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4d0206a0-c5e6-40e0-b06c-2b97f8256a7c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.1997681 Nov 24 04:14:25.380815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34794) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.400593 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.419234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe635378-c836-4f84-a69d-37eff2123436 req-7c7f13d0-0861-4f9f-a06e-3ff6a2b83d4e tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:25.420745 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fe635378-c836-4f84-a69d-37eff2123436 req-7c7f13d0-0861-4f9f-a06e-3ff6a2b83d4e tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1153369 Nov 24 04:14:25.491559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:25.500214 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fe635378-c836-4f84-a69d-37eff2123436 req-562718a6-8ada-4fad-adc2-6cbff354d77d tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690277 Nov 24 04:14:25.571643 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.644281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=86207174-84ce-4ddd-85c5-85cebfa75486,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:25.649321 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.658458 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0be420b-37a4-4ab1-99b8-d82eb5365259 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/86207174-84ce-4ddd-85c5-85cebfa75486 HTTP/1.1" status: 204 len: 168 time: 0.6515260 Nov 24 04:14:25.660335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34800) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.714386 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-772bc43c-ce5c-4eb7-99b7-86213b618b69 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] GET failed (client error): The resource could not be found. Nov 24 04:14:25.716612 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-772bc43c-ce5c-4eb7-99b7-86213b618b69 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports/86207174-84ce-4ddd-85c5-85cebfa75486 HTTP/1.1" status: 404 len: 333 time: 0.0550170 Nov 24 04:14:25.721556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34804) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:25.777116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36be5dd2-fc50-4429-aec4-c017c8f46cf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.796698 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb38ecf1-f206-4d4e-b751-19b0b2bc14c0 req-efbb3a81-34a2-4328-9178-5aa2dab4cbd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:25.798329 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-cb38ecf1-f206-4d4e-b751-19b0b2bc14c0 req-efbb3a81-34a2-4328-9178-5aa2dab4cbd7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1387579 Nov 24 04:14:25.858554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2443cd84-8433-4a6b-8b0c-99e20a447c25 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.872353 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-cb38ecf1-f206-4d4e-b751-19b0b2bc14c0 req-6ed28139-5838-46c9-a7ce-5c69caac5e81 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663173 Nov 24 04:14:25.903102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2443cd84-8433-4a6b-8b0c-99e20a447c25 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.964505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36be5dd2-fc50-4429-aec4-c017c8f46cf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.987216 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2443cd84-8433-4a6b-8b0c-99e20a447c25 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.992380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-6c219903-fdc8-446b-a765-75e153a8a276 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:25.992692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2443cd84-8433-4a6b-8b0c-99e20a447c25 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:25.996382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-6c219903-fdc8-446b-a765-75e153a8a276 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=1f9bf64d67774d1fb7ab8d25db416cdd&device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 1099 time: 0.1679831 Nov 24 04:14:25.996533 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2443cd84-8433-4a6b-8b0c-99e20a447c25 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/security-groups/26a57360-9306-4d6e-8e7f-6d5f91ebc1f7 HTTP/1.1" status: 204 len: 168 time: 0.2716401 Nov 24 04:14:25.998546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34806) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.031922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2443cd84-8433-4a6b-8b0c-99e20a447c25 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=26a57360-9306-4d6e-8e7f-6d5f91ebc1f7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:26.071781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-499f44db-69fc-4688-96b8-6259100ec1be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.095865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-499f44db-69fc-4688-96b8-6259100ec1be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.103489 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437d8a61-4ef9-4626-bedf-011292ac1db8 req-fe186759-3cc4-4523-b5df-8d37b076e77c tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:26.110986 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-437d8a61-4ef9-4626-bedf-011292ac1db8 req-fe186759-3cc4-4523-b5df-8d37b076e77c tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.3191056 Nov 24 04:14:26.136285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1eab5cf-358c-4216-bff6-598b567ddfa9 None None] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:26.152389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.9 (a95d5001-fb6e-49e5-845e-f7c973250bb7/a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06/1bdf6e3d-2c00-41a9-bf97-b2547ad59f87) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:26.168009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-499f44db-69fc-4688-96b8-6259100ec1be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.170869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-499f44db-69fc-4688-96b8-6259100ec1be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.174633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-499f44db-69fc-4688-96b8-6259100ec1be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/security-groups/30329d92-f621-4567-a88c-97534ef84e7d HTTP/1.1" status: 204 len: 168 time: 0.1714282 Nov 24 04:14:26.176128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34808) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.216418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-499f44db-69fc-4688-96b8-6259100ec1be tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=30329d92-f621-4567-a88c-97534ef84e7d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:26.224929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36be5dd2-fc50-4429-aec4-c017c8f46cf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.227532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36be5dd2-fc50-4429-aec4-c017c8f46cf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.232260 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-36be5dd2-fc50-4429-aec4-c017c8f46cf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/890e1dee-5fd9-45d2-b1e3-791aa24e5c03 HTTP/1.1" status: 204 len: 168 time: 0.8452868 Nov 24 04:14:26.235284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34810) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.312161 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Provisioning complete for port f856284c-e3d7-42b5-b16f-4799edadaa2e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:26.314103 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.317543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36be5dd2-fc50-4429-aec4-c017c8f46cf3 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=890e1dee-5fd9-45d2-b1e3-791aa24e5c03,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:26.320379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-92d1348d-3bcb-4dec-bda5-7f1dd0ce53b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:26.322866 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-92d1348d-3bcb-4dec-bda5-7f1dd0ce53b0 service neutron] 10.222.0.21 "GET /v2.0/networks?id=acefce04-02aa-44cc-bb30-373d1b065eae HTTP/1.1" status: 200 len: 912 time: 0.2997794 Nov 24 04:14:26.343314 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0202252-6090-458d-bc54-2391d9f68086 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1060770 Nov 24 04:14:26.344125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34812) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.344823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-09780708-388c-403a-932c-8529d8523c63 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.358122 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'tempest-secgroup--1697163170'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:26.394781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.421694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-09780708-388c-403a-932c-8529d8523c63 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.426540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e216d7de-3fc8-46cc-acb3-2a4eaa026102 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:26.455727 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Port f856284c-e3d7-42b5-b16f-4799edadaa2e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:26.470753 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-437d8a61-4ef9-4626-bedf-011292ac1db8 req-38aac7c6-92ae-4118-b9ab-ef315d6851bf tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3584917 Nov 24 04:14:26.493579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Provisioning complete for port e216d7de-3fc8-46cc-acb3-2a4eaa026102 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:26.493948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.518044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.518567 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-99392946-18b7-4c40-87da-b2ac40d2846b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ce904412-401d-4df1-801f-c17322c730b9 HTTP/1.1" status: 200 len: 217 time: 0.1593242 Nov 24 04:14:26.519904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-09780708-388c-403a-932c-8529d8523c63 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.522937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-09780708-388c-403a-932c-8529d8523c63 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.524206 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-09780708-388c-403a-932c-8529d8523c63 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/security-groups/3fde5947-4300-45ce-b4fd-0a58ec9b75df HTTP/1.1" status: 204 len: 168 time: 0.3467996 Nov 24 04:14:26.530391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34814) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.531026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.551192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09780708-388c-403a-932c-8529d8523c63 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fde5947-4300-45ce-b4fd-0a58ec9b75df,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:26.619366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.620729 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.2735689 Nov 24 04:14:26.630441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34816) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.631166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e216d7de-3fc8-46cc-acb3-2a4eaa026102 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:26.631766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.634804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-10cacf24-368f-46c8-8f18-0e2c7961d66c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:26.635247 dv-neutron-819049-1-hyperv neutron-server[103380]: WARNING neutron.api.v2.base [None req-10cacf24-368f-46c8-8f18-0e2c7961d66c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 24 04:14:26.635732 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-10cacf24-368f-46c8-8f18-0e2c7961d66c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] update failed (client error): There was a conflict when trying to complete your request. Nov 24 04:14:26.637690 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-10cacf24-368f-46c8-8f18-0e2c7961d66c tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "PUT /v2.0/security-groups/33fbc81f-1a60-4fc6-ab04-e9f2a1230398 HTTP/1.1" status: 409 len: 330 time: 0.0063815 Nov 24 04:14:26.645668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34818) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.652575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-554c3a85-2b35-46b6-8f44-9c33b3fd1e0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:26.657746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-554c3a85-2b35-46b6-8f44-9c33b3fd1e0a service neutron] 10.222.0.21 "GET /v2.0/subnets?id=16303810-2955-433b-bb61-fa9692bb82ad HTTP/1.1" status: 200 len: 851 time: 0.1061327 Nov 24 04:14:26.659746 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c5cbe4-cc74-4439-9213-9abd1877f564 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event updated for resources: {'SecurityGroup': ['ID=33fbc81f-1a60-4fc6-ab04-e9f2a1230398,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:26.676244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 6fe10406-bbec-4bff-9fd6-20c49727626a {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:26.685012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.701529 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-a8bed3e7-5a14-4333-8590-860ace1f80b7 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=acefce04-02aa-44cc-bb30-373d1b065eae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0362184 Nov 24 04:14:26.763370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.783483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.794306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.804592 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-92555a56-e4d7-4116-b4f9-736b982f566d service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882039 Nov 24 04:14:26.806247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d21ee15c-565f-423d-a693-26852918972d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.832540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b4638308-1199-43f0-8460-3d940202a251 None None] For port e216d7de-3fc8-46cc-acb3-2a4eaa026102, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e216d7de-3fc8-46cc-acb3-2a4eaa026102,segment=NetworkSegment(4cf1b5ff-984c-41d9-87fd-e613c81612f9),segment_id=4cf1b5ff-984c-41d9-87fd-e613c81612f9)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:26.842400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.848677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d21ee15c-565f-423d-a693-26852918972d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.866946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.900103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.921551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.966061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d21ee15c-565f-423d-a693-26852918972d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.969094 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d21ee15c-565f-423d-a693-26852918972d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.970480 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d21ee15c-565f-423d-a693-26852918972d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/33fbc81f-1a60-4fc6-ab04-e9f2a1230398 HTTP/1.1" status: 204 len: 168 time: 0.3238537 Nov 24 04:14:26.976426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34822) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:26.982216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:26.982680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:26.989275 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21ee15c-565f-423d-a693-26852918972d tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=33fbc81f-1a60-4fc6-ab04-e9f2a1230398,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:27.051328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:14:27.051772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:14:27.054502 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Pushing event updated for resources: {'Port': ['ID=e216d7de-3fc8-46cc-acb3-2a4eaa026102,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:27.071890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ac826e-fa8b-48b4-8773-bb2938e42d97 req-27ab9b02-60f4-4f98-9e73-f197fe18bdb7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:27.075850 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-931ea424-48ec-4f2a-b9ec-10c17651a965 req-3a0389b1-ef91-41d4-a539-3d8fe459781c service neutron] 10.222.0.21 "GET /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2586005 Nov 24 04:14:27.079536 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-66ac826e-fa8b-48b4-8773-bb2938e42d97 req-27ab9b02-60f4-4f98-9e73-f197fe18bdb7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0940883 Nov 24 04:14:27.102192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.117895 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.143281 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b3ebe77-6419-4736-b1f1-e946fa1e0716 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1642015 Nov 24 04:14:27.144794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34824) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.150100 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=6fe10406-bbec-4bff-9fd6-20c49727626a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:27.166132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.176440 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-76d6ab9c-687f-45f7-8960-4cd3dc8200e7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/6fe10406-bbec-4bff-9fd6-20c49727626a HTTP/1.1" status: 204 len: 168 time: 0.6421740 Nov 24 04:14:27.180268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34826) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.185733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aeaa23e-f9b9-4b49-af64-b472343cad10 None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:27.202233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b4638308-1199-43f0-8460-3d940202a251 None None] Could not find standard attr ID for object 86207174-84ce-4ddd-85c5-85cebfa75486. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:27.251486 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-66ac826e-fa8b-48b4-8773-bb2938e42d97 req-8ef2c3b9-1dcc-4804-891e-9b40565aa71a tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1656890 Nov 24 04:14:27.290690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet 184a4566-153d-4dfe-9683-1936347d996c {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:27.294524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.339776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.359773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c5d216f4-f327-4f9f-9c57-c8b337ef4e67 None None] Provisioning complete for port dda04eb8-66a7-4239-89fa-729252577b76 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:27.360697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c5d216f4-f327-4f9f-9c57-c8b337ef4e67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.425096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c5d216f4-f327-4f9f-9c57-c8b337ef4e67 None None] Port dda04eb8-66a7-4239-89fa-729252577b76 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:27.434786 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.443572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c5d216f4-f327-4f9f-9c57-c8b337ef4e67 None None] Provisioning complete for port e216d7de-3fc8-46cc-acb3-2a4eaa026102 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:27.443942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c5d216f4-f327-4f9f-9c57-c8b337ef4e67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.504532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.549156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c5d216f4-f327-4f9f-9c57-c8b337ef4e67 None None] Could not find standard attr ID for object 86207174-84ce-4ddd-85c5-85cebfa75486. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:27.549526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=184a4566-153d-4dfe-9683-1936347d996c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:27.558778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.567534 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f2d10354-f3b3-4087-a3a8-9a0fa5eb1173 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/184a4566-153d-4dfe-9683-1936347d996c HTTP/1.1" status: 204 len: 168 time: 0.3813670 Nov 24 04:14:27.568328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34830) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.608880 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-e07757b3-10a2-496d-a7b0-5f113aa29569 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:27.609846 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e07757b3-10a2-496d-a7b0-5f113aa29569 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:27.617342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:27.618264 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e07757b3-10a2-496d-a7b0-5f113aa29569 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/6fe10406-bbec-4bff-9fd6-20c49727626a HTTP/1.1" status: 404 len: 337 time: 0.0483897 Nov 24 04:14:27.619286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34832) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.645932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:27.648857 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-5cda109f-1acb-46e2-b58e-1442e4ec1e72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] delete failed (client error): The resource could not be found. Nov 24 04:14:27.655657 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5cda109f-1acb-46e2-b58e-1442e4ec1e72 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "DELETE /v2.0/security-groups/13b28e52-5703-4bf2-8b24-526750b2ff1b HTTP/1.1" status: 404 len: 347 time: 0.1282649 Nov 24 04:14:27.661739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34834) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.687745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:27.688311 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-819be38b-a434-4c68-a85f-80b12da73512 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] show failed (client error): The resource could not be found. Nov 24 04:14:27.690058 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-819be38b-a434-4c68-a85f-80b12da73512 tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-groups/02497b14-fe2a-43a0-9c71-3ddf65ee2ff4 HTTP/1.1" status: 404 len: 347 time: 0.0266411 Nov 24 04:14:27.693503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34836) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.701247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:27.712552 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting subnet a923e012-ebc0-4328-95fb-36c372b05b6f {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:27.716585 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-f29949bc-6336-4717-a52f-b887f99ecedd tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] show failed (client error): The resource could not be found. Nov 24 04:14:27.721402 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f29949bc-6336-4717-a52f-b887f99ecedd tempest-NegativeSecGroupIPv6Test-886857426 tempest-NegativeSecGroupIPv6Test-886857426-project] 10.222.0.48 "GET /v2.0/security-group-rules/b02d785b-d111-47f2-b747-410cb2606574 HTTP/1.1" status: 404 len: 356 time: 0.0231984 Nov 24 04:14:27.721402 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.723049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:27.726262 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.730849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=1bdf6e3d-2c00-41a9-bf97-b2547ad59f87,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:27.820728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:27.821368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.848868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:27.859236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa14d69e-8757-4a77-903f-1fbd34a82fb0 req-6533eec3-27a4-46d0-86dc-b2d231d372fa tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:27.867455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aa14d69e-8757-4a77-903f-1fbd34a82fb0 req-6533eec3-27a4-46d0-86dc-b2d231d372fa tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.2787657 Nov 24 04:14:27.896270 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-260013be-bdc6-40e3-ae8b-caeffdd91331 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 3.0918140 Nov 24 04:14:27.900041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34840) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:27.993730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.010398 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-aa14d69e-8757-4a77-903f-1fbd34a82fb0 req-eeeee50d-2b73-41b6-b2fd-0e1739986a41 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368821 Nov 24 04:14:28.036741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ad72ce5-6f60-45b9-92b2-266b023ff00b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:28.043126 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1ad72ce5-6f60-45b9-92b2-266b023ff00b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 922 time: 0.1399484 Nov 24 04:14:28.082745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-65d2b486-551a-4a4f-9b54-e64ef01c9f47 None None] Provisioning complete for port 1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:28.083878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-65d2b486-551a-4a4f-9b54-e64ef01c9f47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.090016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34842) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.130704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-65d2b486-551a-4a4f-9b54-e64ef01c9f47 None None] Port 1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:28.235615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d075d89-e983-4284-92b3-64fb38eb080a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:28.244910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d075d89-e983-4284-92b3-64fb38eb080a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:28.251558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d075d89-e983-4284-92b3-64fb38eb080a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:28.251741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e216d7de-3fc8-46cc-acb3-2a4eaa026102 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:28.256031 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3d075d89-e983-4284-92b3-64fb38eb080a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2379 time: 0.1484489 Nov 24 04:14:28.256031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34846) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.257512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34848) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.366603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:28.366959 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.378916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e216d7de-3fc8-46cc-acb3-2a4eaa026102 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:28.379294 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.434992 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a0a2154-3433-4ff4-b7bd-5d7d11e22c92 None None] Network 721c2ec6-3abd-47ff-80e2-24b3c8106daa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:28.521780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-904485ed-6874-4dd7-8244-833838b40b0f req-a827a8f4-d3cf-460a-b463-491cc92d20af tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:28.523434 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-904485ed-6874-4dd7-8244-833838b40b0f req-a827a8f4-d3cf-460a-b463-491cc92d20af tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0696630 Nov 24 04:14:28.530617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port b8985b51-3822-48f2-b6c3-2c24bd2cfbc3, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:28.531091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.536255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-52c916bf-df93-4766-8660-bdb13a7e7504 None None] Provisioning complete for port f856284c-e3d7-42b5-b16f-4799edadaa2e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:28.536764 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-52c916bf-df93-4766-8660-bdb13a7e7504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.556355 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-844b7477-da7f-4690-a8c8-b2dbcdb037ae admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=3e548383c4c6445fad1558d30088f9fd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3008463 Nov 24 04:14:28.558587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:28.561508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34854) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.562379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.564318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:28.564659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.593298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-52c916bf-df93-4766-8660-bdb13a7e7504 None None] Port f856284c-e3d7-42b5-b16f-4799edadaa2e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:28.612078 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Subnet': ['ID=a923e012-ebc0-4328-95fb-36c372b05b6f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:28.623099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.629284 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-82bf2038-dbc3-46a6-b852-ffb5675f1ade tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/a923e012-ebc0-4328-95fb-36c372b05b6f HTTP/1.1" status: 204 len: 168 time: 1.0062597 Nov 24 04:14:28.629660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34856) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.641587 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-904485ed-6874-4dd7-8244-833838b40b0f req-13b789f6-cd0d-408f-9f79-a41401782068 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1080360 Nov 24 04:14:28.643550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-52c916bf-df93-4766-8660-bdb13a7e7504 None None] Provisioning complete for port 41d439ed-bbec-4ce1-ae8e-751809219ca2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:28.643994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-52c916bf-df93-4766-8660-bdb13a7e7504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.662515 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-5bf214e7-edf2-4946-98ef-5b84eed9d14e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.662975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5bf214e7-edf2-4946-98ef-5b84eed9d14e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.668532 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5bf214e7-edf2-4946-98ef-5b84eed9d14e tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/0d87b69d-e133-4dca-9dc7-1a72f89ecfa6 HTTP/1.1" status: 404 len: 337 time: 0.0355682 Nov 24 04:14:28.668800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34858) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.704237 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f3c5b8ed-1c19-4926-99a3-3374b1a781ce tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "GET /v2.0/ports?device_id=15d9eb56-ed2f-4b2a-a33f-480074b7cf5a HTTP/1.1" status: 200 len: 205 time: 0.0337617 Nov 24 04:14:28.706571 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34860) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.731453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-61d541fe-7170-40cb-92e4-caea878d0dde admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.743971 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-e45acea1-d9a4-4d15-92dc-01ee2288eb27 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] delete failed (client error): The resource could not be found. Nov 24 04:14:28.745180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e45acea1-d9a4-4d15-92dc-01ee2288eb27 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/routers/15d9eb56-ed2f-4b2a-a33f-480074b7cf5a HTTP/1.1" status: 404 len: 336 time: 0.0376952 Nov 24 04:14:28.747607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34862) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.760798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] DHCP port deletion for 721c2ec6-3abd-47ff-80e2-24b3c8106daa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:28.773750 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-149ae94a-c95d-44ef-a7ef-9dc155a4144b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.774112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-149ae94a-c95d-44ef-a7ef-9dc155a4144b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.779524 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-149ae94a-c95d-44ef-a7ef-9dc155a4144b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/5334ecdc-83a8-40ec-b5bc-7747649eb177 HTTP/1.1" status: 404 len: 337 time: 0.0286906 Nov 24 04:14:28.779960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34864) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.785589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-61d541fe-7170-40cb-92e4-caea878d0dde admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.810865 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-e342ab17-26d4-413a-bdf4-26fc9d9986e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.811284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e342ab17-26d4-413a-bdf4-26fc9d9986e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.817203 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e342ab17-26d4-413a-bdf4-26fc9d9986e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/d67eb75e-81c0-40cb-a02b-2cc53700a7e1 HTTP/1.1" status: 404 len: 337 time: 0.0342066 Nov 24 04:14:28.817350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] Deleting port 41d439ed-bbec-4ce1-ae8e-751809219ca2 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:28.817350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.817538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34866) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.835790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.843348 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-9ec9f045-5be4-484c-aef1-fda43d5501e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.843914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9ec9f045-5be4-484c-aef1-fda43d5501e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.849293 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9ec9f045-5be4-484c-aef1-fda43d5501e9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/c035091e-dcad-4011-ac6e-b6ef0769fb13 HTTP/1.1" status: 404 len: 337 time: 0.0281315 Nov 24 04:14:28.850007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34868) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.864115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:28.872698 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d9c9064-c833-4332-b7f5-157b43d64481 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.873336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1d9c9064-c833-4332-b7f5-157b43d64481 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.879312 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1d9c9064-c833-4332-b7f5-157b43d64481 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/607f7000-de8f-4ff0-ba4c-90eb6966938b HTTP/1.1" status: 404 len: 333 time: 0.0264277 Nov 24 04:14:28.879951 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34870) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.881153 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] For port 41d439ed-bbec-4ce1-ae8e-751809219ca2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=41d439ed-bbec-4ce1-ae8e-751809219ca2,segment=NetworkSegment(b386343f-6228-4702-a514-5fe49462e4e7),segment_id=b386343f-6228-4702-a514-5fe49462e4e7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:28.881621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.894448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] Calling delete_port for 41d439ed-bbec-4ce1-ae8e-751809219ca2 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:28.908901 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-2df32bec-373c-4ea6-9f36-e64fa725e154 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.909454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2df32bec-373c-4ea6-9f36-e64fa725e154 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.912829 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2df32bec-373c-4ea6-9f36-e64fa725e154 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/5c0b3f8f-475f-41ec-9085-d573eb4a50b9 HTTP/1.1" status: 404 len: 337 time: 0.0319273 Nov 24 04:14:28.915228 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34872) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.941416 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-3a06a2e7-37a2-400c-ab4e-0e41c5877ee9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.941868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3a06a2e7-37a2-400c-ab4e-0e41c5877ee9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.945123 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3a06a2e7-37a2-400c-ab4e-0e41c5877ee9 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/1bc11f49-6376-4c45-b16f-b71dd58426e6 HTTP/1.1" status: 404 len: 337 time: 0.0287375 Nov 24 04:14:28.947560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34874) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:28.987171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:28.992983 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b99a354-79c2-4f60-b57a-2df5d662164a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:28.993565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b99a354-79c2-4f60-b57a-2df5d662164a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:28.996558 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1b99a354-79c2-4f60-b57a-2df5d662164a tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/0631f15d-b540-4bf7-a8f5-2997891cc257 HTTP/1.1" status: 404 len: 333 time: 0.0470536 Nov 24 04:14:28.999365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34876) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:29.012321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] Pushing event deleted for resources: {'Port': ['ID=41d439ed-bbec-4ce1-ae8e-751809219ca2,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:29.016601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-007b9e9f-f6c0-4b2d-b921-93e847860c95 None None] No DVR routers for this DVR port 41d439ed-bbec-4ce1-ae8e-751809219ca2 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:29.017180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-61d541fe-7170-40cb-92e4-caea878d0dde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.020120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-61d541fe-7170-40cb-92e4-caea878d0dde admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.022335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-61d541fe-7170-40cb-92e4-caea878d0dde admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/3ab6a18e-5628-4f67-aa47-ed4200fd8c35 HTTP/1.1" status: 204 len: 168 time: 0.4536457 Nov 24 04:14:29.051590 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-c3a8aadc-380c-4a9e-9ae7-2981589a1082 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:29.052142 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c3a8aadc-380c-4a9e-9ae7-2981589a1082 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:29.053479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d541fe-7170-40cb-92e4-caea878d0dde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ab6a18e-5628-4f67-aa47-ed4200fd8c35,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:29.057091 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c3a8aadc-380c-4a9e-9ae7-2981589a1082 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/4a352f55-f9a2-464c-85c5-c0cc336109ae HTTP/1.1" status: 404 len: 337 time: 0.0564284 Nov 24 04:14:29.059622 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34882) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:29.084993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.111383 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-98945a50-a116-40a7-b97b-a6513e3fcfc7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] DELETE failed (client error): The resource could not be found. Nov 24 04:14:29.112053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-98945a50-a116-40a7-b97b-a6513e3fcfc7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:29.115216 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-98945a50-a116-40a7-b97b-a6513e3fcfc7 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/subnets/95799b5f-6cc8-4f59-a4c0-1d2e58fcc1fd HTTP/1.1" status: 404 len: 337 time: 0.0538776 Nov 24 04:14:29.117706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34884) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:29.149972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=b8985b51-3822-48f2-b6c3-2c24bd2cfbc3,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:29.241162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Deleting port f856284c-e3d7-42b5-b16f-4799edadaa2e {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:29.242005 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.273767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.357084 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.376722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Calling delete_port for f856284c-e3d7-42b5-b16f-4799edadaa2e owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:29.383868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7abb77fb-7fb6-4b95-92d2-8721ffff8fbd req-9fffdc43-3d8d-4ad4-9148-c46950b6a752 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:29.386817 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7abb77fb-7fb6-4b95-92d2-8721ffff8fbd req-9fffdc43-3d8d-4ad4-9148-c46950b6a752 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.2723148 Nov 24 04:14:29.387574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=1bdf6e3d-2c00-41a9-bf97-b2547ad59f87,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:29.477804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.521975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.526344 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/ports/f856284c-e3d7-42b5-b16f-4799edadaa2e HTTP/1.1" status: 204 len: 168 time: 0.4074705 Nov 24 04:14:29.526582 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7abb77fb-7fb6-4b95-92d2-8721ffff8fbd req-8c5a8f47-81bb-4624-92b1-4c1ccce84026 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018183 Nov 24 04:14:29.527867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aefc00c8-d285-4c26-86ad-f43915d3694b tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Port': ['ID=f856284c-e3d7-42b5-b16f-4799edadaa2e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:29.530963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34896) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:29.532782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.535993 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5e7c9ec5-308b-4b78-a7aa-24201604d7f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 HTTP/1.1" status: 204 len: 168 time: 1.2737522 Nov 24 04:14:29.539378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34898) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:29.575316 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-4fc834f3-53ab-48a2-a630-f07bfb3a0159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:29.580695 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34902) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:29.599268 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4fc834f3-53ab-48a2-a630-f07bfb3a0159 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/1bdf6e3d-2c00-41a9-bf97-b2547ad59f87 HTTP/1.1" status: 404 len: 333 time: 0.0587692 Nov 24 04:14:29.600513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.688902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.879102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port dda04eb8-66a7-4239-89fa-729252577b76 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:29.879446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.886716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:29.909268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1fda3b-968d-4660-90ce-3f844ab9c5c6 req-678b0b74-5b2c-41da-a259-37b81d6a8fe2 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:29.918257 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bd1fda3b-968d-4660-90ce-3f844ab9c5c6 req-678b0b74-5b2c-41da-a259-37b81d6a8fe2 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1137648 Nov 24 04:14:29.941742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['721c2ec6-3abd-47ff-80e2-24b3c8106daa']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:29.961869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:29.987245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b386343f-6228-4702-a514-5fe49462e4e7') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:29.987548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b386343f-6228-4702-a514-5fe49462e4e7') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:29.992731 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bd1fda3b-968d-4660-90ce-3f844ab9c5c6 req-3a6089e6-da0a-4843-a7fc-1d68dccbb539 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0752954 Nov 24 04:14:30.006323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61650134-e914-4856-a2f8-902f04fccb1f req-21ed2201-d132-4961-afda-70fd4ffbf361 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:30.007826 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-61650134-e914-4856-a2f8-902f04fccb1f req-21ed2201-d132-4961-afda-70fd4ffbf361 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.1936791 Nov 24 04:14:30.014593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.028093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34916) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:30.059308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.061897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.076462 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Releasing vlan 181 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:30.076861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:30.080403 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:30.104790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:30.108405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for dda04eb8-66a7-4239-89fa-729252577b76 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:30.111293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ec8e5615-795f-49f2-a18a-3a7011f9c3d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/0fe6e120-10fd-4f02-8be4-2afcf5422729/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9021657 Nov 24 04:14:30.118169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:30.134959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:30.137076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:30.188098 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-61650134-e914-4856-a2f8-902f04fccb1f req-b8c02e90-aa98-450e-8e1c-fcede8f90260 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1637650 Nov 24 04:14:30.200624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.265449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.269194 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] 10.222.0.48 "DELETE /v2.0/networks/721c2ec6-3abd-47ff-80e2-24b3c8106daa HTTP/1.1" status: 204 len: 168 time: 0.7360482 Nov 24 04:14:30.275519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-487628863'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:30.283331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d1b70c2-6e55-4cd5-966a-96d74954cc35 tempest-PortsIpV6TestJSON-734712643 tempest-PortsIpV6TestJSON-734712643-project] Pushing event deleted for resources: {'Network': ['ID=721c2ec6-3abd-47ff-80e2-24b3c8106daa,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:30.347598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Made reservation on behalf of 49e1d30283f345cface3cdb2815be233 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:30.347871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:30.352214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.381227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.384319 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:30.410724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 41d439ed-bbec-4ce1-ae8e-751809219ca2 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:30.411060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 41d439ed-bbec-4ce1-ae8e-751809219ca2 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:30.484947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8bbe51-7632-4057-9797-9a9c977e06bc req-b145eb7e-0a4a-40ca-a165-de9b2a0202e3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:30.487304 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-2b8bbe51-7632-4057-9797-9a9c977e06bc req-b145eb7e-0a4a-40ca-a165-de9b2a0202e3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.1076002 Nov 24 04:14:30.511825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.564469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=dda04eb8-66a7-4239-89fa-729252577b76,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:30.644171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34928) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:30.669688 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-2b8bbe51-7632-4057-9797-9a9c977e06bc req-dc42f25b-7bd4-433a-ac27-ab7bf7006e99 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1758132 Nov 24 04:14:30.714653 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.720126 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a3fb4a43-33d5-4bee-99b2-feaa8c4fa61b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/dda04eb8-66a7-4239-89fa-729252577b76 HTTP/1.1" status: 204 len: 168 time: 1.1379230 Nov 24 04:14:30.722824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34932) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:30.749910 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-8e774249-a2c6-486a-8783-d58595224c7f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:30.750470 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.754459 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8e774249-a2c6-486a-8783-d58595224c7f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/dda04eb8-66a7-4239-89fa-729252577b76 HTTP/1.1" status: 404 len: 333 time: 0.0305624 Nov 24 04:14:30.754789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34934) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:30.768426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.834570 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:28Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:13:06Z', 'revision_number': 1, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:30.859277 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-78541b91-048d-4cc2-908a-a331bae548e0 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=372dd3329b1c46059a975406a09b4bcc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2133710 Nov 24 04:14:30.862011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34936) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:30.862377 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:30.863903 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:14:30.867802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Pushing event updated for resources: {'SecurityGroup': ['ID=670561e3-237a-4bfe-bf23-b1147bd45fc0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:30.871549 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:30.872962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:30.873650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:30.874412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.916578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.916988 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Added segment 76753c9f-61f2-4c35-981e-2061e820b548 of type vlan for network 0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a Nov 24 04:14:30.927710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4c6abd8f-df6f-4815-acdd-ddfa66b7154c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.954989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4c6abd8f-df6f-4815-acdd-ddfa66b7154c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.955533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:30.989889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:30.990169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.007695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4c6abd8f-df6f-4815-acdd-ddfa66b7154c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.010993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4c6abd8f-df6f-4815-acdd-ddfa66b7154c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.012768 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4c6abd8f-df6f-4815-acdd-ddfa66b7154c admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/114d374f-a6bc-4ede-ba64-5820d0a0a2d4 HTTP/1.1" status: 204 len: 168 time: 0.1493127 Nov 24 04:14:31.022780 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6abd8f-df6f-4815-acdd-ddfa66b7154c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=114d374f-a6bc-4ede-ba64-5820d0a0a2d4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:31.091569 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.116701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.122286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:31.122883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.137016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ed1b05-33b4-4409-82cb-aeb7153ef0fc req-97618678-990f-4d6e-b420-6bea1707fb61 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:31.143763 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-55ed1b05-33b4-4409-82cb-aeb7153ef0fc req-97618678-990f-4d6e-b420-6bea1707fb61 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0733576 Nov 24 04:14:31.182772 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 775 time: 1.1524048 Nov 24 04:14:31.186614 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34942) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.192464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-ec9f9d1a-9f58-4b91-949f-eaf764c0b5b1 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-930405635') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.225720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51b8ea4-65a9-4ebd-b544-185ba1252f51 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Pushing event updated for resources: {'Network': ['ID=0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:31.239953 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-55ed1b05-33b4-4409-82cb-aeb7153ef0fc req-3de7883e-4d9e-4a10-93a7-e2d1f5aa520e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0914137 Nov 24 04:14:31.259377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:31.267510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.309956 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:31.349305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d97858d9-e633-44c1-882d-f595036b05c2 None None] Network a95d5001-fb6e-49e5-845e-f7c973250bb7 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:31.353700 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.357323 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f5ddd879-dab6-4bc6-ac20-d750bc60bea0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06 HTTP/1.1" status: 204 len: 168 time: 0.6014338 Nov 24 04:14:31.360170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34950) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.385178 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed8529f-ec06-4abe-b49d-e69d21285927 req-36b6dc46-e468-4d32-9851-ec1ce20253b0 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:31.387040 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6ed8529f-ec06-4abe-b49d-e69d21285927 req-36b6dc46-e468-4d32-9851-ec1ce20253b0 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.0788312 Nov 24 04:14:31.412246 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ec9f9d1a-9f58-4b91-949f-eaf764c0b5b1 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "PUT /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-930405635 HTTP/1.1" status: 201 len: 201 time: 0.2244270 Nov 24 04:14:31.415791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34954) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.421859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-a9250bc2-4205-4fb2-a26a-ca292b53a7ce tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-930405635') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.453687 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6ed8529f-ec06-4abe-b49d-e69d21285927 req-5d72df9e-033c-4950-a8a3-6a455ea94c99 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593553 Nov 24 04:14:31.488122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:28Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:13:06Z', 'revision_number': 1, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.511566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.525203 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb50b5ea-fab7-407a-9bf0-446deff02ccd None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:28Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '69d31bd4-9fe6-491e-8c03-a04773e3f2d2', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.143', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'port_id': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 950, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'mac_address': 'fa:16:3e:16:cf:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49acebc0-f021-4e68-8116-e16663679896', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:12:59Z', 'updated_at': '2021-11-24T04:13:06Z', 'revision_number': 1, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:31.590400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34960) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.590981 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a9250bc2-4205-4fb2-a26a-ca292b53a7ce tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-930405635 HTTP/1.1" status: 204 len: 168 time: 0.1735992 Nov 24 04:14:31.595234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-8955ba7f-fd9e-4be6-a657-b5258fcda8f7 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.616357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port e216d7de-3fc8-46cc-acb3-2a4eaa026102 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:31.616776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.669364 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8955ba7f-fd9e-4be6-a657-b5258fcda8f7 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags HTTP/1.1" status: 200 len: 237 time: 0.0779448 Nov 24 04:14:31.671897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34966) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.676838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-b15cc337-6862-44f2-aaee-e09b8b61460e tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', {'tags': ['tempest-TagsTest-Tag-2053349771', 'tempest-TagsTest-Tag-1345934244', 'tempest-TagsTest-Tag-714028462']}) {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.687712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] For port e216d7de-3fc8-46cc-acb3-2a4eaa026102, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e216d7de-3fc8-46cc-acb3-2a4eaa026102,segment=NetworkSegment(4cf1b5ff-984c-41d9-87fd-e613c81612f9),segment_id=4cf1b5ff-984c-41d9-87fd-e613c81612f9)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:31.688842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.702472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for e216d7de-3fc8-46cc-acb3-2a4eaa026102 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:31.768290 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b15cc337-6862-44f2-aaee-e09b8b61460e tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "PUT /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags HTTP/1.1" status: 200 len: 308 time: 0.0919583 Nov 24 04:14:31.770808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34972) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.775598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-0787db14-61e3-4233-b9d0-16f3ae0d5906 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-2053349771') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.850666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2f0366-2deb-4c33-8165-f9954637072b req-ef513f34-0899-4721-962d-a459ed541cf3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:31.852218 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2c2f0366-2deb-4c33-8165-f9954637072b req-ef513f34-0899-4721-962d-a459ed541cf3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.0772362 Nov 24 04:14:31.853119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:31.875339 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0787db14-61e3-4233-b9d0-16f3ae0d5906 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "DELETE /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-2053349771 HTTP/1.1" status: 204 len: 168 time: 0.1016490 Nov 24 04:14:31.876675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34976) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:31.882008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=e216d7de-3fc8-46cc-acb3-2a4eaa026102,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:31.882245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-a9a6a020-5d83-4b66-9942-ffb5525861af tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-2053349771') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:31.889912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a9c4685-e3aa-47c5-9b3d-1f7435293ae0 None None] DHCP port deletion for a95d5001-fb6e-49e5-845e-f7c973250bb7 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:31.904861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No DVR routers for this DVR port e216d7de-3fc8-46cc-acb3-2a4eaa026102 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:31.996630 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34978) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.004623 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-a9a6a020-5d83-4b66-9942-ffb5525861af tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] show failed (client error): The resource could not be found. Nov 24 04:14:32.009599 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a9a6a020-5d83-4b66-9942-ffb5525861af tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-2053349771 HTTP/1.1" status: 404 len: 326 time: 0.1317973 Nov 24 04:14:32.018911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34982) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.025437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-16f49399-64e5-4a43-becc-13023c119832 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-1345934244') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:32.069046 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2c2f0366-2deb-4c33-8165-f9954637072b req-aa3fcb75-bbac-4332-9668-bcb27f51a6b9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1912012 Nov 24 04:14:32.111081 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-16f49399-64e5-4a43-becc-13023c119832 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-1345934244 HTTP/1.1" status: 204 len: 168 time: 0.0993807 Nov 24 04:14:32.113597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34984) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.117920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-530d95a8-8732-4ff6-b699-8cb3533d15f3 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-714028462') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:32.121302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.135135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-a2b7e77b-d29d-4704-8e41-c132b878ea11 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:32.137119 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-a2b7e77b-d29d-4704-8e41-c132b878ea11 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.2359924 Nov 24 04:14:32.141762 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-891860022'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:32.192608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a95d5001-fb6e-49e5-845e-f7c973250bb7']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:32.209849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e6c3ecd2-d7f9-431d-9a3d-a2a9b4c034ff tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:32.211333 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e6c3ecd2-d7f9-431d-9a3d-a2a9b4c034ff tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.21 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.2628539 Nov 24 04:14:32.213813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:32.217615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.219620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4cf1b5ff-984c-41d9-87fd-e613c81612f9') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:32.220045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4cf1b5ff-984c-41d9-87fd-e613c81612f9') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:32.225720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e216d7de-3fc8-46cc-acb3-2a4eaa026102 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:32.229911 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-530d95a8-8732-4ff6-b699-8cb3533d15f3 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-714028462 HTTP/1.1" status: 204 len: 168 time: 0.1151299 Nov 24 04:14:32.230830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.236213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34986) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.243568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.247395 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e216d7de-3fc8-46cc-acb3-2a4eaa026102 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:32.247949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e216d7de-3fc8-46cc-acb3-2a4eaa026102 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:32.248289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.tag.tag_plugin [None req-973e435f-8105-498c-819b-02aeb3f6d5f8 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:32.248434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:32.268455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:32.269489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b8985b51-3822-48f2-b6c3-2c24bd2cfbc3 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:32.320137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.321387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.327301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.337812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 166 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:32.338252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:32.363026 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:32.373278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 174, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:32.396576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3dea3031-a1c9-4a61-b6e7-593cc29e5a2c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:32.399578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.399924 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment ab321b5b-ea71-4a61-b631-eef44465d8d1 of type vlan for network 37608dc5-580c-4764-b65f-43bd682282cb Nov 24 04:14:32.444380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7703cf51-d8a6-40e9-ab72-f926304edd0f req-49c41b0b-5c53-403f-8783-1507355f2861 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:32.445873 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7703cf51-d8a6-40e9-ab72-f926304edd0f req-49c41b0b-5c53-403f-8783-1507355f2861 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1103086 Nov 24 04:14:32.454557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.458851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.471849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.478382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/a95d5001-fb6e-49e5-845e-f7c973250bb7 HTTP/1.1" status: 204 len: 168 time: 1.1116452 Nov 24 04:14:32.483351 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34990) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.491917 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 26aa7f6c-485f-4a13-a097-744803530749 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:32.492258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.494577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-857325581'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:32.523907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.524271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5933fa57-2306-44e3-aa31-43697e9ed23f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=a95d5001-fb6e-49e5-845e-f7c973250bb7,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:32.530288 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:32.530889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.554649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Deleting port ce904412-401d-4df1-801f-c17322c730b9 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:32.554987 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.589985 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7703cf51-d8a6-40e9-ab72-f926304edd0f req-d638e5ca-f24c-4a69-a2c7-86c183f826be tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1268051 Nov 24 04:14:32.601076 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6033366 Nov 24 04:14:32.608767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 34994) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.627855 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:32.631239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.641552 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16028809-b7bc-4ae4-be6e-c6065a54c25f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=37608dc5-580c-4764-b65f-43bd682282cb,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:32.652326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 37608dc5-580c-4764-b65f-43bd682282cb details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:32.660692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] vlan segment allocate from pool success with {'vlan_id': 163, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:32.671208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.671560 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Added segment 3aba44ed-37ff-41ae-ac2b-1adf56d08507 of type vlan for network 5aab3620-e915-4544-8009-60e1d136b182 Nov 24 04:14:32.723245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.750778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.756676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:32.757340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.803029 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.3098373 Nov 24 04:14:32.827181 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34996) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:32.831962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': '5aab3620-e915-4544-8009-60e1d136b182', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:32.849769 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b395a8-a08f-44dd-b696-ed356da8ed4c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Network': ['ID=5aab3620-e915-4544-8009-60e1d136b182,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:32.871134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 5aab3620-e915-4544-8009-60e1d136b182 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:32.951091 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:32.954947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:32.986142 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2142581543'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:33.047220 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-973e435f-8105-498c-819b-02aeb3f6d5f8 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "DELETE /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags HTTP/1.1" status: 204 len: 168 time: 0.8032117 Nov 24 04:14:33.050001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 34998) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.054625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-892460b1-20ac-4c6f-b0e0-77963d0b4d04 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-1345934244') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:33.084253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:33.087698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.102029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efde2945-1458-4acb-8283-9dd99cbe5112 req-e94bf224-ead6-4ba5-a3dd-8d6552ae3dc6 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:33.103572 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-efde2945-1458-4acb-8283-9dd99cbe5112 req-e94bf224-ead6-4ba5-a3dd-8d6552ae3dc6 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 946 time: 0.5608153 Nov 24 04:14:33.150605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 26aa7f6c-485f-4a13-a097-744803530749, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=26aa7f6c-485f-4a13-a097-744803530749,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:33.151291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.175064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] For port ce904412-401d-4df1-801f-c17322c730b9, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=ce904412-401d-4df1-801f-c17322c730b9,segment=NetworkSegment(3d6fe194-5d56-4d69-bb30-b0e96721fe3f),segment_id=3d6fe194-5d56-4d69-bb30-b0e96721fe3f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:33.175437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.192017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 26aa7f6c-485f-4a13-a097-744803530749 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:33.202081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 183, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:33.213962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Calling delete_port for ce904412-401d-4df1-801f-c17322c730b9 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:33.230890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.241327 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-892460b1-20ac-4c6f-b0e0-77963d0b4d04 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] show failed (client error): The resource could not be found. Nov 24 04:14:33.242353 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-892460b1-20ac-4c6f-b0e0-77963d0b4d04 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-1345934244 HTTP/1.1" status: 404 len: 326 time: 0.1911621 Nov 24 04:14:33.245403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35002) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.246134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.246509 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 67ae6a41-e0c2-4714-9321-5da2760b1a7c of type vlan for network 98a4f053-9ca9-4678-80b4-a528e80ad18f Nov 24 04:14:33.270797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-d4ead86a-a7ea-452e-a200-e17ee47a4a6a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a', 'tempest-TagsTest-Tag-714028462') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:33.288868 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-efde2945-1458-4acb-8283-9dd99cbe5112 req-28302d78-74cc-4534-9e54-8ebc852b3d3d tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/security-groups?id=d4520c5d-8714-4382-b447-66561e7fc1ff&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1697330 Nov 24 04:14:33.305462 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbca9cdc-0630-42c8-a054-033b7aedbb8a req-517265b5-d627-4958-8ff3-b38c04c4a2f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:33.307125 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-dbca9cdc-0630-42c8-a054-033b7aedbb8a req-517265b5-d627-4958-8ff3-b38c04c4a2f3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 946 time: 0.1481431 Nov 24 04:14:33.351671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=0b380565-b933-4b82-a8c3-f74014f0c198,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:33.371144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Checking segment: {'id': '3aba44ed-37ff-41ae-ac2b-1adf56d08507', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '5aab3620-e915-4544-8009-60e1d136b182'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:33.371506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network hostable DHCP agents. Network: 5aab3620-e915-4544-8009-60e1d136b182, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:33.373691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.431825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.437863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:33.438901 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-dbca9cdc-0630-42c8-a054-033b7aedbb8a req-8f22491f-015f-43f8-8d9d-9e3f47015c09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=85d13e9f-8f86-478e-a7fe-77e3092afe4b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1207025 Nov 24 04:14:33.439021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.445340 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-d4ead86a-a7ea-452e-a200-e17ee47a4a6a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] show failed (client error): The resource could not be found. Nov 24 04:14:33.446363 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d4ead86a-a7ea-452e-a200-e17ee47a4a6a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "GET /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags/tempest-TagsTest-Tag-714028462 HTTP/1.1" status: 404 len: 325 time: 0.1815252 Nov 24 04:14:33.449361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 5aab3620-e915-4544-8009-60e1d136b182 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:33.451916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35004) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.461035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.tag.tag_plugin [None req-703272b6-af1d-4fad-b6e5-745a4e5176f1 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:33.480385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 5aab3620-e915-4544-8009-60e1d136b182) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:33.486188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:33.487003 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.493814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24ed4b5e-65c4-45a6-97e6-502407b206e7 None None] Network 5aab3620-e915-4544-8009-60e1d136b182 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:33.518834 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-29806ebf-d2f6-4060-b49f-024afe547211 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6906209 Nov 24 04:14:33.520587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35006) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.525684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-463711991', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:33.543095 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5608678 Nov 24 04:14:33.546821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35008) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.576330 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-703272b6-af1d-4fad-b6e5-745a4e5176f1 tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "DELETE /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a/tags HTTP/1.1" status: 204 len: 168 time: 0.1214547 Nov 24 04:14:33.583070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35010) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.590391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '37608dc5-580c-4764-b65f-43bd682282cb', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:33.595101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.596259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.618570 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3777a6-0aa3-4a88-9ea5-f0b9ceede658 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=98a4f053-9ca9-4678-80b4-a528e80ad18f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:33.641861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.659314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:33.699820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-5aab3620-e915-4544-8009-60e1d136b182', 'network_id': '5aab3620-e915-4544-8009-60e1d136b182', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': '0b380565-b933-4b82-a8c3-f74014f0c198'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:33.700943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.704752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.709334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.726828 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=26aa7f6c-485f-4a13-a097-744803530749,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:33.751884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['ce904412-401d-4df1-801f-c17322c730b9'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:14:33.799115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Pushing event deleted for resources: {'Port': ['ID=ce904412-401d-4df1-801f-c17322c730b9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:33.799779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.812425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.852741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port 26aa7f6c-485f-4a13-a097-744803530749 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:33.861594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.862869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.866368 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7611a501-40bd-4303-8ac3-6dd7495667cb req-d870a175-de98-43c3-b1cc-28cc936850a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "DELETE /v2.0/ports/26aa7f6c-485f-4a13-a097-744803530749 HTTP/1.1" status: 204 len: 173 time: 1.7196803 Nov 24 04:14:33.869694 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'name': 'network-vif-deleted', 'tag': '26aa7f6c-485f-4a13-a097-744803530749'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:33.872031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-526cc329-7bae-4ce2-9d20-70cfaf5d90b5" -d '{"events": [{"server_uuid": "f7a44151-8384-4ee1-997e-6273cc167dcc", "name": "network-vif-deleted", "tag": "26aa7f6c-485f-4a13-a097-744803530749"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:33.883881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:33.892585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] No DVR routers for this DVR port ce904412-401d-4df1-801f-c17322c730b9 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:33.897010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.899495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76753c9f-61f2-4c35-981e-2061e820b548') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:33.899810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76753c9f-61f2-4c35-981e-2061e820b548') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:33.900592 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-253582f0-16f0-42c8-ae1e-fd41428da5e2 req-e66bbda3-e9a3-45e4-8314-23b31082d008 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.21 "DELETE /v2.0/ports/ce904412-401d-4df1-801f-c17322c730b9 HTTP/1.1" status: 204 len: 173 time: 1.6783533 Nov 24 04:14:33.902237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:33.910760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.916929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.918029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eee4f04-c729-4337-adb9-c6d63871a83a req-67a798bc-25ce-4e03-97ba-8be9d20a1e30 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:33.925276 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4eee4f04-c729-4337-adb9-c6d63871a83a req-67a798bc-25ce-4e03-97ba-8be9d20a1e30 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.2399175 Nov 24 04:14:33.929181 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.930695 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dc512e26-5177-40f4-9769-e315285e87fa tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 701 time: 0.4089131 Nov 24 04:14:33.933342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35016) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:33.944671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'network_id': '5aab3620-e915-4544-8009-60e1d136b182', 'name': 'tempest-PortsTestJSON-209107367'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:33.956605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0f759c2-b072-4f33-8094-86e9a64955e9 x-openstack-request-id: req-f0f759c2-b072-4f33-8094-86e9a64955e9 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:33.957065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7a44151-8384-4ee1-997e-6273cc167dcc", "name": "network-vif-deleted", "tag": "26aa7f6c-485f-4a13-a097-744803530749", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:33.957600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-f0f759c2-b072-4f33-8094-86e9a64955e9 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:33.958161 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7a44151-8384-4ee1-997e-6273cc167dcc', 'name': 'network-vif-deleted', 'tag': '26aa7f6c-485f-4a13-a097-744803530749', 'status': 'completed', 'code': 200} Nov 24 04:14:33.964387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.983209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Releasing vlan 182 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:33.983696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:33.987283 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:34.045683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Allocated IP 172.20.0.2 (5aab3620-e915-4544-8009-60e1d136b182/0b380565-b933-4b82-a8c3-f74014f0c198/6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:34.067592 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4eee4f04-c729-4337-adb9-c6d63871a83a req-87324674-7ee1-4bb8-8419-b979dce1b09b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1412370 Nov 24 04:14:34.108308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.131029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.136543 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] 10.222.0.48 "DELETE /v2.0/networks/0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a HTTP/1.1" status: 204 len: 168 time: 0.5499108 Nov 24 04:14:34.172357 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a88597-b9e3-458e-862c-e34a8a112f5a tempest-TagsTest-504083302 tempest-TagsTest-504083302-project] Pushing event deleted for resources: {'Network': ['ID=0b5c2136-d7ce-4f3e-91b2-4c0c603fdb3a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:34.226259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:34.230044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.239266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.252452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:34.285623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.296423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.331097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=4051a88a-38c2-4c5e-b906-042c17c43cba,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:34.384253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Network 5aab3620-e915-4544-8009-60e1d136b182 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:34.402469 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.10 (5aab3620-e915-4544-8009-60e1d136b182/0b380565-b933-4b82-a8c3-f74014f0c198/d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:34.403914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': 'ab321b5b-ea71-4a61-b631-eef44465d8d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '37608dc5-580c-4764-b65f-43bd682282cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:34.405132 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 37608dc5-580c-4764-b65f-43bd682282cb, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:34.414394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:34.459716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 37608dc5-580c-4764-b65f-43bd682282cb is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:34.476178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 37608dc5-580c-4764-b65f-43bd682282cb) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:34.483256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:34.485379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.499936 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fbf87720-08f6-49f8-ad4b-748ee4645f6c req-7b7d8d09-3b84-4921-ba18-d90937261e27 tempest-TestServerAdvancedOps-17916696 tempest-TestServerAdvancedOps-17916696-project] 10.222.0.48 "GET /v2.0/ports?device_id=603e8bd7-e303-481c-aac8-5f973041c636 HTTP/1.1" status: 200 len: 210 time: 0.0445108 Nov 24 04:14:34.521720 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3a1fb6b2-8102-478a-860e-6fda7a9239fa tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.9662113 Nov 24 04:14:34.522539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35026) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:34.528138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:34.544790 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:34.549514 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4375bbb4-4380-43dc-a536-3c64024fd6e3 None None] Network 37608dc5-580c-4764-b65f-43bd682282cb requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:34.552744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Pushing event updated for resources: {'Port': ['ID=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:34.616488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35028) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:34.698814 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8d3e05a7-d6ec-4b28-ba54-1854e657c1a3 req-d69ceb0c-b596-4747-9a0e-a74916bfe723 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=f7a44151-8384-4ee1-997e-6273cc167dcc HTTP/1.1" status: 200 len: 210 time: 0.0597005 Nov 24 04:14:34.702860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.741027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:34.745735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.814619 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-29e72204-b80d-4644-b522-c22f16d07e44 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=49e1d30283f345cface3cdb2815be233&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1963568 Nov 24 04:14:34.817851 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35032) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:34.846999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.878725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Attempting to bind port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:34.879102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Attempting to bind port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '3aba44ed-37ff-41ae-ac2b-1adf56d08507', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '5aab3620-e915-4544-8009-60e1d136b182'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:34.879473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Attempting to bind port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 on network 5aab3620-e915-4544-8009-60e1d136b182 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:34.896780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:34.897144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Checking segment: {'id': '3aba44ed-37ff-41ae-ac2b-1adf56d08507', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '5aab3620-e915-4544-8009-60e1d136b182'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:34.897702 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.898102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Bound using segment: {'id': '3aba44ed-37ff-41ae-ac2b-1adf56d08507', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '5aab3620-e915-4544-8009-60e1d136b182'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:34.898616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Bound port: 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3aba44ed-37ff-41ae-ac2b-1adf56d08507', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 163, 'network_id': '5aab3620-e915-4544-8009-60e1d136b182'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:34.899013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.899537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 5aab3620-e915-4544-8009-60e1d136b182 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:34.913712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:34.920281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:34.963596 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:34.977947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24c5d9c6-d02b-4459-90aa-3004b8983f47 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.992023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:34.992557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:34.997110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.018744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24c5d9c6-d02b-4459-90aa-3004b8983f47 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.025923 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-10f30579-4404-4ea9-99d2-a9f97437572b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.0880439 Nov 24 04:14:35.027137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35034) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:35.042098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-caf31b89-dbd4-416c-9583-ee2de21f2060 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.080444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24c5d9c6-d02b-4459-90aa-3004b8983f47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.084324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-24c5d9c6-d02b-4459-90aa-3004b8983f47 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.087851 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-24c5d9c6-d02b-4459-90aa-3004b8983f47 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/670561e3-237a-4bfe-bf23-b1147bd45fc0 HTTP/1.1" status: 204 len: 168 time: 0.2660787 Nov 24 04:14:35.087998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] For port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:35.092235 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] For port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,segment=NetworkSegment(3aba44ed-37ff-41ae-ac2b-1adf56d08507),segment_id=3aba44ed-37ff-41ae-ac2b-1adf56d08507)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:35.104557 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c5d9c6-d02b-4459-90aa-3004b8983f47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=670561e3-237a-4bfe-bf23-b1147bd45fc0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:35.113544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.129767 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-37608dc5-580c-4764-b65f-43bd682282cb', 'network_id': '37608dc5-580c-4764-b65f-43bd682282cb', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '4051a88a-38c2-4c5e-b906-042c17c43cba'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:35.130820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.213099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1135a744-93a6-449d-9981-c6b0cad80217 req-c5f4ba76-a8c6-4bba-ae8b-7470138f348d tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:35.216405 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1135a744-93a6-449d-9981-c6b0cad80217 req-c5f4ba76-a8c6-4bba-ae8b-7470138f348d tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0690718 Nov 24 04:14:35.283071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=2e9268d5-7892-4616-9ccf-7721d2a741d2,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:35.299024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '67ae6a41-e0c2-4714-9321-5da2760b1a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 183, 'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:35.299402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 98a4f053-9ca9-4678-80b4-a528e80ad18f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:35.306437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-303878bb-5553-4d9d-8c14-192d86ef3f06 None None] Pushing event updated for resources: {'Port': ['ID=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:35.335865 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1135a744-93a6-449d-9981-c6b0cad80217 req-7e24b698-665b-4864-b61b-07b7fb3d6ddb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1116061 Nov 24 04:14:35.408744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Allocated IP 2001:db8::2 (37608dc5-580c-4764-b65f-43bd682282cb/4051a88a-38c2-4c5e-b906-042c17c43cba/49c3d42b-430a-476c-b34a-1a0c129ee42d) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:35.408967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:35.474679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 98a4f053-9ca9-4678-80b4-a528e80ad18f) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:35.520208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:35.522031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.606212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cefd094-d9c8-4731-97d1-1d442455a314 None None] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:35.614517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35042) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:35.670218 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.675383 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9cd4bbc6-09aa-44a0-9fb0-8b46744bda5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.1517220 Nov 24 04:14:35.678016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35044) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:35.685276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-959187816', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:35.698957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Deleting subnet 16303810-2955-433b-bb61-fa9692bb82ad {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:35.705894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.751413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.752458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.768059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.770187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35048) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:35.862830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.888802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.903750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-98a4f053-9ca9-4678-80b4-a528e80ad18f', 'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '2e9268d5-7892-4616-9ccf-7721d2a741d2'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:35.906191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:35.926638 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 26aa7f6c-485f-4a13-a097-744803530749 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:35.951008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Network 37608dc5-580c-4764-b65f-43bd682282cb is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:35.959491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '603e8bd7-e303-481c-aac8-5f973041c636', 'name': 'network-vif-deleted', 'tag': 'ce904412-401d-4df1-801f-c17322c730b9'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:35.962873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f37e7ac-5e54-400c-99d3-094883657d58" -d '{"events": [{"server_uuid": "603e8bd7-e303-481c-aac8-5f973041c636", "name": "network-vif-deleted", "tag": "ce904412-401d-4df1-801f-c17322c730b9"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:35.987365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:35.989931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:35.999280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: 26aa7f6c-485f-4a13-a097-744803530749 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:35.999653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 26aa7f6c-485f-4a13-a097-744803530749 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:36.000049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device ce904412-401d-4df1-801f-c17322c730b9 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:36.021434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cfe2302b-026b-4709-8b11-f2e003c6bc45 x-openstack-request-id: req-cfe2302b-026b-4709-8b11-f2e003c6bc45 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:36.021720 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "603e8bd7-e303-481c-aac8-5f973041c636", "name": "network-vif-deleted", "tag": "ce904412-401d-4df1-801f-c17322c730b9", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:36.022000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-cfe2302b-026b-4709-8b11-f2e003c6bc45 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:36.022403 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '603e8bd7-e303-481c-aac8-5f973041c636', 'name': 'network-vif-deleted', 'tag': 'ce904412-401d-4df1-801f-c17322c730b9', 'status': 'completed', 'code': 200} Nov 24 04:14:36.033083 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.039822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.088866 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Pushing event updated for resources: {'Port': ['ID=49c3d42b-430a-476c-b34a-1a0c129ee42d,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:36.092213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: ce904412-401d-4df1-801f-c17322c730b9 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:36.092575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device ce904412-401d-4df1-801f-c17322c730b9 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:36.137469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:36.151079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Attempting to bind port 49c3d42b-430a-476c-b34a-1a0c129ee42d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:36.151274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Attempting to bind port 49c3d42b-430a-476c-b34a-1a0c129ee42d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'ab321b5b-ea71-4a61-b631-eef44465d8d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '37608dc5-580c-4764-b65f-43bd682282cb'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:36.151702 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Attempting to bind port 49c3d42b-430a-476c-b34a-1a0c129ee42d on network 37608dc5-580c-4764-b65f-43bd682282cb {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:36.162611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:36.162984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Checking segment: {'id': 'ab321b5b-ea71-4a61-b631-eef44465d8d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '37608dc5-580c-4764-b65f-43bd682282cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:36.163396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.163798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Bound using segment: {'id': 'ab321b5b-ea71-4a61-b631-eef44465d8d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '37608dc5-580c-4764-b65f-43bd682282cb'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:36.164288 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Bound port: 49c3d42b-430a-476c-b34a-1a0c129ee42d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ab321b5b-ea71-4a61-b631-eef44465d8d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '37608dc5-580c-4764-b65f-43bd682282cb'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:36.164678 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.282528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Allocated IP 2001:db8:1::2 (98a4f053-9ca9-4678-80b4-a528e80ad18f/2e9268d5-7892-4616-9ccf-7721d2a741d2/be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:36.285388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] For port 49c3d42b-430a-476c-b34a-1a0c129ee42d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:36.289984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] For port 49c3d42b-430a-476c-b34a-1a0c129ee42d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=49c3d42b-430a-476c-b34a-1a0c129ee42d,segment=NetworkSegment(ab321b5b-ea71-4a61-b631-eef44465d8d1),segment_id=ab321b5b-ea71-4a61-b631-eef44465d8d1)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:36.300346 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.303900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.343110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:36.351750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.367911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.404921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.427633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-346e28c7-9284-4538-a88a-55aa3ba47f18 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.451742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.455844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35054) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:36.456007 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9ea0ea45-d945-4376-ba8c-8f5c46338486 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.7768149 Nov 24 04:14:36.481204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.528866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-346e28c7-9284-4538-a88a-55aa3ba47f18 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.536553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.539659 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] 10.222.0.48 "DELETE /v2.0/subnets/16303810-2955-433b-bb61-fa9692bb82ad HTTP/1.1" status: 204 len: 168 time: 0.9241114 Nov 24 04:14:36.561017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35056) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:36.573321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.583898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7925848d-5a09-4e10-8128-10e6bf05ebce None None] Pushing event updated for resources: {'Port': ['ID=49c3d42b-430a-476c-b34a-1a0c129ee42d,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:36.590397 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.650851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:36.657784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ea103db-50ac-4578-99a9-170a98e7ede9 None None] Network 5aab3620-e915-4544-8009-60e1d136b182 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:36.677645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:36.679996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:36.681116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f8caa2-b963-4075-9ddd-62d37bd808ad admin admin] Pushing event deleted for resources: {'Subnet': ['ID=16303810-2955-433b-bb61-fa9692bb82ad,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:36.694592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:36.694967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.703005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Pushing event updated for resources: {'Port': ['ID=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:36.710073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.739778 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c66731-ad57-4617-971e-e21af0ab603b req-bd73cf5f-db1a-45c0-8713-d4954a8053c4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:36.741311 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-69c66731-ad57-4617-971e-e21af0ab603b req-bd73cf5f-db1a-45c0-8713-d4954a8053c4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.2843947 Nov 24 04:14:36.868363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Attempting to bind port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:36.868738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Attempting to bind port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '67ae6a41-e0c2-4714-9321-5da2760b1a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 183, 'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:36.869110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Attempting to bind port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f on network 98a4f053-9ca9-4678-80b4-a528e80ad18f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:36.879007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e6f10649-b842-4991-b5d2-f37c53956000 None None] Provisioning complete for port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:36.881289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e6f10649-b842-4991-b5d2-f37c53956000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.883452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.912948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:36.913304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Checking segment: {'id': '67ae6a41-e0c2-4714-9321-5da2760b1a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 183, 'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:36.913713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.914109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Bound using segment: {'id': '67ae6a41-e0c2-4714-9321-5da2760b1a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 183, 'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:36.922936 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-69c66731-ad57-4617-971e-e21af0ab603b req-50a5b360-04b8-4585-a7a2-284894fdfb26 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1548800 Nov 24 04:14:36.924633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-346e28c7-9284-4538-a88a-55aa3ba47f18 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.928026 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-346e28c7-9284-4538-a88a-55aa3ba47f18 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.930227 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-346e28c7-9284-4538-a88a-55aa3ba47f18 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/85d13e9f-8f86-478e-a7fe-77e3092afe4b HTTP/1.1" status: 204 len: 168 time: 1.1565106 Nov 24 04:14:36.934934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Bound port: be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '67ae6a41-e0c2-4714-9321-5da2760b1a7c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 183, 'network_id': '98a4f053-9ca9-4678-80b4-a528e80ad18f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:36.935591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.945060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.950131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-346e28c7-9284-4538-a88a-55aa3ba47f18 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=85d13e9f-8f86-478e-a7fe-77e3092afe4b,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:36.954528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['acefce04-02aa-44cc-bb30-373d1b065eae']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:36.977701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d6fe194-5d56-4d69-bb30-b0e96721fe3f') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:36.977989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d6fe194-5d56-4d69-bb30-b0e96721fe3f') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:36.979870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35060) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:36.999101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:36.999351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.052816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.064018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Releasing vlan 172 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:37.064415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:37.066510 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:37.079684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting subnet b58537d8-e9f8-43e0-92cb-52a12f3fe9d6 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:37.091117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.112276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] For port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:37.115115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] For port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,segment=NetworkSegment(67ae6a41-e0c2-4714-9321-5da2760b1a7c),segment_id=67ae6a41-e0c2-4714-9321-5da2760b1a7c)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:37.144737 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.178620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.205175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.217075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.223294 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] 10.222.0.48 "DELETE /v2.0/networks/acefce04-02aa-44cc-bb30-373d1b065eae HTTP/1.1" status: 204 len: 168 time: 0.6314228 Nov 24 04:14:37.230239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35062) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:37.234826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d2ad6a5-6bd2-4d35-b735-b479f6468c19 admin admin] Pushing event deleted for resources: {'Network': ['ID=acefce04-02aa-44cc-bb30-373d1b065eae,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:37.235084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.300541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.314326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c476520-7c9c-4c80-8dd4-ab6fbba4ddd2 None None] Pushing event updated for resources: {'Port': ['ID=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:37.336906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,segment=NetworkSegment(3aba44ed-37ff-41ae-ac2b-1adf56d08507),segment_id=3aba44ed-37ff-41ae-ac2b-1adf56d08507)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:37.339898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e6f10649-b842-4991-b5d2-f37c53956000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.346712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Deleting subnet e57451b9-29ef-4d61-b156-8d23758eeccd {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:37.359436 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.378548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.405486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.446307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.451224 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/subnets/b58537d8-e9f8-43e0-92cb-52a12f3fe9d6 HTTP/1.1" status: 204 len: 168 time: 0.4644992 Nov 24 04:14:37.454980 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25d426b-bf5e-4728-b629-5d62c347a0ea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Subnet': ['ID=b58537d8-e9f8-43e0-92cb-52a12f3fe9d6,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:37.458078 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35064) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:37.577855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8::1 (37608dc5-580c-4764-b65f-43bd682282cb/4051a88a-38c2-4c5e-b906-042c17c43cba/8e82fa9a-5706-46cc-88a0-e936c647ed5c) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:37.616760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.645748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9440aa6e-c08f-4ad1-a116-a711235426e6 None None] Network 61fb4de4-ff65-42d0-aed9-c58e7caab600 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:37.698782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 79f9a8dc-23c7-4067-be18-299b610d4334 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:37.699131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.778715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:37.781968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-e6f10649-b842-4991-b5d2-f37c53956000 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:14:37.793433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-e6f10649-b842-4991-b5d2-f37c53956000 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:14:37.853506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 79f9a8dc-23c7-4067-be18-299b610d4334, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=79f9a8dc-23c7-4067-be18-299b610d4334,segment=NetworkSegment(d92fbff6-b634-454f-b4b7-5f45f8744fac),segment_id=d92fbff6-b634-454f-b4b7-5f45f8744fac)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:37.854218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:37.882019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 79f9a8dc-23c7-4067-be18-299b610d4334 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:37.974338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d3dc7df0-8402-443b-85fb-678bcbbfd845 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.014175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.058582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-581db927-fb83-4492-85ff-f08fb0c04f0f None None] DHCP port deletion for 61fb4de4-ff65-42d0-aed9-c58e7caab600 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:38.075485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=79f9a8dc-23c7-4067-be18-299b610d4334,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:38.089049 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port 79f9a8dc-23c7-4067-be18-299b610d4334 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:38.185677 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1123c482-15cb-44be-8bbb-153487abeec8 req-986a1010-6ea8-4b4c-8999-477329b20548 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:38.188284 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1123c482-15cb-44be-8bbb-153487abeec8 req-986a1010-6ea8-4b4c-8999-477329b20548 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1154761 Nov 24 04:14:38.224584 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.247251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.280942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['61fb4de4-ff65-42d0-aed9-c58e7caab600']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:38.309432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd92fbff6-b634-454f-b4b7-5f45f8744fac') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:38.309731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd92fbff6-b634-454f-b4b7-5f45f8744fac') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:38.334192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.370761 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-1123c482-15cb-44be-8bbb-153487abeec8 req-8990804a-e65a-4f92-a0a9-af3a601a8bc1 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1501899 Nov 24 04:14:38.372708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.386447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Releasing vlan 157 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:38.386926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:38.390091 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:38.432607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78e45c1b-5db3-4963-a5c3-12f0f72346e6 None None] Network 37608dc5-580c-4764-b65f-43bd682282cb requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:38.436858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.493358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.494475 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.503303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.523479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.532231 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.543889 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/networks/61fb4de4-ff65-42d0-aed9-c58e7caab600 HTTP/1.1" status: 204 len: 168 time: 1.0810914 Nov 24 04:14:38.545427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c769433f-a790-4a21-b733-cf1bf4c55dae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Network': ['ID=61fb4de4-ff65-42d0-aed9-c58e7caab600,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:38.547499 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35068) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:38.557160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:38.610937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Provisioning complete for port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:38.611360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.658024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.716478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.718942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:38.719548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.720945 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] 10.222.0.48 "DELETE /v2.0/subnets/e57451b9-29ef-4d61-b156-8d23758eeccd HTTP/1.1" status: 204 len: 168 time: 1.4884667 Nov 24 04:14:38.727139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35070) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:38.727818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5adbf17-f727-4a9b-8c0d-6bc462c45e4c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e57451b9-29ef-4d61-b156-8d23758eeccd,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:38.730919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:38.742374 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.775259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.795550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.808386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 37608dc5-580c-4764-b65f-43bd682282cb is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:38.812643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:38.815748 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:38.816492 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.829431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.856964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4089768-29f4-4d90-9c56-fe5016aa71f4 None None] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:38.950543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:38.975698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=8e82fa9a-5706-46cc-88a0-e936c647ed5c,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:38.976382 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:38.978655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['78868d08-ded4-49d9-b11d-39b526ef8dd7']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:38.990682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c9112c2-9ccd-4c5f-b77c-702b7a00d4b2') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:38.991054 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c9112c2-9ccd-4c5f-b77c-702b7a00d4b2') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:39.006735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Provisioning complete for port d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.007095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.009616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port fc244ada-be12-4593-a3c6-dcb3cae0ded0 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:39.009972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.013693 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.031636 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network 5aab3620-e915-4544-8009-60e1d136b182 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:39.037496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:39.048322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.084410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Port d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:39.086868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Releasing vlan 175 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:39.087425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:39.089518 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:39.124774 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Provisioning complete for port 49c3d42b-430a-476c-b34a-1a0c129ee42d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.125160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.152505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.178868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.179335 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.189878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.197742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for fc244ada-be12-4593-a3c6-dcb3cae0ded0 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:39.199900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.211491 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] 10.222.0.48 "DELETE /v2.0/networks/78868d08-ded4-49d9-b11d-39b526ef8dd7 HTTP/1.1" status: 204 len: 168 time: 0.4821582 Nov 24 04:14:39.214661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.215494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.238890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35371611-9041-4bec-9c8d-d00a82647d90 admin admin] Pushing event deleted for resources: {'Network': ['ID=78868d08-ded4-49d9-b11d-39b526ef8dd7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:39.405564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.420834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.528573 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] For port 49c3d42b-430a-476c-b34a-1a0c129ee42d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=49c3d42b-430a-476c-b34a-1a0c129ee42d,segment=NetworkSegment(ab321b5b-ea71-4a61-b631-eef44465d8d1),segment_id=ab321b5b-ea71-4a61-b631-eef44465d8d1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:39.536143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,segment=NetworkSegment(67ae6a41-e0c2-4714-9321-5da2760b1a7c),segment_id=67ae6a41-e0c2-4714-9321-5da2760b1a7c)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:39.539337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.545211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35076) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:39.590472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.591449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 49c3d42b-430a-476c-b34a-1a0c129ee42d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:39.610754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.634630 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e0d9f1fd-a9f0-4d5a-97ac-0403f4b2e258 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=1f9bf64d67774d1fb7ab8d25db416cdd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0882261 Nov 24 04:14:39.667273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35078) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:39.668410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57764ac8-4a93-4bdb-a8b7-60b5aa3df65b None None] Pushing event updated for resources: {'Port': ['ID=49c3d42b-430a-476c-b34a-1a0c129ee42d,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:39.680435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=fc244ada-be12-4593-a3c6-dcb3cae0ded0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:39.713835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Provisioning complete for port 8e82fa9a-5706-46cc-88a0-e936c647ed5c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.714411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.777897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 49c3d42b-430a-476c-b34a-1a0c129ee42d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.778606 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.789570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.789904 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP 69d31bd4-9fe6-491e-8c03-a04773e3f2d2 disassociated (deleted). External IP: 172.26.5.143, port: 9f1b668f-dd92-42dc-9d4b-55596d7ec904. Nov 24 04:14:39.799387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:39.810425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Router daa9fa3d-bf65-4d24-a324-e10a8f3b297b is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:14:39.810921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Port 8e82fa9a-5706-46cc-88a0-e936c647ed5c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:39.821705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.834834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Provisioning complete for port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.835374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.841910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd663f85-add1-4d1d-ad14-3387516b7de8 req-dbe5fe88-70fc-4b7e-ac70-59d8c7f7e994 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:39.843537 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-cd663f85-add1-4d1d-ad14-3387516b7de8 req-dbe5fe88-70fc-4b7e-ac70-59d8c7f7e994 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.1419270 Nov 24 04:14:39.845327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.846229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.851993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ee00266-7e09-457d-905d-c3cc306a2e0a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.909617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ee00266-7e09-457d-905d-c3cc306a2e0a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:39.983059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Provisioning complete for port d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:39.983692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.011146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 79f9a8dc-23c7-4067-be18-299b610d4334 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:40.041489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 79f9a8dc-23c7-4067-be18-299b610d4334 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:40.042089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 79f9a8dc-23c7-4067-be18-299b610d4334 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:40.076130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Port d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:40.078938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=8e82fa9a-5706-46cc-88a0-e936c647ed5c,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:40.082816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.091588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:40.095132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:40.096013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Provisioning complete for port 49c3d42b-430a-476c-b34a-1a0c129ee42d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:40.097706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c8c0dbf-503f-42e1-a978-5ac5d5c57a2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.099926 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ee00266-7e09-457d-905d-c3cc306a2e0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.102944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5ee00266-7e09-457d-905d-c3cc306a2e0a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.103075 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-88bb61e2-255b-4998-a9b2-c16745e3a79b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/routers/daa9fa3d-bf65-4d24-a324-e10a8f3b297b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0752270 Nov 24 04:14:40.106731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35080) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:40.107299 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] Sync routers for ids ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:40.107906 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5ee00266-7e09-457d-905d-c3cc306a2e0a admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/d4520c5d-8714-4382-b447-66561e7fc1ff HTTP/1.1" status: 204 len: 168 time: 0.4383941 Nov 24 04:14:40.118952 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-cd663f85-add1-4d1d-ad14-3387516b7de8 req-ea8d5ae2-7e95-486a-b927-16c7f4da60b4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2621570 Nov 24 04:14:40.133794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee00266-7e09-457d-905d-c3cc306a2e0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4520c5d-8714-4382-b447-66561e7fc1ff,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:40.136109 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] Routers {'daa9fa3d-bf65-4d24-a324-e10a8f3b297b'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:40.136862 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.231992 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.261843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 37608dc5-580c-4764-b65f-43bd682282cb is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:40.264264 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] Routers {'daa9fa3d-bf65-4d24-a324-e10a8f3b297b'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:40.264415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:40.265216 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.330537 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.331534 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8e0c9c7-683e-41bb-8ec6-1765c416015b None None] The sync data for ids ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:40.341358 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:40.348726 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:40.354369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.386005 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:14:40.393215 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b56944e0-d2bd-4cbe-a308-b88824f82b1b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/floatingips/69d31bd4-9fe6-491e-8c03-a04773e3f2d2 HTTP/1.1" status: 204 len: 168 time: 1.8411808 Nov 24 04:14:40.402382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:40.406754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5" -d '{"events": [{"name": "network-changed", "server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:40.416998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:40.458489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:40.459297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.460198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ca283bc-fa17-46af-82d0-d3aa4ebd0b3a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:40.463440 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0ca283bc-fa17-46af-82d0-d3aa4ebd0b3a tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports?device_id=daa9fa3d-bf65-4d24-a324-e10a8f3b297b HTTP/1.1" status: 200 len: 982 time: 0.3566246 Nov 24 04:14:40.466376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35096) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:40.562445 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:40.563479 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.588634 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:14:40.711181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c0e4ef87-f730-4ebf-9f15-b7c39a5dffa2 None None] Provisioning complete for port 8e82fa9a-5706-46cc-88a0-e936c647ed5c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:40.711554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c0e4ef87-f730-4ebf-9f15-b7c39a5dffa2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.746564 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35100) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:40.783680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c0e4ef87-f730-4ebf-9f15-b7c39a5dffa2 None None] Port 8e82fa9a-5706-46cc-88a0-e936c647ed5c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:40.810500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:40.823212 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a3bd316c-9114-46fd-885b-b8cf9d471404 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3662112 Nov 24 04:14:40.824042 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35102) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:40.824402 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] Sync routers for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:40.837503 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:40.838511 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.863657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-934f05b0-baa7-4723-87b6-e8f94ba6c024 x-openstack-request-id: req-934f05b0-baa7-4723-87b6-e8f94ba6c024 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:40.864365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:40.864868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-934f05b0-baa7-4723-87b6-e8f94ba6c024 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:40.865000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:40.865964 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'status': 'completed', 'code': 200} Nov 24 04:14:40.870404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 49c3d42b-430a-476c-b34a-1a0c129ee42d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:40.874173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c0e4ef87-f730-4ebf-9f15-b7c39a5dffa2 None None] Provisioning complete for port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:40.874560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c0e4ef87-f730-4ebf-9f15-b7c39a5dffa2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:40.895914 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.898059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8181e376-0559-4f3f-976b-9416da7a907a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:40.902399 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8181e376-0559-4f3f-976b-9416da7a907a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports/8e82fa9a-5706-46cc-88a0-e936c647ed5c HTTP/1.1" status: 200 len: 911 time: 0.0768132 Nov 24 04:14:40.904936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35104) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:40.920668 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:40.921639 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.962050 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:40.963000 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5de97b-d9b9-4b4c-b656-3723ef6f2442 None None] The sync data for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:40.995393 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-99d632d0-b108-4209-842c-1b95bf174511 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=b489f05684494105afe242125c1c12c4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2458949 Nov 24 04:14:40.996070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35106) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:40.999630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-1c966c47-6da3-40f0-a4dd-ac330c124f06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:41.001198 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-1c966c47-6da3-40f0-a4dd-ac330c124f06 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 1099 time: 0.1448374 Nov 24 04:14:41.053008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e688bb09-5874-4251-83cc-aa32e156c52e req-ade25659-455b-4698-b11c-3609f628efdd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:41.054647 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e688bb09-5874-4251-83cc-aa32e156c52e req-ade25659-455b-4698-b11c-3609f628efdd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 946 time: 0.1876585 Nov 24 04:14:41.141979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.143589 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e688bb09-5874-4251-83cc-aa32e156c52e req-171a5cd9-6c35-418f-b57b-4638752728d0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0751610 Nov 24 04:14:41.151039 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d00631-2e13-4c89-a475-847db2adc00a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.175783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d00631-2e13-4c89-a475-847db2adc00a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.283950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-a6350a10-75ea-4024-bd5f-c05c6734ace2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:41.285452 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-a6350a10-75ea-4024-bd5f-c05c6734ace2 service neutron] 10.222.0.21 "GET /v2.0/networks?id=becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 200 len: 898 time: 0.2692082 Nov 24 04:14:41.356994 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d00631-2e13-4c89-a475-847db2adc00a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.359913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-29d00631-2e13-4c89-a475-847db2adc00a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.361669 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-29d00631-2e13-4c89-a475-847db2adc00a admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/4ba7d7e7-e777-4b67-9643-5b6f62746761 HTTP/1.1" status: 204 len: 168 time: 0.3616869 Nov 24 04:14:41.376758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d00631-2e13-4c89-a475-847db2adc00a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ba7d7e7-e777-4b67-9643-5b6f62746761,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:41.378461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 49c3d42b-430a-476c-b34a-1a0c129ee42d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:41.378925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.381068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.404834 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-eea0f834-eccc-45a4-a5e3-9d951779494b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 200 len: 217 time: 0.1080720 Nov 24 04:14:41.492116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7d7317-a8c5-4426-8f2c-3bcdb814ae76 req-a914825f-8ff1-4042-917d-84e03ab3f9c1 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:41.493805 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ba7d7317-a8c5-4426-8f2c-3bcdb814ae76 req-a914825f-8ff1-4042-917d-84e03ab3f9c1 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.2509038 Nov 24 04:14:41.535248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:28Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:41.565597 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:14:41.585234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:41.585880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:41.589593 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-c6d383d3-8d38-4c5b-8b57-87a94fbfbb03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:41.590187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-c6d383d3-8d38-4c5b-8b57-87a94fbfbb03 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=c4348623-9729-4d15-a5cf-803eac33880a HTTP/1.1" status: 200 len: 834 time: 0.1644254 Nov 24 04:14:41.612766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.634417 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:41.634730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e3ae3ada-5b27-4ede-9016-d76e2ddeffb3 None None] Provisioning complete for port 8e82fa9a-5706-46cc-88a0-e936c647ed5c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:41.634831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.635059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e3ae3ada-5b27-4ede-9016-d76e2ddeffb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.683210 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ba7d7317-a8c5-4426-8f2c-3bcdb814ae76 req-1aefc245-8e99-42f1-ac0e-239df3cc28f3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1596150 Nov 24 04:14:41.686294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb022a07-dfce-4398-97eb-cd8145bf94ab req-081a8e1a-cf3b-43af-bbab-c7ddd26c5c0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:41.689405 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-eb022a07-dfce-4398-97eb-cd8145bf94ab req-081a8e1a-cf3b-43af-bbab-c7ddd26c5c0c service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1099 time: 0.1743262 Nov 24 04:14:41.739039 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e3ae3ada-5b27-4ede-9016-d76e2ddeffb3 None None] Port 8e82fa9a-5706-46cc-88a0-e936c647ed5c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:41.772729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:41.773281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:41.792431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:41.911565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c286a8f2-ac43-4387-b29d-abf0de1cbc16 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:14:41.996559 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.027758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:42.083406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:42.103368 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'port_id': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'mac_address': 'fa:16:3e:cc:4a:1d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 191, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:14:42.151009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-b04a7634-e2b6-48aa-b740-cc6bfb105ae7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:42.152568 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-b04a7634-e2b6-48aa-b740-cc6bfb105ae7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 946 time: 0.0559578 Nov 24 04:14:42.155635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.162900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:28Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:42.214683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c286a8f2-ac43-4387-b29d-abf0de1cbc16 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:14:42.225786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff5d952-87ff-4f4f-b892-51576c655cd7 None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:28Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ae19df28-b4dc-4543-a27d-e26e7c450f42', 'name': '', 'network_id': 'becef48c-b834-483b-91dc-0f71ec58e834', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:70:61:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_interface', 'standard_attr_id': 848, 'fixed_ips': [{'subnet_id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:23Z', 'updated_at': '2021-11-24T04:12:33Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'c4348623-9729-4d15-a5cf-803eac33880a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:42.251250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.274760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:42.279522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-f3f1e0bb-74c5-448c-95e0-082e3eea088d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:42.281771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.282939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.284545 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-f3f1e0bb-74c5-448c-95e0-082e3eea088d service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=becef48c-b834-483b-91dc-0f71ec58e834&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.6842608 Nov 24 04:14:42.354899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=6']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:42.433889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-eb022a07-dfce-4398-97eb-cd8145bf94ab req-4000ebc6-f399-4e17-8619-78378e264a30 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2057209 Nov 24 04:14:42.511607 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-de2de9ef-777a-44f6-808a-17c09b609b39 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1744332 Nov 24 04:14:42.521035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8:1::1 (98a4f053-9ca9-4678-80b4-a528e80ad18f/2e9268d5-7892-4616-9ccf-7721d2a741d2/e8f94244-5f65-4016-b751-49674a4b3dd7) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:42.528442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['c286a8f2-ac43-4387-b29d-abf0de1cbc16'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:14:42.593040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e203a67c-835d-4c56-a2f4-6fecfcdfda7d None None] New status for floating IP 69d31bd4-9fe6-491e-8c03-a04773e3f2d2: DOWN {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:14:42.715524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.760570 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b7aa2e15-46d6-41ab-8ed8-f7db3e9e6fe5 req-f4c1927e-e26d-422b-a5d3-0e7305716912 service neutron] 10.222.0.21 "GET /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1349192 Nov 24 04:14:42.781228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.850815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:42.860790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:42.867594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:42.868614 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:42.914817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=e8f94244-5f65-4016-b751-49674a4b3dd7,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:42.924935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df91dce-5eff-4ddb-b1d7-72eb70c9de37 req-2c74e34c-99eb-42d1-b30c-204fdc3e8b44 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:42.929848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6df91dce-5eff-4ddb-b1d7-72eb70c9de37 req-2c74e34c-99eb-42d1-b30c-204fdc3e8b44 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=49acebc0-f021-4e68-8116-e16663679896 HTTP/1.1" status: 200 len: 946 time: 0.6171558 Nov 24 04:14:42.932967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66596e82-66e0-4952-a3c7-874f22f9d2fd req-8788aab5-aeb0-4da8-886b-ff84d16a3b5e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:42.934780 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-66596e82-66e0-4952-a3c7-874f22f9d2fd req-8788aab5-aeb0-4da8-886b-ff84d16a3b5e tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 945 time: 0.1505144 Nov 24 04:14:42.980289 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Router daa9fa3d-bf65-4d24-a324-e10a8f3b297b has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:42.998697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:42.999030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.024941 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-66596e82-66e0-4952-a3c7-874f22f9d2fd req-5509a067-5102-42e7-b78a-549b3dce3d36 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0826945 Nov 24 04:14:43.044348 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6df91dce-5eff-4ddb-b1d7-72eb70c9de37 req-c6539945-aa97-4153-adc9-97cd78c37898 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=558d0703-e628-4b77-8479-c6f15ad57e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1052430 Nov 24 04:14:43.063482 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.153155 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:43.161855 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-60d5a18e-ff01-4d4c-b359-6dd452169d7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/routers/daa9fa3d-bf65-4d24-a324-e10a8f3b297b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6912942 Nov 24 04:14:43.162936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35116) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:43.163378 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] Sync routers for ids ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:43.173756 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] Routers {'daa9fa3d-bf65-4d24-a324-e10a8f3b297b'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:43.174612 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:43.192163 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-ce41923f-fce2-45ff-a086-b7b55e6e47b6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:43.193780 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ce41923f-fce2-45ff-a086-b7b55e6e47b6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/d2ffb8a4-4535-4c2e-8fa4-8a48f0b57134 HTTP/1.1" status: 404 len: 333 time: 0.0301640 Nov 24 04:14:43.196807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35118) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:43.207716 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:43.209730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 9f1b668f-dd92-42dc-9d4b-55596d7ec904, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=9f1b668f-dd92-42dc-9d4b-55596d7ec904,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:43.209911 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-23c8f93f-2fa5-4b97-b718-fa8da8b1610f None None] Provisioning complete for port e8f94244-5f65-4016-b751-49674a4b3dd7 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:43.210419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.210533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-23c8f93f-2fa5-4b97-b718-fa8da8b1610f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.217671 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] Routers {'daa9fa3d-bf65-4d24-a324-e10a8f3b297b'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:43.218521 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:43.223858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 9f1b668f-dd92-42dc-9d4b-55596d7ec904 owned by compute:nova {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:43.252738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-23c8f93f-2fa5-4b97-b718-fa8da8b1610f None None] Port e8f94244-5f65-4016-b751-49674a4b3dd7 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:43.256671 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:43.257497 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f72b6c74-0055-4c56-a148-4ee3c19a1a87 None None] The sync data for ids ['daa9fa3d-bf65-4d24-a324-e10a8f3b297b'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:43.308995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.362126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.400012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=9f1b668f-dd92-42dc-9d4b-55596d7ec904,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:43.435052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port 9f1b668f-dd92-42dc-9d4b-55596d7ec904 on host hv-neutron-8190 {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:43.437611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.441109 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3c31bf2a-4da7-4712-ba3f-71dedcb61fcc req-5eeaae47-3574-4774-8d40-e988fe8042eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "DELETE /v2.0/ports/9f1b668f-dd92-42dc-9d4b-55596d7ec904 HTTP/1.1" status: 204 len: 173 time: 1.1761889 Nov 24 04:14:43.441666 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'name': 'network-vif-deleted', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:43.444066 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2de56f3d-a8bc-43b3-836d-b7a625addd4b" -d '{"events": [{"server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "name": "network-vif-deleted", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:43.482059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-436fb09f-c0ce-4b42-960c-f44d46c8db6b x-openstack-request-id: req-436fb09f-c0ce-4b42-960c-f44d46c8db6b {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:43.482651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "49acebc0-f021-4e68-8116-e16663679896", "name": "network-vif-deleted", "tag": "9f1b668f-dd92-42dc-9d4b-55596d7ec904", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:43.483056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-436fb09f-c0ce-4b42-960c-f44d46c8db6b {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:43.483570 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '49acebc0-f021-4e68-8116-e16663679896', 'name': 'network-vif-deleted', 'tag': '9f1b668f-dd92-42dc-9d4b-55596d7ec904', 'status': 'completed', 'code': 200} Nov 24 04:14:43.546013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.550625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.613271 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.613652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Fanout notify agent at l3_agent the message router_deleted on router daa9fa3d-bf65-4d24-a324-e10a8f3b297b {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:14:43.621165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.622534 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1576b768-342a-4009-9ca0-2de3c5386543 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/routers/daa9fa3d-bf65-4d24-a324-e10a8f3b297b HTTP/1.1" status: 204 len: 168 time: 0.4239109 Nov 24 04:14:43.625190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35122) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:43.645002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.649437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.650337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.676875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 0b380565-b933-4b82-a8c3-f74014f0c198 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:43.680027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.718559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=e8f94244-5f65-4016-b751-49674a4b3dd7,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:43.724260 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.788492 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:43.790012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:43.817061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.912000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.927770 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:43.933723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c286a8f2-ac43-4387-b29d-abf0de1cbc16 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:43.968204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=0b380565-b933-4b82-a8c3-f74014f0c198,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:43.975710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:43.979455 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f258079c-c7f6-43ca-9ad2-8e9079e472f8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/0b380565-b933-4b82-a8c3-f74014f0c198 HTTP/1.1" status: 204 len: 168 time: 0.3531840 Nov 24 04:14:43.982007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35124) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:44.006498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d735522c-5223-43e9-956c-ee837ab724c8 None None] Network 5aab3620-e915-4544-8009-60e1d136b182 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:44.092677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:44.098800 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1f7aa5df-2ecd-4458-b117-93f7161a29c1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1910417 Nov 24 04:14:44.101291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35130) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:44.110109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] Sync routers for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:44.131053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.156318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39f0333c-c307-4289-9cdc-ff7664fe4f37 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:44.160354 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-39f0333c-c307-4289-9cdc-ff7664fe4f37 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports/e8f94244-5f65-4016-b751-49674a4b3dd7 HTTP/1.1" status: 200 len: 913 time: 0.0548961 Nov 24 04:14:44.160354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35132) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:44.175856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35134) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:44.192105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port c286a8f2-ac43-4387-b29d-abf0de1cbc16 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:44.192815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.218776 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:44.220226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:44.221146 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66c8ac19-8521-45e3-835a-af53f8929cef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.247480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66c8ac19-8521-45e3-835a-af53f8929cef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.282021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:44.302323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12987a81-2ee6-405d-b214-6c35842c4ccd req-1a952b1c-23c4-46f0-b087-dc52fb3db781 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:44.303842 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-12987a81-2ee6-405d-b214-6c35842c4ccd req-1a952b1c-23c4-46f0-b087-dc52fb3db781 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 945 time: 0.1669765 Nov 24 04:14:44.316035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:44.316690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:44.321710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bfbb5c2f-2fbd-4d82-bdf9-d0904ab09946 None None] Provisioning complete for port e8f94244-5f65-4016-b751-49674a4b3dd7 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:44.321899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bfbb5c2f-2fbd-4d82-bdf9-d0904ab09946 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.324044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66c8ac19-8521-45e3-835a-af53f8929cef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.329582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-66c8ac19-8521-45e3-835a-af53f8929cef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.330776 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-66c8ac19-8521-45e3-835a-af53f8929cef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/558d0703-e628-4b77-8479-c6f15ad57e5f HTTP/1.1" status: 204 len: 168 time: 0.1712205 Nov 24 04:14:44.340974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66c8ac19-8521-45e3-835a-af53f8929cef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=558d0703-e628-4b77-8479-c6f15ad57e5f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:44.369551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35138) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:44.402280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:44.402907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738c90f0-61a0-4cf0-968c-f6474dc39dcd None None] The sync data for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:44.445524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] DHCP port deletion for 5aab3620-e915-4544-8009-60e1d136b182 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:44.462920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:44.462920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.463250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-bfbb5c2f-2fbd-4d82-bdf9-d0904ab09946 None None] Port e8f94244-5f65-4016-b751-49674a4b3dd7 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:44.486553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.494719 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-12987a81-2ee6-405d-b214-6c35842c4ccd req-0de99642-2627-47bf-8a0e-c4209db63f64 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1771119 Nov 24 04:14:44.513057 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35140) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:44.527663 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:44.529850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:14:44.533010 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03e96830-5c6e-4570-a7bf-f9bb500f91f2" -d '{"events": [{"server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "name": "network-vif-plugged", "status": "completed", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:14:44.538835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.539666 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 9f1b668f-dd92-42dc-9d4b-55596d7ec904 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:44.568350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: 9f1b668f-dd92-42dc-9d4b-55596d7ec904 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:44.568830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 9f1b668f-dd92-42dc-9d4b-55596d7ec904 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:44.584123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] For port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,segment=NetworkSegment(3aba44ed-37ff-41ae-ac2b-1adf56d08507),segment_id=3aba44ed-37ff-41ae-ac2b-1adf56d08507)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:44.584503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.596523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:14:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e61c4b3-874f-4d46-86e2-4d0612813b4f x-openstack-request-id: req-4e61c4b3-874f-4d46-86e2-4d0612813b4f {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:14:44.596851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "name": "network-vif-plugged", "status": "completed", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:14:44.598194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-4e61c4b3-874f-4d46-86e2-4d0612813b4f {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:14:44.598194 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'code': 200} Nov 24 04:14:44.606774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:44.629834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] Deleting port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:44.630248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.661985 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6bc0cb03-d39a-4b70-913a-121e90bae0a7 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/floatingips/06a6cce1-4f72-4389-a050-43d496e8504b HTTP/1.1" status: 200 len: 993 time: 0.1397398 Nov 24 04:14:44.761050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.800509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:44.802571 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No DVR routers for this DVR port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:44.844296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.844655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.856884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=7']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:44.864182 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] For port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,segment=NetworkSegment(3aba44ed-37ff-41ae-ac2b-1adf56d08507),segment_id=3aba44ed-37ff-41ae-ac2b-1adf56d08507)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:44.864582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.879469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] Calling delete_port for 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:44.959111 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.961329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:44.972899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] No DVR routers for this DVR port 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:44.991221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5aab3620-e915-4544-8009-60e1d136b182']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:45.000943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f12c79-e59e-4114-80af-a72b97403aa4 None None] Pushing event deleted for resources: {'Port': ['ID=6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:45.005521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3aba44ed-37ff-41ae-ac2b-1adf56d08507') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:45.005521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3aba44ed-37ff-41ae-ac2b-1adf56d08507') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:45.018240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.078960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.087706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 163 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:45.088095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:45.091525 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:45.121845 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port ae19df28-b4dc-4543-a27d-e26e7c450f42 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:45.122241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.157414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.167458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.170470 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/5aab3620-e915-4544-8009-60e1d136b182 HTTP/1.1" status: 204 len: 168 time: 1.1872303 Nov 24 04:14:45.175611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35144) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:45.213562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6778534-dd19-493d-91a3-c102e2b14878 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=5aab3620-e915-4544-8009-60e1d136b182,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:45.217049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port ae19df28-b4dc-4543-a27d-e26e7c450f42, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ae19df28-b4dc-4543-a27d-e26e7c450f42,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:45.217412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.230859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for ae19df28-b4dc-4543-a27d-e26e7c450f42 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:45.266432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-888ee664-0389-45e4-91e2-f13d3044062d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:45.268143 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-888ee664-0389-45e4-91e2-f13d3044062d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/6069ea67-8627-41f6-b533-5ca8850bfd72 HTTP/1.1" status: 200 len: 840 time: 0.0826693 Nov 24 04:14:45.274779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35146) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:45.314664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port e8f94244-5f65-4016-b751-49674a4b3dd7 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:45.315005 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.326910 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-05403518-f871-4464-a982-d792e4c0d0d8 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/6069ea67-8627-41f6-b533-5ca8850bfd72?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0510523 Nov 24 04:14:45.330474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35148) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:45.337938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:45.459602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.469293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.488577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=ae19df28-b4dc-4543-a27d-e26e7c450f42,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:45.489524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for e8f94244-5f65-4016-b751-49674a4b3dd7 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:45.504610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:45.508232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.663353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.816813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.855529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=e8f94244-5f65-4016-b751-49674a4b3dd7,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:45.859730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:45.893209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 0fe6e120-10fd-4f02-8be4-2afcf5422729 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:45.924531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:45.988502 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:45.997657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:45.998137 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.001296 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fe007f4-d161-4a69-8d4f-27c33db84400 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:46.017745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:46.020895 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=573bddfc-8add-4e72-a7d4-49eea78ae54f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:46.026740 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-029b151b-554d-47d8-a426-6b7cef750749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/0fe6e120-10fd-4f02-8be4-2afcf5422729/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6559472 Nov 24 04:14:46.028877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35150) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:46.029748 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1f8aeab3-1dd8-4796-b4da-6a2fc37bc2b2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6947184 Nov 24 04:14:46.032319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35152) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:46.037729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'security_group': {'name': 'tempest-secgroup-2029724202'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:46.037978 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] Sync routers for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:46.060746 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:46.061742 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:46.073526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.084073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.102962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting subnet c4348623-9729-4d15-a5cf-803eac33880a {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:46.109533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.229273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.241441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.251845 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.284939 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.286701 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:46.287429 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2561822 Nov 24 04:14:46.293510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35154) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:46.303745 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'security_group': {'name': 'tempest-secgroup-513090743'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:46.342879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-a288e794-7129-48ec-b278-2ea8bf1fe00e', 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'tenant_id': 'b1bda997a7f64c3885e8ed4cd7b28f2f', 'fixed_ips': [{'subnet_id': '573bddfc-8add-4e72-a7d4-49eea78ae54f'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:46.344769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.352517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f715a405-59d2-4615-a0b5-e18390b99e34 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c544a170-0ba2-4afb-87a4-3931344a451e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:46.380373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:46.426802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:46.427976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6bf1a6b1-2bcb-4bf3-b5d2-710d8299fbc8 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:46.613219 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:45Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:46.615537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Allocated IP 172.20.0.2 (a288e794-7129-48ec-b278-2ea8bf1fe00e/573bddfc-8add-4e72-a7d4-49eea78ae54f/1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:46.658526 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] Checking router: 0fe6e120-10fd-4f02-8be4-2afcf5422729 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:14:46.675795 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] Routers {'0fe6e120-10fd-4f02-8be4-2afcf5422729'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:46.676739 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['0fe6e120-10fd-4f02-8be4-2afcf5422729'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:46.770913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.771402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.778604 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.778985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.788344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] Set router 0fe6e120-10fd-4f02-8be4-2afcf5422729 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:46.822076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:46.825127 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:46.827766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:46.829812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Pushing event updated for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:46.832153 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:46.889268 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Attempting to bind port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:46.889612 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Attempting to bind port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '7bf5b14e-f40d-4760-a2d5-49f2d2712f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:46.890199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Attempting to bind port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b on network a288e794-7129-48ec-b278-2ea8bf1fe00e {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:46.895830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:46.896455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Checking segment: {'id': '7bf5b14e-f40d-4760-a2d5-49f2d2712f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:46.897149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.897786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Bound using segment: {'id': '7bf5b14e-f40d-4760-a2d5-49f2d2712f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:46.898301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Bound port: 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7bf5b14e-f40d-4760-a2d5-49f2d2712f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:46.898714 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.949300 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:46.980043 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:46.983688 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,segment=NetworkSegment(7bf5b14e-f40d-4760-a2d5-49f2d2712f10),segment_id=7bf5b14e-f40d-4760-a2d5-49f2d2712f10)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:46.989298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.005657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Subnet': ['ID=c4348623-9729-4d15-a5cf-803eac33880a,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:47.008265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.013926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35156) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:47.014733 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1fa47bd4-60af-4aee-8674-a9a774d5720c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/subnets/c4348623-9729-4d15-a5cf-803eac33880a HTTP/1.1" status: 204 len: 168 time: 0.9785578 Nov 24 04:14:47.026532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22d5489d-6c12-4b9c-a64f-6bf0dde11e46 None None] Network becef48c-b834-483b-91dc-0f71ec58e834 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:47.030533 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.035132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:47.040166 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b664dccc-d3d6-42c6-a404-2d6e29da73a3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8624601 Nov 24 04:14:47.043214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35158) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:47.052827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.062339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] Sync routers for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:47.136396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:47.137221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:47.142974 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7adbf79a-71f8-48f2-be72-ea53849d2033 None None] Pushing event updated for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:47.150624 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:45Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:47.195830 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd55120d-6104-43f2-b8f5-c3229100b653 None None] The sync data for ids ['0fe6e120-10fd-4f02-8be4-2afcf5422729'] in dv-neutron-819049-1-hyperv is: [{'id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'name': 'tempest-TestNetworkBasicOps-router-655074813', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70'}], 'enable_snat': True}, 'gw_port_id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:12:13Z', 'updated_at': '2021-11-24T04:14:45Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c28b89a3-39b5-4dd6-a2c6-fa8640fa8153', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:1b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fe6e120-10fd-4f02-8be4-2afcf5422729', 'device_owner': 'network:router_gateway', 'standard_attr_id': 803, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:12:15Z', 'updated_at': '2021-11-24T04:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:47.222362 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:47.252293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:47.256345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a74e0fa1-0997-41a5-ae77-49fcfd9c8e04,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:47.259365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:47.296450 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.297154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:47.298303 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-30702c2b-fea2-4844-b5e1-44f44793c507 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.0029967 Nov 24 04:14:47.301098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d07ab6e-5ac8-4ff5-87ef-99b4300e9d88 None None] The sync data for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:47.339977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35160) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:47.354528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1938932868', 'security_groups': ['a74e0fa1-0997-41a5-ae77-49fcfd9c8e04'], 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '573bddfc-8add-4e72-a7d4-49eea78ae54f'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:47.512698 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-51cec06f-62c8-420b-aa5b-55df3bc863d2 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1736712 Nov 24 04:14:47.557742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.602314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] DHCP port deletion for becef48c-b834-483b-91dc-0f71ec58e834 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:47.694354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:47.701263 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-caf1f600-14aa-41ce-8f5d-a60560cd5fd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:47.705198 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-caf1f600-14aa-41ce-8f5d-a60560cd5fd7 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1099 time: 0.1625021 Nov 24 04:14:47.722676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] Deleting port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:47.723494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.752742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.797320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] For port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,segment=NetworkSegment(30f1aa6c-2278-4dd6-a015-c8daf36f40bb),segment_id=30f1aa6c-2278-4dd6-a015-c8daf36f40bb)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:47.797764 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.813233 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] Calling delete_port for b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:47.837280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:47.837904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.846763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.939809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.951701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 23281caf-63ef-47a2-b553-e65383d1a288 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:47.955011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port c28b89a3-39b5-4dd6-a2c6-fa8640fa8153, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:47.955379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:47.969106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:47.970177 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] No DVR routers for this DVR port b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:47.974759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a76c451-5ea3-46e2-9655-c397f7eacc73 None None] Pushing event deleted for resources: {'Port': ['ID=b3f44c75-b9b3-42e0-bca5-150a8e0c1df8,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:48.116591 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-169c75f1-4f70-4eff-9c0a-d157c2d25d28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:48.118082 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-169c75f1-4f70-4eff-9c0a-d157c2d25d28 service neutron] 10.222.0.21 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 898 time: 0.3847911 Nov 24 04:14:48.145337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.176882 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=c28b89a3-39b5-4dd6-a2c6-fa8640fa8153,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:48.204172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2379269e-ccb3-4edb-b593-4ddb4b32c799 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:48.255275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.262312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.277740 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:48.334927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:48.335291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.362728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.365116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.423200 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-245c6f46-c3b7-4a21-b369-a68025f4094d service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 1001 time: 0.2754638 Nov 24 04:14:48.427150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.431255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.432070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Fanout notify agent at l3_agent the message router_deleted on router 0fe6e120-10fd-4f02-8be4-2afcf5422729 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:14:48.440993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.442435 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7eac357d-efd2-403e-a12f-47beb1c0dcc2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/routers/0fe6e120-10fd-4f02-8be4-2afcf5422729 HTTP/1.1" status: 204 len: 168 time: 1.4272463 Nov 24 04:14:48.445307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35162) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:48.513092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,segment=NetworkSegment(7bf5b14e-f40d-4760-a2d5-49f2d2712f10),segment_id=7bf5b14e-f40d-4760-a2d5-49f2d2712f10)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:48.522614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.541729 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.14 (a288e794-7129-48ec-b278-2ea8bf1fe00e/573bddfc-8add-4e72-a7d4-49eea78ae54f/23281caf-63ef-47a2-b553-e65383d1a288) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:48.614022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.627525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-0fe6d2d0-97ea-4fd6-a929-8b4db78f567d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:48.629193 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-0fe6d2d0-97ea-4fd6-a929-8b4db78f567d service neutron] 10.222.0.21 "GET /v2.0/subnets?id=33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 200 len: 834 time: 0.1966894 Nov 24 04:14:48.629452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:48.639014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ae19df28-b4dc-4543-a27d-e26e7c450f42 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:48.668664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ae19df28-b4dc-4543-a27d-e26e7c450f42 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:48.671291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ae19df28-b4dc-4543-a27d-e26e7c450f42 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:48.671291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:48.709000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:48.709232 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b3f44c75-b9b3-42e0-bca5-150a8e0c1df8 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:48.780147 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.810176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['becef48c-b834-483b-91dc-0f71ec58e834']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:48.821351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '30f1aa6c-2278-4dd6-a015-c8daf36f40bb') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:48.821567 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '30f1aa6c-2278-4dd6-a015-c8daf36f40bb') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:48.825489 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-39997c0f-c0e9-42b6-b201-78974ec57fd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:48.827054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-39997c0f-c0e9-42b6-b201-78974ec57fd5 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=5056a387-4f26-43bd-ad60-c8135c9a7757&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1765063 Nov 24 04:14:48.832362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.846781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.853105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Releasing vlan 156 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:48.853497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:48.856839 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:48.935725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.945841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f8493719-9549-4adf-83f4-28cc925dca4c None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:48.946549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8493719-9549-4adf-83f4-28cc925dca4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.975520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:48.979492 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/networks/becef48c-b834-483b-91dc-0f71ec58e834 HTTP/1.1" status: 204 len: 168 time: 0.5329266 Nov 24 04:14:48.990426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a23cb1-12ea-4419-9ce7-74b4771ee5ed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Network': ['ID=becef48c-b834-483b-91dc-0f71ec58e834,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:49.001809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35164) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:49.011011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--1237221374', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:49.045273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.057583 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:49.060711 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-cc610166-3e55-4d9c-b065-4decff0bf497 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1990793 Nov 24 04:14:49.062211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.082672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f8493719-9549-4adf-83f4-28cc925dca4c None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:49.082984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f8493719-9549-4adf-83f4-28cc925dca4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.098358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 152, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:49.109003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.109696 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment 9aa54d37-a4e0-411f-959a-ce8a29b58669 of type vlan for network 38418e10-00b7-4e21-8d7a-91bfeb87756f Nov 24 04:14:49.126258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f8493719-9549-4adf-83f4-28cc925dca4c None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:49.158688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.166916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 8e82fa9a-5706-46cc-88a0-e936c647ed5c {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:49.167476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.183730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.190061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:49.190688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.213832 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-db3c4977-0115-4982-9a95-ebc44d44a2c5 req-b709d573-a29c-4790-bbe6-61c64d7f83d8 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1415625 Nov 24 04:14:49.227895 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2210116 Nov 24 04:14:49.228105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35166) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:49.232539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-504363531', 'admin_state_up': True, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:49.243882 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.277146 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7232d690-46c8-4142-97b1-06e8cc03c84b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=38418e10-00b7-4e21-8d7a-91bfeb87756f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:49.289689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:49.293449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.295188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.315060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:49.325696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:49.328750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:49.338225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.340646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=23281caf-63ef-47a2-b553-e65383d1a288,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:49.362121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.523130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.569789 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a20e4e6b-81ca-45cf-bb0f-5a8c6ac0c5ee None None] Provisioning complete for port 23281caf-63ef-47a2-b553-e65383d1a288 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:49.570067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a20e4e6b-81ca-45cf-bb0f-5a8c6ac0c5ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.610771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a20e4e6b-81ca-45cf-bb0f-5a8c6ac0c5ee None None] Port 23281caf-63ef-47a2-b553-e65383d1a288 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:49.726864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 8e82fa9a-5706-46cc-88a0-e936c647ed5c owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:49.743182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.755294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:49.755906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.762578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.803832 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8c8e51bf-e562-4301-bc14-6abe2f9a0f3d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 2.4627316 Nov 24 04:14:49.806513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35168) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:49.813956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:49.930750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:49.954556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.71 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/1fe8009f-8694-49b5-a31d-087301231349) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:49.958128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=8e82fa9a-5706-46cc-88a0-e936c647ed5c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:50.013390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:50.017020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.058432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.166180 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.ipam_backend_mixin [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 573bddfc-8add-4e72-a7d4-49eea78ae54f (CIDR: 172.20.0.0/28) Nov 24 04:14:50.170855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.174429 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:50.174986 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:50.199849 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6438740f-0636-437c-94b4-8da4050425d1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3897598 Nov 24 04:14:50.201276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35170) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:50.206200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:50.221503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:50.246872 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:50.285090 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.298034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:50.303557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:50.303989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.306297 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a34a9151-211c-411c-9dfe-e842ab25d176 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2615950 Nov 24 04:14:50.306934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35172) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:50.310929 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] Sync routers for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:50.330293 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:50.331250 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:50.331942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=1fe8009f-8694-49b5-a31d-087301231349,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:50.340906 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bde12c54-0192-4faa-bc94-383b4c4c7aee tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 HTTP/1.1" status: 200 len: 205 time: 0.0326989 Nov 24 04:14:50.341554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35174) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:50.354180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:50.359004 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:50.361689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:50.381580 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6914189-81da-4820-a0df-f38bc043c46f None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:50.417899 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.440035 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:50.456061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-561eeeca-eef0-4a03-9a8b-1fed8e8e348e None None] Provisioning complete for port 1fe8009f-8694-49b5-a31d-087301231349 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:50.456729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-561eeeca-eef0-4a03-9a8b-1fed8e8e348e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.474367 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] Routers {'1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:50.475361 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:50.501276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-561eeeca-eef0-4a03-9a8b-1fed8e8e348e None None] Port 1fe8009f-8694-49b5-a31d-087301231349 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:50.505942 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:50.514782 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:50.516081 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-736410e4-4d17-4ca0-a4b5-f2a76809d62f None None] The sync data for ids ['1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:50.524431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:50.527982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.533196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:50.533553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c28b89a3-39b5-4dd6-a2c6-fa8640fa8153 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:50.608223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.610819 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.657671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.658816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router 1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:14:50.666081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.667230 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-62b679fe-0206-45b9-8068-661a09a1a3b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 HTTP/1.1" status: 204 len: 168 time: 0.3246090 Nov 24 04:14:50.669932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35176) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:50.721291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 2e9268d5-7892-4616-9ccf-7721d2a741d2 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:50.724445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.741597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.766708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.854110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.913119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.948932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=2e9268d5-7892-4616-9ccf-7721d2a741d2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:50.954896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:50.958295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21d7abfc-cd4d-4705-8f1a-df55ce4175d5 None None] Network 98a4f053-9ca9-4678-80b4-a528e80ad18f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:50.966547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35178) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:50.970070 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-41cd18e8-4e16-4700-9dd9-0e1b116f81b2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/2e9268d5-7892-4616-9ccf-7721d2a741d2 HTTP/1.1" status: 204 len: 168 time: 0.2940907 Nov 24 04:14:51.003259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.125787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] DHCP port deletion for 98a4f053-9ca9-4678-80b4-a528e80ad18f request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:51.178231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] Deleting port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:51.178609 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.242837 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] For port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,segment=NetworkSegment(67ae6a41-e0c2-4714-9321-5da2760b1a7c),segment_id=67ae6a41-e0c2-4714-9321-5da2760b1a7c)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:51.243239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.256775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] Calling delete_port for be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:51.346337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.372598 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] Pushing event deleted for resources: {'Port': ['ID=be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:51.378244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2557b497-826f-49b5-99de-9573f7c5056c None None] No DVR routers for this DVR port be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:51.438216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:51.448542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:51.456811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 4051a88a-38c2-4c5e-b906-042c17c43cba {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:51.457129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38446ce0-5da6-45be-a840-2b737a7ec880 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:51.462438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:51.463031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.470012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.502055 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=c578f31c-1176-4132-a135-5adc056db9e2,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:51.511980 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.522918 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7658904b-ff0f-490f-a710-1df0b63edee2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.3206460 Nov 24 04:14:51.526058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35180) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:51.532316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.533757 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-58745933', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'c578f31c-1176-4132-a135-5adc056db9e2'}], 'security_groups': ['c544a170-0ba2-4afb-87a4-3931344a451e']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:51.604977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.673646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] Update dhcp port {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'fixed_ips': [{'subnet_id': '573bddfc-8add-4e72-a7d4-49eea78ae54f', 'ip_address': '172.20.0.2'}, {'subnet_id': 'c578f31c-1176-4132-a135-5adc056db9e2'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:14:51.700579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.703331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.764089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 3fa77305-8276-4287-a9eb-5efe6a409e17 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:14:51.782187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.852130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=4051a88a-38c2-4c5e-b906-042c17c43cba,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:51.854191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.860651 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-97cb579b-352e-46d1-8342-17bcf1a9edc4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/4051a88a-38c2-4c5e-b906-042c17c43cba HTTP/1.1" status: 204 len: 168 time: 0.8898821 Nov 24 04:14:51.860836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d860d257-a088-403e-8df4-2cbfe72621e5 None None] Network 37608dc5-580c-4764-b65f-43bd682282cb requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:51.860966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35182) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:51.915416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Delete allocated IP 172.20.0.14 (a288e794-7129-48ec-b278-2ea8bf1fe00e/573bddfc-8add-4e72-a7d4-49eea78ae54f) {{(pid=103380) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 04:14:51.930883 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.20 (a288e794-7129-48ec-b278-2ea8bf1fe00e/c578f31c-1176-4132-a135-5adc056db9e2/23281caf-63ef-47a2-b553-e65383d1a288) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:51.982013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:51.984997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:52.004029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Sync routers for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:52.015953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:52.017131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:52.033815 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.035093 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c13180db-4f35-4ec4-8eef-6f4eb2e3eaa7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 2.8060923 Nov 24 04:14:52.045543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35184) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.088890 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-79c8ebc4-4cc4-448f-8a96-2001ff035700 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0399103 Nov 24 04:14:52.089547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35186) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.104520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.110530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.111414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] DHCP port deletion for 37608dc5-580c-4764-b65f-43bd682282cb request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:52.131646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.172187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['98a4f053-9ca9-4678-80b4-a528e80ad18f']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:52.183512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=23281caf-63ef-47a2-b553-e65383d1a288,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:52.203556 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:52.217203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '67ae6a41-e0c2-4714-9321-5da2760b1a7c') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:52.217512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '67ae6a41-e0c2-4714-9321-5da2760b1a7c') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:52.230443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] In _notify_port_updated(), no bound segment for port 23281caf-63ef-47a2-b553-e65383d1a288 on network a288e794-7129-48ec-b278-2ea8bf1fe00e {{(pid=103380) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:14:52.234412 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.238087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:52.239062 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.240553 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-45c1c6c6-9bd3-463f-89ba-1b11137e3c7e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/ports/23281caf-63ef-47a2-b553-e65383d1a288 HTTP/1.1" status: 200 len: 919 time: 0.7130637 Nov 24 04:14:52.243505 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35188) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.262372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.266186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc23c0a9-13e3-4c4f-9c43-dddddc90d2a7 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:52.270317 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dc23c0a9-13e3-4c4f-9c43-dddddc90d2a7 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1770127 Nov 24 04:14:52.271223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35190) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.282023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 183 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:52.282453 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:52.285654 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:52.323569 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-05227b9a-71e5-47ec-a75f-e1a3b4567567 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0510583 Nov 24 04:14:52.331334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35192) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.338208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1010219712', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:52.363158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 23281caf-63ef-47a2-b553-e65383d1a288 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:52.363546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.422080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:52.429696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] Allocated IP 172.20.0.18 (a288e794-7129-48ec-b278-2ea8bf1fe00e/c578f31c-1176-4132-a135-5adc056db9e2/1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:52.431696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.444637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.448348 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/98a4f053-9ca9-4678-80b4-a528e80ad18f HTTP/1.1" status: 204 len: 168 time: 0.5869954 Nov 24 04:14:52.453933 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35194) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.464272 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.471784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:14:52.472136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be6b1f6d-ff83-48e4-bb47-fa94d8e54f6f not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:14:52.472563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 49c3d42b-430a-476c-b34a-1a0c129ee42d no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:14:52.478528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 23281caf-63ef-47a2-b553-e65383d1a288 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:52.484888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b99ca0-5f02-4149-bc2d-192a2b019ea0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=98a4f053-9ca9-4678-80b4-a528e80ad18f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:52.544059 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:52.548407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.589963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.625552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] Deleting port 49c3d42b-430a-476c-b34a-1a0c129ee42d {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:52.625843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.627417 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.697697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=23281caf-63ef-47a2-b553-e65383d1a288,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:52.738180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 49c3d42b-430a-476c-b34a-1a0c129ee42d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:14:52.738524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.747304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.752000 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6565b3ee-5ffe-44b9-b89c-2e5991339901 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/23281caf-63ef-47a2-b553-e65383d1a288 HTTP/1.1" status: 204 len: 168 time: 0.5072713 Nov 24 04:14:52.754504 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35196) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.775113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,segment=NetworkSegment(7bf5b14e-f40d-4760-a2d5-49f2d2712f10),segment_id=7bf5b14e-f40d-4760-a2d5-49f2d2712f10)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:52.779864 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d47980b-8cb6-4d66-b667-81e129ca4a32 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:14:52.784275 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1d47980b-8cb6-4d66-b667-81e129ca4a32 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/23281caf-63ef-47a2-b553-e65383d1a288 HTTP/1.1" status: 404 len: 333 time: 0.0260615 Nov 24 04:14:52.784884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35198) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.791448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] For port 49c3d42b-430a-476c-b34a-1a0c129ee42d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=49c3d42b-430a-476c-b34a-1a0c129ee42d,segment=NetworkSegment(ab321b5b-ea71-4a61-b631-eef44465d8d1),segment_id=ab321b5b-ea71-4a61-b631-eef44465d8d1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:52.791448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.824739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] Calling delete_port for 49c3d42b-430a-476c-b34a-1a0c129ee42d owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:52.842286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.843027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a3f8d8d-a34f-472c-b68f-786c01eabf51 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.843714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 49c3d42b-430a-476c-b34a-1a0c129ee42d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=49c3d42b-430a-476c-b34a-1a0c129ee42d,segment=NetworkSegment(ab321b5b-ea71-4a61-b631-eef44465d8d1),segment_id=ab321b5b-ea71-4a61-b631-eef44465d8d1)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:52.844212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.851498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.852174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.867580 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 49c3d42b-430a-476c-b34a-1a0c129ee42d owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:14:52.873520 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a3f8d8d-a34f-472c-b68f-786c01eabf51 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.891783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.936808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a3f8d8d-a34f-472c-b68f-786c01eabf51 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.939861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a3f8d8d-a34f-472c-b68f-786c01eabf51 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:52.943591 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a3f8d8d-a34f-472c-b68f-786c01eabf51 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/security-groups/a74e0fa1-0997-41a5-ae77-49fcfd9c8e04 HTTP/1.1" status: 204 len: 168 time: 0.1555555 Nov 24 04:14:52.944656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35200) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:52.966894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 49c3d42b-430a-476c-b34a-1a0c129ee42d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=49c3d42b-430a-476c-b34a-1a0c129ee42d,segment=NetworkSegment(ab321b5b-ea71-4a61-b631-eef44465d8d1),segment_id=ab321b5b-ea71-4a61-b631-eef44465d8d1)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:52.971989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=f2125981-3937-4d3b-9f58-7dca17c52922,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:52.980055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3f8d8d-a34f-472c-b68f-786c01eabf51 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a74e0fa1-0997-41a5-ae77-49fcfd9c8e04,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:52.992395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:52.992952 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: 38418e10-00b7-4e21-8d7a-91bfeb87756f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:53.009484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.027569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:53.039076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.042750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f66a59dd-6661-4b3d-a935-bae893f92a0d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.043699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:50Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:53.066203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 38418e10-00b7-4e21-8d7a-91bfeb87756f) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:53.068212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=49c3d42b-430a-476c-b34a-1a0c129ee42d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.072868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:53.073465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.077204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port 49c3d42b-430a-476c-b34a-1a0c129ee42d on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:53.085041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f66a59dd-6661-4b3d-a935-bae893f92a0d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.112980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80b57aea-2416-4f4a-a837-839835d3c2ca None None] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:53.117619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Checking router: 3fa77305-8276-4287-a9eb-5efe6a409e17 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:14:53.117972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Updating router 3fa77305-8276-4287-a9eb-5efe6a409e17 port 1fe8009f-8694-49b5-a31d-087301231349 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:14:53.130774 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-816ea82a-65e5-4669-8cac-e3177fb4f5aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7986484 Nov 24 04:14:53.131845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb58367a-e502-4494-b3cd-0375ed7e5131 None None] Pushing event updated for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.135223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35202) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:53.187526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.196448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event deleted for resources: {'Port': ['ID=49c3d42b-430a-476c-b34a-1a0c129ee42d,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.221052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['37608dc5-580c-4764-b65f-43bd682282cb']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:53.229941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.237931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ab321b5b-ea71-4a61-b631-eef44465d8d1') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:53.238544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ab321b5b-ea71-4a61-b631-eef44465d8d1') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:53.252891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.263889 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.267319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f66a59dd-6661-4b3d-a935-bae893f92a0d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.270362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f66a59dd-6661-4b3d-a935-bae893f92a0d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.273908 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f66a59dd-6661-4b3d-a935-bae893f92a0d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/security-groups/c544a170-0ba2-4afb-87a4-3931344a451e HTTP/1.1" status: 204 len: 168 time: 0.3258603 Nov 24 04:14:53.278870 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.286419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 174 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:14:53.286835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:14:53.303021 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:14:53.307123 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35204) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:53.317355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] No DVR routers for this DVR port 49c3d42b-430a-476c-b34a-1a0c129ee42d on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:14:53.373587 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4159ac9-4457-4b58-a6eb-75c5ab94969a None None] Pushing event deleted for resources: {'Port': ['ID=49c3d42b-430a-476c-b34a-1a0c129ee42d,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.385728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.402761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66a59dd-6661-4b3d-a935-bae893f92a0d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c544a170-0ba2-4afb-87a4-3931344a451e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.417950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.429165 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/37608dc5-580c-4764-b65f-43bd682282cb HTTP/1.1" status: 204 len: 168 time: 0.9720213 Nov 24 04:14:53.434796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35206) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:53.450936 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-128230029'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:53.471794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c703300f-c5c3-4c03-8926-640de067d907 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=37608dc5-580c-4764-b65f-43bd682282cb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.497291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 573bddfc-8add-4e72-a7d4-49eea78ae54f {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:14:53.503642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.534097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-38418e10-00b7-4e21-8d7a-91bfeb87756f', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:53.534856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.538366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:53.542213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.574798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 175, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:14:53.585550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.586292 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 09ebaf21-03b0-4887-8935-21c4b4f062e7 of type vlan for network 09de9cec-5020-427f-be8c-dcc86b3d71f4 Nov 24 04:14:53.635779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.674075 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.680617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:53.681411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.713222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.716604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.744248 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.3039908 Nov 24 04:14:53.745191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35208) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:53.755139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Allocated IP 172.20.0.2 (38418e10-00b7-4e21-8d7a-91bfeb87756f/f2125981-3937-4d3b-9f58-7dca17c52922/4ef31e67-d644-4395-835a-e1c0164a7504) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:53.769812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.773422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:53.783917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.884089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1128b4d-fa5d-4ada-8bf5-188ef25cf537 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:53.913385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68d0eb23-4879-428d-9f9b-e96833a59ac0 None None] Pushing event updated for resources: {'Port': ['ID=1fe8009f-8694-49b5-a31d-087301231349,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.917935 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Attempting to bind port 1fe8009f-8694-49b5-a31d-087301231349 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:53.918219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Attempting to bind port 1fe8009f-8694-49b5-a31d-087301231349 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:53.918593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Attempting to bind port 1fe8009f-8694-49b5-a31d-087301231349 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:53.925840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf3642be-4ee5-4e4d-9278-6858190438fe tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=09de9cec-5020-427f-be8c-dcc86b3d71f4,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:53.929678 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:53.930047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:53.930480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.930876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:53.931353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Bound port: 1fe8009f-8694-49b5-a31d-087301231349, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:53.931744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:53.977207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:14:53.991368 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:53.995409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.013203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.067631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Provisioning complete for port 1fe8009f-8694-49b5-a31d-087301231349 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:54.068006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.107834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] For port 1fe8009f-8694-49b5-a31d-087301231349, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:54.127697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.136676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.149751 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.154128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] For port 1fe8009f-8694-49b5-a31d-087301231349, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1fe8009f-8694-49b5-a31d-087301231349,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:54.170142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.173836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=573bddfc-8add-4e72-a7d4-49eea78ae54f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:54.183919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.187971 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-161dc1fe-f855-48cd-9231-20b058564da2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/573bddfc-8add-4e72-a7d4-49eea78ae54f HTTP/1.1" status: 204 len: 168 time: 0.8787978 Nov 24 04:14:54.198887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35210) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:54.210365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:54.216062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Port 1fe8009f-8694-49b5-a31d-087301231349 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:54.222435 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:54.230628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:54.237619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Could not find standard attr ID for object 23281caf-63ef-47a2-b553-e65383d1a288. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:54.240586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:54.243771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be4c1510-dbff-41d3-b6e8-51f801b26f25 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:14:54.249478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Pushing event updated for resources: {'Port': ['ID=4ef31e67-d644-4395-835a-e1c0164a7504,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:54.302446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.394457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=77aafc96-4615-4a35-b02c-4068c68d9ab0,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:54.405405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '09ebaf21-03b0-4887-8935-21c4b4f062e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:54.406923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 09de9cec-5020-427f-be8c-dcc86b3d71f4, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:14:54.431893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:14:54.442488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 09de9cec-5020-427f-be8c-dcc86b3d71f4) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:54.448184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:54.449679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.475083 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fa1fb6df-e9f0-4a65-964e-6148d469dea9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7060211 Nov 24 04:14:54.477996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35212) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:54.483190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-672358337', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:54.516625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:54.518503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.518739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b19dd129-7f87-4e55-b742-c808322bb02d None None] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:54.520238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.521690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:54.522876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:54.529142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b6be550-bd22-4913-b774-d024c0793743 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:54.551449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.1 (38418e10-00b7-4e21-8d7a-91bfeb87756f/f2125981-3937-4d3b-9f58-7dca17c52922/e009693e-ddac-4259-989a-571f846daec3) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:54.576632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.581222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.606380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.608600 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5f1a0a03-9035-4fe8-898c-585abacfbcfb tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.1293926 Nov 24 04:14:54.612422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35214) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:54.618710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'port': {'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4', 'name': 'tempest-RoutersIpV6Test-1989608129'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:54.626615 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:54.627195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.711037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.742049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:54.745909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.763974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] device_id is not set on port 7158712e-dfb2-4143-84b4-8752b11c84aa yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:54.773720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:54.777741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.805881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.816120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68d0eb23-4879-428d-9f9b-e96833a59ac0 None None] Pushing event updated for resources: {'Port': ['ID=1fe8009f-8694-49b5-a31d-087301231349,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:54.825289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Attempting to bind port 4ef31e67-d644-4395-835a-e1c0164a7504 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:54.825668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Attempting to bind port 4ef31e67-d644-4395-835a-e1c0164a7504 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:54.826044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Attempting to bind port 4ef31e67-d644-4395-835a-e1c0164a7504 on network 38418e10-00b7-4e21-8d7a-91bfeb87756f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:54.888311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:54.888686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Checking segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:54.889094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.889485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Bound using segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:54.889965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Bound port: 4ef31e67-d644-4395-835a-e1c0164a7504, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:54.890901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:54.897175 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:54.900221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8::63 (09de9cec-5020-427f-be8c-dcc86b3d71f4/77aafc96-4615-4a35-b02c-4068c68d9ab0/7158712e-dfb2-4143-84b4-8752b11c84aa) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:54.905684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:54.910830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:54.922503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:54.946067 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=e009693e-ddac-4259-989a-571f846daec3,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:54.977059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.028463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:55.028715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.079513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.133105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.180234 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:55.185776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:55.190187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:55.196011 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:55.196729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.210817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=7158712e-dfb2-4143-84b4-8752b11c84aa,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:55.222952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.228553 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1956fa72-8a1e-4dd4-8bba-da65dcce9d53 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 0.6114857 Nov 24 04:14:55.230304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35216) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:55.268730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] For port 4ef31e67-d644-4395-835a-e1c0164a7504, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:55.275381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.296370 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] For port 4ef31e67-d644-4395-835a-e1c0164a7504, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4ef31e67-d644-4395-835a-e1c0164a7504,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:55.307456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:55.308197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.331110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.366452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:55.372919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:55.376417 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:55.377598 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.398286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=105cd393-2689-49d8-a019-641096494aee,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:55.443980 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-09de9cec-5020-427f-be8c-dcc86b3d71f4', 'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '77aafc96-4615-4a35-b02c-4068c68d9ab0'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:14:55.444146 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-836ff17b-2a4d-47c8-a5e8-284c86b200ac tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2416487 Nov 24 04:14:55.444270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.444361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35218) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:55.456448 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'security_group': {'name': 'tempest-secgroup-1377946763'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:55.490257 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-04e38fea-2df9-4162-bcc6-dcd7f4ec854c None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:55.518555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740aaf29-1736-4acc-88ff-cc91456f9c4a None None] Pushing event updated for resources: {'Port': ['ID=4ef31e67-d644-4395-835a-e1c0164a7504,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:55.520872 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.644506 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.668731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] Provisioning complete for port 1fe8009f-8694-49b5-a31d-087301231349 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:55.669704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.726192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.738752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.741635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.763304 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.809449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:50Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:55.842864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.844329 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3991666 Nov 24 04:14:55.849001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35220) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:55.853389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444bea38-30f6-4e70-8d77-66cc866d0515 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e3333998-e2ed-4ba6-a461-2560afe6ea00,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:55.864830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'security_group': {'name': 'tempest-secgroup-273966145'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:55.888492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16fbaa31-22f3-49c0-ba74-f068403abd08 None None] The sync data for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv is: [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:50Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:55.898963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Allocated IP 2001:db8::2 (09de9cec-5020-427f-be8c-dcc86b3d71f4/77aafc96-4615-4a35-b02c-4068c68d9ab0/8c5fe508-3b5f-43be-b867-343cf5fb5648) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:55.939464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:55.954355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=e009693e-ddac-4259-989a-571f846daec3,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:55.961210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.050029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.080195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.085634 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.114758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] For port 1fe8009f-8694-49b5-a31d-087301231349, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1fe8009f-8694-49b5-a31d-087301231349,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:56.124344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.129977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.139896 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] Could not find standard attr ID for object 23281caf-63ef-47a2-b553-e65383d1a288. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:14:56.140894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.262379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=7158712e-dfb2-4143-84b4-8752b11c84aa,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:56.281395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=27c2640e-6fd7-4902-9de6-71e9eff394eb,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:56.293051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.294994 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7269acf4-ccc2-4890-b319-bc5dbe790e33 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4424362 Nov 24 04:14:56.300160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35222) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:56.323364 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'security_group': {'name': 'tempest-secgroup-1302826734'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:56.374185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.453934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.466468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.475419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.489952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:56.496284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:56.623951 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4ef31e67-d644-4395-835a-e1c0164a7504 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:56.627576 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b8777b0-269b-410d-a89e-fb304ed7aad1 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:56.630772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.650064 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fc7c031-dafd-4794-848c-8ba80bc725de None None] Pushing event updated for resources: {'Port': ['ID=1fe8009f-8694-49b5-a31d-087301231349,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:56.659936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 3fa77305-8276-4287-a9eb-5efe6a409e17 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:14:56.666850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.670648 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3641789 Nov 24 04:14:56.672374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35224) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:56.677790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-786973825', 'security_groups': ['eb3502b5-4250-4f89-add5-4417f427d30d'], 'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '105cd393-2689-49d8-a019-641096494aee'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:56.681110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c088fb75-2447-4f99-9ccd-a1f792049ff9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eb3502b5-4250-4f89-add5-4417f427d30d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:56.725378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.782832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.788927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ce6cfed1-6d2d-4d30-8181-21d0c202f76b None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:56.789388 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ce6cfed1-6d2d-4d30-8181-21d0c202f76b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:56.854348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:56.860759 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-82042cd9-38cb-4a66-97a0-1fa77fa24484 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/3fa77305-8276-4287-a9eb-5efe6a409e17/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7243364 Nov 24 04:14:56.863595 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35226) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:56.909916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:56.920858 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:56.933343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:56.964035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Pushing event updated for resources: {'Port': ['ID=8c5fe508-3b5f-43be-b867-343cf5fb5648,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:56.981744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 4ef31e67-d644-4395-835a-e1c0164a7504 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:56.982119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.112604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.127664 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.128987 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.157689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12485261-d247-4c2b-ace3-dc7fdd1a04dc None None] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:57.158065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.158582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.159138 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.159977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.160210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.161023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.161240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.166824 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cb0cef0f-e39b-449c-bc8d-7f579f58bf1c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4992 time: 0.2987626 Nov 24 04:14:57.166824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:57.167097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35228) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:57.256686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.256965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.257180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.257641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.258086 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.258551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.258994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.259431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.259867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:57.264331 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c60eae11-fe66-440c-b2fa-f2112c199ad3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5149 time: 0.0944989 Nov 24 04:14:57.264498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Attempting to bind port 8c5fe508-3b5f-43be-b867-343cf5fb5648 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:14:57.264677 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Attempting to bind port 8c5fe508-3b5f-43be-b867-343cf5fb5648 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '09ebaf21-03b0-4887-8935-21c4b4f062e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:14:57.267607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Attempting to bind port 8c5fe508-3b5f-43be-b867-343cf5fb5648 on network 09de9cec-5020-427f-be8c-dcc86b3d71f4 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:14:57.267749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35230) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:57.274906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] device_id is not set on port 4370d129-c200-41a1-a8aa-819959b1f630 yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:14:57.314606 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:14:57.315023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Checking segment: {'id': '09ebaf21-03b0-4887-8935-21c4b4f062e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:14:57.315416 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.315851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Bound using segment: {'id': '09ebaf21-03b0-4887-8935-21c4b4f062e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:14:57.316337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Bound port: 8c5fe508-3b5f-43be-b867-343cf5fb5648, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09ebaf21-03b0-4887-8935-21c4b4f062e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 175, 'network_id': '09de9cec-5020-427f-be8c-dcc86b3d71f4'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:14:57.316724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.459742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.8 (a288e794-7129-48ec-b278-2ea8bf1fe00e/105cd393-2689-49d8-a019-641096494aee/4370d129-c200-41a1-a8aa-819959b1f630) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:57.512443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ce6cfed1-6d2d-4d30-8181-21d0c202f76b None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:57.512842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ce6cfed1-6d2d-4d30-8181-21d0c202f76b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.580342 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.594633 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] Update dhcp port {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'fixed_ips': [{'subnet_id': 'c578f31c-1176-4132-a135-5adc056db9e2', 'ip_address': '172.20.0.18'}, {'subnet_id': '105cd393-2689-49d8-a019-641096494aee'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:14:57.614961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] For port 8c5fe508-3b5f-43be-b867-343cf5fb5648, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:14:57.628843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.654748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ce6cfed1-6d2d-4d30-8181-21d0c202f76b None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:57.667017 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] For port 8c5fe508-3b5f-43be-b867-343cf5fb5648, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c5fe508-3b5f-43be-b867-343cf5fb5648,segment=NetworkSegment(09ebaf21-03b0-4887-8935-21c4b4f062e7),segment_id=09ebaf21-03b0-4887-8935-21c4b4f062e7)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:14:57.674971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.682761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.691303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.698563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 4ef31e67-d644-4395-835a-e1c0164a7504, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4ef31e67-d644-4395-835a-e1c0164a7504,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:57.725843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:57.729847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:57.732008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.741971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:14:57.747119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=4370d129-c200-41a1-a8aa-819959b1f630,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:57.760955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=7158712e-dfb2-4143-84b4-8752b11c84aa,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:57.819227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37491076-0cc4-496c-8e6d-09a9bce056d9 None None] Pushing event updated for resources: {'Port': ['ID=8c5fe508-3b5f-43be-b867-343cf5fb5648,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:57.927488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-34d9000d-448c-4c27-8cb3-cd4eecdd18be None None] Provisioning complete for port 4ef31e67-d644-4395-835a-e1c0164a7504 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:57.927867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-34d9000d-448c-4c27-8cb3-cd4eecdd18be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:57.929589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:14:57.935468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:14:58.033844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=4ef31e67-d644-4395-835a-e1c0164a7504,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:58.141523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] Allocated IP 172.20.0.2 (a288e794-7129-48ec-b278-2ea8bf1fe00e/105cd393-2689-49d8-a019-641096494aee/1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:14:58.199664 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a44aefa5-75f7-493e-9ad5-a015d643fed3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2862 time: 0.9322996 Nov 24 04:14:58.200660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 3f8a03ce-f479-4712-b238-c3ff5cffb899 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:14:58.358453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-75ddea7b-826a-43ae-b684-efbcfad1a5a3 None None] Provisioning complete for port e009693e-ddac-4259-989a-571f846daec3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:58.358838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75ddea7b-826a-43ae-b684-efbcfad1a5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.377822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:58.378614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.418368 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5a85a012-35c1-4e2a-abf4-2491fc519e03 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.7422204 Nov 24 04:14:58.418589 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35234) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:58.423140 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:14:58.424068 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:58.435681 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] Sync routers for ids ['3f8a03ce-f479-4712-b238-c3ff5cffb899'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:58.463149 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,segment=NetworkSegment(7bf5b14e-f40d-4760-a2d5-49f2d2712f10),segment_id=7bf5b14e-f40d-4760-a2d5-49f2d2712f10)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:58.464267 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4bec343f-0b0b-490e-a611-f4119d63641b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/3f8a03ce-f479-4712-b238-c3ff5cffb899/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2294235 Nov 24 04:14:58.464754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35236) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:58.465913 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] Routers {'3f8a03ce-f479-4712-b238-c3ff5cffb899'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:58.467199 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f8a03ce-f479-4712-b238-c3ff5cffb899'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:58.503984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-75ddea7b-826a-43ae-b684-efbcfad1a5a3 None None] Port e009693e-ddac-4259-989a-571f846daec3 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:58.510518 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:58.522619 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] Routers {'3f8a03ce-f479-4712-b238-c3ff5cffb899'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:58.523338 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f8a03ce-f479-4712-b238-c3ff5cffb899'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:58.558880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.559398 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4073fffb-d985-4638-839e-97fda3e45c5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:14:58.565973 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4073fffb-d985-4638-839e-97fda3e45c5e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports/7158712e-dfb2-4143-84b4-8752b11c84aa HTTP/1.1" status: 200 len: 983 time: 0.0947726 Nov 24 04:14:58.567759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35238) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:58.572100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.574051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-75ddea7b-826a-43ae-b684-efbcfad1a5a3 None None] Provisioning complete for port 4ef31e67-d644-4395-835a-e1c0164a7504 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:58.574471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75ddea7b-826a-43ae-b684-efbcfad1a5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.595097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c5fe508-3b5f-43be-b867-343cf5fb5648 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:58.598976 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:58.609834 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8220d87-3d46-4f99-8a8b-945ab512772e None None] The sync data for ids ['3f8a03ce-f479-4712-b238-c3ff5cffb899'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:14:58.715380 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:58.720083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.748679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Sync routers for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:14:58.763437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35240) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:58.768638 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1524580667', 'description': 'tempest-secgroup-smoke-1524580667 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:58.824413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:14:58.825098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:58.860251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:58.899086 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.ipam_backend_mixin [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 105cd393-2689-49d8-a019-641096494aee (CIDR: 172.20.0.0/28) Nov 24 04:14:58.909443 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:58.909944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:58.953160 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-36779b09-a1f2-4cf9-8b32-e2a84d2ab6c4 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5332654 Nov 24 04:14:58.955847 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35242) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:58.957421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e58f3f-61e3-4305-aa42-c7cbc7750f22 None None] Pushing event updated for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=6']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:58.973767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:58.988156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8c5fe508-3b5f-43be-b867-343cf5fb5648 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:58.988156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.031620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.039310 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.082888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.086260 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3215542 Nov 24 04:14:59.087948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5433874e-d65f-4428-97be-c7bb9b7ffd7a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bc748bf0-50f6-406a-9e3c-703c4e328b94,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:59.102376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35244) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:59.110539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': 'bc748bf0-50f6-406a-9e3c-703c4e328b94', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:59.161312 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.212668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:59.217060 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.233140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:14:59.268831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.279334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.312808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.314050 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2100852 Nov 24 04:14:59.315089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50c8cc83-290e-4c45-9faf-a84634ecf21c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=502cebf1-1ee5-44ce-96b3-ff3685b51858,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:59.317210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35246) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:59.323515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': 'bc748bf0-50f6-406a-9e3c-703c4e328b94', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:59.366475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.441067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.472813 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.476664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.486452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.524625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=57f1b263-f83f-44ec-9279-e9b93ff40b5f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:59.537543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.540139 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dc0c79e0-c62b-408f-b1f6-a8580fed49a6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2219710 Nov 24 04:14:59.543673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35248) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:59.551258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': 'bc748bf0-50f6-406a-9e3c-703c4e328b94', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:59.553544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b6559ed4-dca9-47de-839c-286530fd97ef None None] Provisioning complete for port e009693e-ddac-4259-989a-571f846daec3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:59.554041 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b6559ed4-dca9-47de-839c-286530fd97ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.560202 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.ipam_backend_mixin [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet c578f31c-1176-4132-a135-5adc056db9e2 (CIDR: 172.20.0.16/28) Nov 24 04:14:59.572525 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:14:59.573003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:14:59.592507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.604329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 8c5fe508-3b5f-43be-b867-343cf5fb5648, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c5fe508-3b5f-43be-b867-343cf5fb5648,segment=NetworkSegment(09ebaf21-03b0-4887-8935-21c4b4f062e7),segment_id=09ebaf21-03b0-4887-8935-21c4b4f062e7)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:14:59.617583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.618315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4ef31e67-d644-4395-835a-e1c0164a7504 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:14:59.629002 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-b6559ed4-dca9-47de-839c-286530fd97ef None None] Port e009693e-ddac-4259-989a-571f846daec3 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:14:59.691193 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.700073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.711673 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8802aeb1-f9db-4c84-9d63-3e54e0a094f9 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.7461240 Nov 24 04:14:59.712459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35250) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:59.726263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'subnet': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:59.737694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.739717 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1941068 Nov 24 04:14:59.742574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35252) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:59.748857 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': 'bc748bf0-50f6-406a-9e3c-703c4e328b94', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:59.756103 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee29477d-e2f9-4aed-900d-858098ec6304 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd9e1373-e61f-4311-8a14-f71e96119b5f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:59.766673 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=8c5fe508-3b5f-43be-b867-343cf5fb5648,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:59.787824 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.792828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0a4c70de-89a4-46cc-b93d-4577d68e0f39 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:59.793206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0a4c70de-89a4-46cc-b93d-4577d68e0f39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.822826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 4ef31e67-d644-4395-835a-e1c0164a7504 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:14:59.823202 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.854229 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-757bc11c-171e-4e9c-89c4-1492b6d7d084 None None] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:14:59.883404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:14:59.886385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.894579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.931530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6b4936e6-b3a3-4362-8371-56cce9813d29,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:14:59.938450 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Made reservation on behalf of b1bda997a7f64c3885e8ed4cd7b28f2f for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:14:59.940267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.942172 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3da21ed3-8dad-4d5e-bddc-b7b764cb88b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1983056 Nov 24 04:14:59.945562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35254) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:14:59.948190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:14:59.948841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Checking router: 3fa77305-8276-4287-a9eb-5efe6a409e17 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:14:59.949786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Updating router 3fa77305-8276-4287-a9eb-5efe6a409e17 port e009693e-ddac-4259-989a-571f846daec3 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:14:59.952072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': 'bc748bf0-50f6-406a-9e3c-703c4e328b94', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:14:59.986180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:14:59.994984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.038436 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.066907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.072568 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.092833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ef79a56f-87b5-4f7b-afe7-e8951cb0f189,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:00.106874 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.113639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 7158712e-dfb2-4143-84b4-8752b11c84aa {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:00.114229 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.116990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35256) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:00.117943 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f2622946-b73d-4d59-b45f-9bedbf4f1ac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1636963 Nov 24 04:15:00.123071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': 'bc748bf0-50f6-406a-9e3c-703c4e328b94', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:00.249268 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:15:00.269469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.273136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1fe8009f-8694-49b5-a31d-087301231349 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:00.291507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.324934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0a4c70de-89a4-46cc-b93d-4577d68e0f39 None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:00.325311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0a4c70de-89a4-46cc-b93d-4577d68e0f39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.343452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 7158712e-dfb2-4143-84b4-8752b11c84aa owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:00.421129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0a4c70de-89a4-46cc-b93d-4577d68e0f39 None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:00.443997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.456108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.469349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1fe8009f-8694-49b5-a31d-087301231349 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:00.469730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.475208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.520425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1b6b0832-32dc-4140-8b63-c8a99eda985c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:00.536942 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.548268 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-57d49696-feea-42ca-b6dd-df405c8b3a09 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4285023 Nov 24 04:15:00.592751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Network a288e794-7129-48ec-b278-2ea8bf1fe00e is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:00.601620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:00.604742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:00.605294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.628158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Subnet': ['ID=e030fcbd-d5f2-4e87-b141-8b84e9f4e465,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:00.655270 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a1cd42fd-d1b0-4da2-ba59-105f10b109ce tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.9400713 Nov 24 04:15:00.655930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35260) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:00.663959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50e3e0c9-8b1a-461c-94c8-409b8e55873c None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:00.675305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-285735242', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'e030fcbd-d5f2-4e87-b141-8b84e9f4e465'}], 'security_groups': ['e3333998-e2ed-4ba6-a461-2560afe6ea00', '27c2640e-6fd7-4902-9de6-71e9eff394eb']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:00.721503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-13530571-c31c-45eb-bfe6-bc6af94e06aa None None] Provisioning complete for port 4370d129-c200-41a1-a8aa-819959b1f630 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:00.722209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-13530571-c31c-45eb-bfe6-bc6af94e06aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.746304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.827316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.841669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:00.892880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-13530571-c31c-45eb-bfe6-bc6af94e06aa None None] Port 4370d129-c200-41a1-a8aa-819959b1f630 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:00.893047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=7158712e-dfb2-4143-84b4-8752b11c84aa,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:00.930562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-13530571-c31c-45eb-bfe6-bc6af94e06aa None None] Could not find standard attr ID for object 7158712e-dfb2-4143-84b4-8752b11c84aa. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:15:00.960309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cda0b60-d32a-415b-bbb7-c1d3b8a71345 None None] Pushing event updated for resources: {'Port': ['ID=e009693e-ddac-4259-989a-571f846daec3,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:01.086321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:01.142302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-13530571-c31c-45eb-bfe6-bc6af94e06aa None None] Provisioning complete for port 8c5fe508-3b5f-43be-b867-343cf5fb5648 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:01.142615 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-13530571-c31c-45eb-bfe6-bc6af94e06aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.156847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Attempting to bind port e009693e-ddac-4259-989a-571f846daec3 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:01.157226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Attempting to bind port e009693e-ddac-4259-989a-571f846daec3 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:01.157593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Attempting to bind port e009693e-ddac-4259-989a-571f846daec3 on network 38418e10-00b7-4e21-8d7a-91bfeb87756f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:01.162498 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-1212bc8e-bbe7-4d7c-a537-41dfc9604c98 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1524580667&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.3363478 Nov 24 04:15:01.215299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.263960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.400207 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:01.400591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Checking segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:01.401003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.401398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Bound using segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:01.401884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Bound port: e009693e-ddac-4259-989a-571f846daec3, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:01.402309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.534497 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] For port e009693e-ddac-4259-989a-571f846daec3, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:01.538408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:01.538788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.543034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] For port e009693e-ddac-4259-989a-571f846daec3, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e009693e-ddac-4259-989a-571f846daec3,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:01.600670 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.715780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] Update dhcp port {'port': {'network_id': 'a288e794-7129-48ec-b278-2ea8bf1fe00e', 'fixed_ips': [{'subnet_id': 'c578f31c-1176-4132-a135-5adc056db9e2', 'ip_address': '172.20.0.18'}, {'subnet_id': '105cd393-2689-49d8-a019-641096494aee', 'ip_address': '172.20.0.2'}, {'subnet_id': 'e030fcbd-d5f2-4e87-b141-8b84e9f4e465'}], 'binding:host_id': 'dv-neutron-819049-1-hyperv'}, 'id': '1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b'} from dv-neutron-819049-1-hyperv. {{(pid=103382) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:328}} Nov 24 04:15:01.745227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:01.745876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:01.747781 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cda0b60-d32a-415b-bbb7-c1d3b8a71345 None None] Pushing event updated for resources: {'Port': ['ID=e009693e-ddac-4259-989a-571f846daec3,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:01.824637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:01.895514 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c5fe508-3b5f-43be-b867-343cf5fb5648 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:01.945741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Provisioning complete for port e009693e-ddac-4259-989a-571f846daec3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:01.946120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.005828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:02.031615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-cbe99d60-71e0-4de9-ade0-6d2bab135d4b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:02.033080 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-cbe99d60-71e0-4de9-ade0-6d2bab135d4b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=38418e10-00b7-4e21-8d7a-91bfeb87756f HTTP/1.1" status: 200 len: 797 time: 0.8577125 Nov 24 04:15:02.042299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 3f8a03ce-f479-4712-b238-c3ff5cffb899 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:02.096742 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-c4d22da9-047d-45ad-9735-8285d02d5404 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0562279 Nov 24 04:15:02.189081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8c5fe508-3b5f-43be-b867-343cf5fb5648 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:02.189456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.227016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:02.232741 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f7a58c18-54e8-4b61-8fe6-116af7f83d6e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/3f8a03ce-f479-4712-b238-c3ff5cffb899/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6645710 Nov 24 04:15:02.236230 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35272) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:02.251202 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] Sync routers for ids ['3f8a03ce-f479-4712-b238-c3ff5cffb899'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:02.260612 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-2c86a596-d1ec-405e-8c7c-c108627e4ecc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1245761 Nov 24 04:15:02.280151 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] Routers {'3f8a03ce-f479-4712-b238-c3ff5cffb899'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:02.282491 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f8a03ce-f479-4712-b238-c3ff5cffb899'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:02.340232 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] Allocated IP 172.20.0.34 (a288e794-7129-48ec-b278-2ea8bf1fe00e/e030fcbd-d5f2-4e87-b141-8b84e9f4e465/1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:02.341132 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:02.355179 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] Routers {'3f8a03ce-f479-4712-b238-c3ff5cffb899'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:02.356381 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:14:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f8a03ce-f479-4712-b238-c3ff5cffb899'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:02.366367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.400841 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:02.402364 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51352bc8-444a-4143-ad44-8d97ecb83218 None None] The sync data for ids ['3f8a03ce-f479-4712-b238-c3ff5cffb899'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:02.453259 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-c523a0c2-7a0b-4c4f-8571-0ad87d4c62df tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] remove_router_interface failed (client error): The resource could not be found. Nov 24 04:15:02.457491 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c523a0c2-7a0b-4c4f-8571-0ad87d4c62df tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/3f8a03ce-f479-4712-b238-c3ff5cffb899/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.2197781 Nov 24 04:15:02.457657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35276) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:02.485493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] For port e009693e-ddac-4259-989a-571f846daec3, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e009693e-ddac-4259-989a-571f846daec3,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:02.492743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3b951686-87c4-4fd9-a329-dfe75fa17c58 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=3f8a03ce-f479-4712-b238-c3ff5cffb899 HTTP/1.1" status: 200 len: 205 time: 0.0318694 Nov 24 04:15:02.492743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-a0d570fb-0938-4820-a8d9-b603907822ea service neutron] 10.222.0.48 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2178793 Nov 24 04:15:02.493205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35278) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:02.515565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.550269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Could not find standard attr ID for object 7158712e-dfb2-4143-84b4-8752b11c84aa. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:15:02.591126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.617384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,segment=NetworkSegment(7bf5b14e-f40d-4760-a2d5-49f2d2712f10),segment_id=7bf5b14e-f40d-4760-a2d5-49f2d2712f10)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:02.619186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Provisioning complete for port 8c5fe508-3b5f-43be-b867-343cf5fb5648 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:02.619552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.621661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c3dafb-b020-4717-889a-e18e43aa1e6b None None] Pushing event updated for resources: {'Port': ['ID=e009693e-ddac-4259-989a-571f846daec3,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:02.653948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:02.700455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09e28f8e-8fbd-4503-97a5-4cc1c7d07c57 None None] The sync data for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv is: [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:02.708181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.717659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.844501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.847555 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-d698bb42-871b-472a-8e4d-9cb83053dabd service neutron] 10.222.0.48 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3475242 Nov 24 04:15:02.850211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.915148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa488f09-cc69-46ad-957f-7feeea405a72 None None] Pushing event updated for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=7']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:02.942900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.943419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router 3f8a03ce-f479-4712-b238-c3ff5cffb899 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:02.962450 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:02.965943 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3b76bea4-306f-4aa6-9f01-5d0e0b51a258 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/3f8a03ce-f479-4712-b238-c3ff5cffb899 HTTP/1.1" status: 204 len: 168 time: 0.4694731 Nov 24 04:15:02.966847 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35280) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:03.016590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Delete allocated IP 172.20.0.8 (a288e794-7129-48ec-b278-2ea8bf1fe00e/105cd393-2689-49d8-a019-641096494aee) {{(pid=103381) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 04:15:03.041045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Allocated IP 172.20.0.38 (a288e794-7129-48ec-b278-2ea8bf1fe00e/e030fcbd-d5f2-4e87-b141-8b84e9f4e465/4370d129-c200-41a1-a8aa-819959b1f630) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:03.047948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e009693e-ddac-4259-989a-571f846daec3 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:03.075591 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 77aafc96-4615-4a35-b02c-4068c68d9ab0 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:03.080522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.142606 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.211451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3e99ed3a-5494-450d-b56d-0be635edbc69 None None] Provisioning complete for port e009693e-ddac-4259-989a-571f846daec3 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:03.211830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3e99ed3a-5494-450d-b56d-0be635edbc69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.283457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e009693e-ddac-4259-989a-571f846daec3 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:03.283837 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.315314 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8e5d9f77-26f9-4e93-bfd5-388717919acf req-27f66240-5c72-4572-a8e9-78535158838f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 210 time: 0.0686710 Nov 24 04:15:03.322855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.333995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.341614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.448948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.489256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event updated for resources: {'Port': ['ID=4370d129-c200-41a1-a8aa-819959b1f630,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:03.502668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=77aafc96-4615-4a35-b02c-4068c68d9ab0,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:03.514487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.514884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b14c4761-a5eb-4ae8-bdf7-24935c2e2f27 None None] Network 09de9cec-5020-427f-be8c-dcc86b3d71f4 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:03.518757 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c9701b90-8d51-4b77-a107-12f01fa48ab2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/77aafc96-4615-4a35-b02c-4068c68d9ab0 HTTP/1.1" status: 204 len: 168 time: 0.5436139 Nov 24 04:15:03.521188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35292) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:03.598541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] In _notify_port_updated(), no bound segment for port 4370d129-c200-41a1-a8aa-819959b1f630 on network a288e794-7129-48ec-b278-2ea8bf1fe00e {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:15:03.611577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:03.612673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.614661 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a8320648-486f-48d7-8872-c53d3df41fc2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "PUT /v2.0/ports/4370d129-c200-41a1-a8aa-819959b1f630 HTTP/1.1" status: 200 len: 959 time: 2.9533284 Nov 24 04:15:03.617503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35294) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:03.675659 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.795902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 8c5fe508-3b5f-43be-b867-343cf5fb5648 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:03.796801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.803900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] DHCP port deletion for 09de9cec-5020-427f-be8c-dcc86b3d71f4 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:03.810943 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 4370d129-c200-41a1-a8aa-819959b1f630 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:03.811370 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.948014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 8c5fe508-3b5f-43be-b867-343cf5fb5648, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8c5fe508-3b5f-43be-b867-343cf5fb5648,segment=NetworkSegment(09ebaf21-03b0-4887-8935-21c4b4f062e7),segment_id=09ebaf21-03b0-4887-8935-21c4b4f062e7)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:03.948378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.961281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:03.971766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 8c5fe508-3b5f-43be-b867-343cf5fb5648 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:03.989305 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 4370d129-c200-41a1-a8aa-819959b1f630 owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:04.070975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.097853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=8c5fe508-3b5f-43be-b867-343cf5fb5648,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:04.100221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Provisioning complete for port 4370d129-c200-41a1-a8aa-819959b1f630 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:04.100740 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.107073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port 8c5fe508-3b5f-43be-b867-343cf5fb5648 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:04.148828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Port 4370d129-c200-41a1-a8aa-819959b1f630 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:04.158542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Deleting port 8c5fe508-3b5f-43be-b867-343cf5fb5648 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:04.158834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.174356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.190303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:04.190683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.211363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.213643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=4370d129-c200-41a1-a8aa-819959b1f630,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:04.237475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['09de9cec-5020-427f-be8c-dcc86b3d71f4']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:04.247814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '09ebaf21-03b0-4887-8935-21c4b4f062e7') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:04.249056 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '09ebaf21-03b0-4887-8935-21c4b4f062e7') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:04.259500 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.281904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.283749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] For port 8c5fe508-3b5f-43be-b867-343cf5fb5648, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:04.284163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.302647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 175 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:04.303072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:04.306334 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:04.313014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.317079 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-224834af-5505-4a13-a80a-258e6a79b290 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/4370d129-c200-41a1-a8aa-819959b1f630 HTTP/1.1" status: 204 len: 168 time: 0.6979694 Nov 24 04:15:04.321837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35296) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:04.334722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Calling delete_port for 8c5fe508-3b5f-43be-b867-343cf5fb5648 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:04.337744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Port 8c5fe508-3b5f-43be-b867-343cf5fb5648 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:15:04.341104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.388729 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-dac5a8ca-e061-4201-ac2e-b8de93275ff2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] GET failed (client error): The resource could not be found. Nov 24 04:15:04.393389 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dac5a8ca-e061-4201-ac2e-b8de93275ff2 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports/4370d129-c200-41a1-a8aa-819959b1f630 HTTP/1.1" status: 404 len: 333 time: 0.0678806 Nov 24 04:15:04.396723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35300) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:04.467616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] Pushing event deleted for resources: {'Port': ['ID=8c5fe508-3b5f-43be-b867-343cf5fb5648,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:04.481605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.484166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b6c1f12-ca58-47d6-83e4-96e700cc8b07 None None] No DVR routers for this DVR port 8c5fe508-3b5f-43be-b867-343cf5fb5648 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:04.489190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.493504 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/09de9cec-5020-427f-be8c-dcc86b3d71f4 HTTP/1.1" status: 204 len: 168 time: 0.9713113 Nov 24 04:15:04.504528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35302) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:04.510293 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1454082835'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:04.529978 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-343bbe26-b570-4e50-b65d-382bf88fcc59 req-7887d22b-156b-4d10-88a9-73532f329a7e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 210 time: 0.1377945 Nov 24 04:15:04.556314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:04.557074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.589935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4287eca6-dfe2-462d-85a2-42aa64f36e6a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=09de9cec-5020-427f-be8c-dcc86b3d71f4,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:04.598594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-974ef9f0-f0cc-48ad-8a1a-05e9d1e7aad1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.630187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f57869bb-3e10-4273-8304-4d582998ff43 None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:04.640543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:04.644349 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.651398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-974ef9f0-f0cc-48ad-8a1a-05e9d1e7aad1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.675527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-76a4b71d-c8d4-4c14-8a66-c2a1b9239832 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:04.677546 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-76a4b71d-c8d4-4c14-8a66-c2a1b9239832 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=38418e10-00b7-4e21-8d7a-91bfeb87756f HTTP/1.1" status: 200 len: 797 time: 0.2435286 Nov 24 04:15:04.690806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 171, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:04.701516 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.702055 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 8b495893-2e31-46c6-932c-b7aa065eeb95 of type vlan for network eea2cba5-dd2e-4dbc-99a1-67de75200d88 Nov 24 04:15:04.721079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-974ef9f0-f0cc-48ad-8a1a-05e9d1e7aad1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.724529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-974ef9f0-f0cc-48ad-8a1a-05e9d1e7aad1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.726677 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-974ef9f0-f0cc-48ad-8a1a-05e9d1e7aad1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/security-groups/eb3502b5-4250-4f89-add5-4417f427d30d HTTP/1.1" status: 204 len: 168 time: 0.3281672 Nov 24 04:15:04.731130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35308) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:04.743961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bf4fd909-8922-423e-aa38-e53af87be397 None None] Could not find standard attr ID for object 4370d129-c200-41a1-a8aa-819959b1f630. {{(pid=103382) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 04:15:04.765027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-974ef9f0-f0cc-48ad-8a1a-05e9d1e7aad1 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb3502b5-4250-4f89-add5-4417f427d30d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:04.765907 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.803732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04aae9e0-9674-438d-89bb-e57e08daf04e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.826877 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-2404f0c7-0d20-4402-a3fb-98dad5b415cb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 380 time: 0.1162126 Nov 24 04:15:04.830603 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04aae9e0-9674-438d-89bb-e57e08daf04e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.839795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['bc748bf0-50f6-406a-9e3c-703c4e328b94']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:04.845099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.850651 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:04.851279 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.884244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04aae9e0-9674-438d-89bb-e57e08daf04e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.887521 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04aae9e0-9674-438d-89bb-e57e08daf04e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.892151 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-04aae9e0-9674-438d-89bb-e57e08daf04e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/security-groups/27c2640e-6fd7-4902-9de6-71e9eff394eb HTTP/1.1" status: 204 len: 168 time: 0.1598549 Nov 24 04:15:04.893008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35310) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:04.912623 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4038115 Nov 24 04:15:04.920860 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35312) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:04.931714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:04.947915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b4a33021-e0e0-4834-81ee-93009d729218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:04.954590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04aae9e0-9674-438d-89bb-e57e08daf04e tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=27c2640e-6fd7-4902-9de6-71e9eff394eb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:04.998999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:05.012012 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a75f5cb-dc91-4911-b15b-9bf5475ffea3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=eea2cba5-dd2e-4dbc-99a1-67de75200d88,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:05.027791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:05.050730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:05.054483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.056722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-619fbd96-fdad-42e7-bba9-550ec64c961d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.093493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-619fbd96-fdad-42e7-bba9-550ec64c961d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.101909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:05.105461 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.122516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:05.123088 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.201132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.8 (38418e10-00b7-4e21-8d7a-91bfeb87756f/f2125981-3937-4d3b-9f58-7dca17c52922/45a441c0-edd7-4702-b94f-f2ff19ae82d4) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:05.210136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-619fbd96-fdad-42e7-bba9-550ec64c961d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.213233 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-619fbd96-fdad-42e7-bba9-550ec64c961d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.214898 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-619fbd96-fdad-42e7-bba9-550ec64c961d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/security-groups/e3333998-e2ed-4ba6-a461-2560afe6ea00 HTTP/1.1" status: 204 len: 168 time: 0.3174443 Nov 24 04:15:05.217519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35314) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:05.235289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619fbd96-fdad-42e7-bba9-550ec64c961d tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3333998-e2ed-4ba6-a461-2560afe6ea00,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:05.268050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c5fe508-3b5f-43be-b867-343cf5fb5648 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:05.292939 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 8c5fe508-3b5f-43be-b867-343cf5fb5648 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:05.293436 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8c5fe508-3b5f-43be-b867-343cf5fb5648 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:05.313754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet 105cd393-2689-49d8-a019-641096494aee {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:05.328742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.364516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.408284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.426662 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=eb81f251-4e12-4f7c-817e-c211acff608f,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:05.443955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '8b495893-2e31-46c6-932c-b7aa065eeb95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:05.444326 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: eea2cba5-dd2e-4dbc-99a1-67de75200d88, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:05.461019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:05.471372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, eea2cba5-dd2e-4dbc-99a1-67de75200d88) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:05.475711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:05.476308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.482181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-630a84e6-8b1e-4d49-94c2-03cbceada980 None None] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:05.486774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.498263 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-781cea63-1b99-4a0c-b22f-f48fd346b4c8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5690908 Nov 24 04:15:05.499161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35316) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:05.503825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-707098', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:05.531263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.532550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.543831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.590363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.594682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.598830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.625442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.630189 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c7d7c012-93d5-4ab3-8a6b-f98b777a1f30 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.1280570 Nov 24 04:15:05.632263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35320) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:05.638732 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:05.648393 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:05.653590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:05.661029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-eea2cba5-dd2e-4dbc-99a1-67de75200d88', 'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': 'eb81f251-4e12-4f7c-817e-c211acff608f'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:05.665802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.705452 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.732252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=45a441c0-edd7-4702-b94f-f2ff19ae82d4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:05.763710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=105cd393-2689-49d8-a019-641096494aee,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:05.773994 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.777220 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dd25541b-ffb1-4ab5-a718-0d264009f8b3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/105cd393-2689-49d8-a019-641096494aee HTTP/1.1" status: 204 len: 168 time: 0.5584917 Nov 24 04:15:05.786172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65d8339e-b47a-4561-9c17-541c18f8fb89 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:05.791490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:05.792150 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:05.801648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35322) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:05.847232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16025598-28d6-4da7-865c-da4f3ab3b579 req-d3147973-c3f4-43d6-be46-32ea8c9b114f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:05.848784 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-16025598-28d6-4da7-865c-da4f3ab3b579 req-d3147973-c3f4-43d6-be46-32ea8c9b114f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 931 time: 0.1843307 Nov 24 04:15:05.856337 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-209aae76-c5ea-4ed6-b366-25366bee6e9c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0206273 Nov 24 04:15:05.871451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Request body: {'port': {'device_id': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:05.932372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Allocated IP 2001:db8::2 (eea2cba5-dd2e-4dbc-99a1-67de75200d88/eb81f251-4e12-4f7c-817e-c211acff608f/e7ebd619-e967-45a4-97b4-8a814795be0f) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:05.933661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet e030fcbd-d5f2-4e87-b141-8b84e9f4e465 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:05.948464 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.007278 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.014470 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-16025598-28d6-4da7-865c-da4f3ab3b579 req-9f23107d-9111-4901-93a7-2dc5ba6bd1f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1571469 Nov 24 04:15:06.026735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a18dfe14-096d-46de-bef2-de8c24dcab4b None None] Provisioning complete for port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:06.027113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a18dfe14-096d-46de-bef2-de8c24dcab4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.040370 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.058561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.115683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a18dfe14-096d-46de-bef2-de8c24dcab4b None None] Port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:06.187640 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.194683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.247290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:06.252554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:06.259142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:06.262496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Pushing event updated for resources: {'Port': ['ID=e7ebd619-e967-45a4-97b4-8a814795be0f,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:06.334685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Attempting to bind port e7ebd619-e967-45a4-97b4-8a814795be0f on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:06.335281 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Attempting to bind port e7ebd619-e967-45a4-97b4-8a814795be0f by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8b495893-2e31-46c6-932c-b7aa065eeb95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:06.335719 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Attempting to bind port e7ebd619-e967-45a4-97b4-8a814795be0f on network eea2cba5-dd2e-4dbc-99a1-67de75200d88 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:06.344612 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:06.344991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Checking segment: {'id': '8b495893-2e31-46c6-932c-b7aa065eeb95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:06.345541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.345944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Bound using segment: {'id': '8b495893-2e31-46c6-932c-b7aa065eeb95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:06.346460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Bound port: e7ebd619-e967-45a4-97b4-8a814795be0f, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b495893-2e31-46c6-932c-b7aa065eeb95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'eea2cba5-dd2e-4dbc-99a1-67de75200d88'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:06.347045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.426864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] For port e7ebd619-e967-45a4-97b4-8a814795be0f, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:06.430261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] For port e7ebd619-e967-45a4-97b4-8a814795be0f, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7ebd619-e967-45a4-97b4-8a814795be0f,segment=NetworkSegment(8b495893-2e31-46c6-932c-b7aa065eeb95),segment_id=8b495893-2e31-46c6-932c-b7aa065eeb95)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:06.437968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.519162 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a1cf0c-b1d1-4555-acd2-0e6b5f8620f6 None None] Pushing event updated for resources: {'Port': ['ID=e7ebd619-e967-45a4-97b4-8a814795be0f,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:06.639546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.682223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8::1 (eea2cba5-dd2e-4dbc-99a1-67de75200d88/eb81f251-4e12-4f7c-817e-c211acff608f/2df7ed69-ddcd-49aa-bbcc-d78c0421af1e) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:06.802681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.852722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=e030fcbd-d5f2-4e87-b141-8b84e9f4e465,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:06.863362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.868761 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4923a8bb-c469-45db-a006-becea6dc0e6b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/e030fcbd-d5f2-4e87-b141-8b84e9f4e465 HTTP/1.1" status: 204 len: 168 time: 1.0646913 Nov 24 04:15:06.879216 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.884582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35324) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:06.915934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-506a18b7-7753-48e7-9ba1-437f563b3a50 None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:06.951039 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0faab8d7-73da-4f57-90fc-a4418a8423e3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:06.951830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0faab8d7-73da-4f57-90fc-a4418a8423e3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:06.957444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 45a441c0-edd7-4702-b94f-f2ff19ae82d4 {{(pid=103380) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:15:06.957790 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0faab8d7-73da-4f57-90fc-a4418a8423e3 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/105cd393-2689-49d8-a019-641096494aee HTTP/1.1" status: 404 len: 337 time: 0.0720215 Nov 24 04:15:06.960299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35326) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:06.968172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:06.993676 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.provisioning_blocks [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Transition to ACTIVE for port object 45a441c0-edd7-4702-b94f-f2ff19ae82d4 will not be triggered until provisioned by entity L2. {{(pid=103380) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:15:07.001933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.002323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7ebd619-e967-45a4-97b4-8a814795be0f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:07.008385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5269fcc9-8e93-421e-ad01-24b08651a363 None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:07.009086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5269fcc9-8e93-421e-ad01-24b08651a363 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.036153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting subnet c578f31c-1176-4132-a135-5adc056db9e2 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:07.040215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.069542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.154282 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.165189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e7ebd619-e967-45a4-97b4-8a814795be0f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:07.165562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.186859 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Pushing event updated for resources: {'Port': ['ID=45a441c0-edd7-4702-b94f-f2ff19ae82d4,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:07.188196 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:07.210278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:07.212746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:07.213464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.242442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Attempting to bind port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:07.242933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Attempting to bind port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:07.243359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Attempting to bind port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 on network 38418e10-00b7-4e21-8d7a-91bfeb87756f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:07.251079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 on network 38418e10-00b7-4e21-8d7a-91bfeb87756f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:15:07.251500 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Attempting to bind port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 on network 38418e10-00b7-4e21-8d7a-91bfeb87756f {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:07.258780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 14, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:07.259209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Checking segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:07.259672 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Bound using segment: {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'} {{(pid=103380) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:07.260260 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.managers [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Bound port: 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9aa54d37-a4e0-411f-959a-ce8a29b58669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f'}}] {{(pid=103380) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:07.260936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.279270 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=2df7ed69-ddcd-49aa-bbcc-d78c0421af1e,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:07.295459 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5269fcc9-8e93-421e-ad01-24b08651a363 None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:07.296562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5269fcc9-8e93-421e-ad01-24b08651a363 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.355553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.359213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5269fcc9-8e93-421e-ad01-24b08651a363 None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:07.395518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a03b4834-a799-48ca-b381-7e672e03d6cb req-b0d2e0d1-4be5-4a04-94c4-27e851e0c5d6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:07.396627 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a03b4834-a799-48ca-b381-7e672e03d6cb req-b0d2e0d1-4be5-4a04-94c4-27e851e0c5d6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 943 time: 0.2349777 Nov 24 04:15:07.409824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port e7ebd619-e967-45a4-97b4-8a814795be0f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7ebd619-e967-45a4-97b4-8a814795be0f,segment=NetworkSegment(8b495893-2e31-46c6-932c-b7aa065eeb95),segment_id=8b495893-2e31-46c6-932c-b7aa065eeb95)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:07.416249 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] For port 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host hv-neutron-8190, cleared binding levels {{(pid=103380) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:07.422124 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] For port 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103380) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:07.423834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.428755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.466587 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.500254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Pushing event updated for resources: {'Port': ['ID=45a441c0-edd7-4702-b94f-f2ff19ae82d4,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:07.524711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:07.526478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.527564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=e7ebd619-e967-45a4-97b4-8a814795be0f,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:07.527956 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-00610d9f-6e51-46e1-b561-9ec69042389f service neutron] 10.222.0.21 "PUT /v2.0/ports/45a441c0-edd7-4702-b94f-f2ff19ae82d4 HTTP/1.1" status: 200 len: 1093 time: 1.6608145 Nov 24 04:15:07.528491 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:15:07.535442 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77d7680a-8f4e-405d-8c31-16adcac5f09b" -d '{"events": [{"name": "network-changed", "server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:15:07.536398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.625447 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a03b4834-a799-48ca-b381-7e672e03d6cb req-6e60a66a-b28b-4967-9720-68d6f4ec1b13 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2154214 Nov 24 04:15:07.646116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:15:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1c7c024-0b31-48d9-827b-d41da41d30cb x-openstack-request-id: req-d1c7c024-0b31-48d9-827b-d41da41d30cb {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:15:07.646777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:15:07.646777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-d1c7c024-0b31-48d9-827b-d41da41d30cb {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:15:07.647281 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'status': 'completed', 'code': 200} Nov 24 04:15:07.684291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-c22f943f-8076-4200-bbfd-142729ebd2f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:07.686122 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-c22f943f-8076-4200-bbfd-142729ebd2f3 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 1096 time: 0.1009552 Nov 24 04:15:07.742716 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-de96e84f-182a-411f-bec7-058d1f601556 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4 HTTP/1.1" status: 200 len: 217 time: 0.0468798 Nov 24 04:15:07.752807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.795357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Subnet': ['ID=c578f31c-1176-4132-a135-5adc056db9e2,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:07.802069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.807871 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35332) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:07.810771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3981af1b-928e-4e19-88be-3619fb5245d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/c578f31c-1176-4132-a135-5adc056db9e2 HTTP/1.1" status: 204 len: 168 time: 0.8494160 Nov 24 04:15:07.841230 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-f63a176f-a931-493f-a369-956e6e55edb5 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:07.841761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f63a176f-a931-493f-a369-956e6e55edb5 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:07.845521 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f63a176f-a931-493f-a369-956e6e55edb5 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/573bddfc-8add-4e72-a7d4-49eea78ae54f HTTP/1.1" status: 404 len: 337 time: 0.0366728 Nov 24 04:15:07.848128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35334) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:07.885722 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2f8e32a7-ba18-4da1-9632-f65e159f0a0f tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "GET /v2.0/ports?device_id=daa9fa3d-bf65-4d24-a324-e10a8f3b297b HTTP/1.1" status: 200 len: 205 time: 0.0351689 Nov 24 04:15:07.887710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-0760693b-1c31-463f-9da7-6aaaefb43a16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:07.889182 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-0760693b-1c31-463f-9da7-6aaaefb43a16 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=f2125981-3937-4d3b-9f58-7dca17c52922 HTTP/1.1" status: 200 len: 835 time: 0.1400721 Nov 24 04:15:07.890208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35336) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:07.982400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-844cc73e-858b-4f0b-a8be-812c25828fcf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.990106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.995810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:07.996644 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.012646 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-b5c9fd15-ad11-4906-be4b-c0fad687e008 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] delete failed (client error): The resource could not be found. Nov 24 04:15:08.013704 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b5c9fd15-ad11-4906-be4b-c0fad687e008 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/routers/daa9fa3d-bf65-4d24-a324-e10a8f3b297b HTTP/1.1" status: 404 len: 336 time: 0.1225727 Nov 24 04:15:08.017426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35338) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.056624 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd586801-1b7c-444b-bcea-02a68e65a1f5 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.057107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fd586801-1b7c-444b-bcea-02a68e65a1f5 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.059129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf385dd2-b327-4f90-8f41-6f8fcce41e96 None None] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:08.063158 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-fd586801-1b7c-444b-bcea-02a68e65a1f5 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/0b380565-b933-4b82-a8c3-f74014f0c198 HTTP/1.1" status: 404 len: 337 time: 0.0442386 Nov 24 04:15:08.064674 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35340) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.071832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=2df7ed69-ddcd-49aa-bbcc-d78c0421af1e,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:08.098584 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-53c09259-2099-41f0-bb0e-2d77349d51e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.099089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-53c09259-2099-41f0-bb0e-2d77349d51e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.104412 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-53c09259-2099-41f0-bb0e-2d77349d51e6 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/a9f87f94-25d7-4f1e-a9a4-f3216f8a3f06 HTTP/1.1" status: 404 len: 337 time: 0.0364363 Nov 24 04:15:08.105509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35342) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.141583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-0e72b1a4-ba77-46ea-88c7-ba228ed29d54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:08.143179 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-0e72b1a4-ba77-46ea-88c7-ba228ed29d54 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=38418e10-00b7-4e21-8d7a-91bfeb87756f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2449267 Nov 24 04:15:08.144787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-de2dc355-431b-46b1-9961-25feb21bfb0b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.145250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de2dc355-431b-46b1-9961-25feb21bfb0b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.149041 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-de2dc355-431b-46b1-9961-25feb21bfb0b tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/7e20059d-eaa0-4ca2-9d74-3dd3a824ccc8 HTTP/1.1" status: 404 len: 337 time: 0.0425739 Nov 24 04:15:08.151722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35344) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.178876 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-3738c208-3d28-4fc2-8ffa-9823434cb957 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.179097 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3738c208-3d28-4fc2-8ffa-9823434cb957 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.182506 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3738c208-3d28-4fc2-8ffa-9823434cb957 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/5719781e-a80c-456c-9263-d3a80027d91f HTTP/1.1" status: 404 len: 333 time: 0.0297742 Nov 24 04:15:08.184788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:08.185688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35346) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.196749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:08.221136 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-f0b60d11-f72f-4915-9ad8-c589b2ae6e89 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.221597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f0b60d11-f72f-4915-9ad8-c589b2ae6e89 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.225100 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f0b60d11-f72f-4915-9ad8-c589b2ae6e89 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/05dba9df-3609-4d18-ab51-84036eec15e8 HTTP/1.1" status: 404 len: 337 time: 0.0376809 Nov 24 04:15:08.228625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35348) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.259349 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-79e45642-234c-4886-b842-b82610cdd6b0 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1069553 Nov 24 04:15:08.318216 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-0dbca64c-d8ed-4797-9dd1-2b62ae7e3f96 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.318588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0dbca64c-d8ed-4797-9dd1-2b62ae7e3f96 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.323933 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0dbca64c-d8ed-4797-9dd1-2b62ae7e3f96 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/dc62de2c-9577-40a7-b660-29d60bf1e5d7 HTTP/1.1" status: 404 len: 337 time: 0.0913332 Nov 24 04:15:08.324878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35350) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.330396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b44fd99-058a-47d2-a16f-e9611dfe129a None None] Network a288e794-7129-48ec-b278-2ea8bf1fe00e requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:08.338339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-36fe7cf8-eb3d-4509-8f26-c43e81a232b5 None None] Provisioning complete for port e7ebd619-e967-45a4-97b4-8a814795be0f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:08.339021 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-36fe7cf8-eb3d-4509-8f26-c43e81a232b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.352312 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-4b1cb6f5-d06a-4dab-83c8-9063830b28d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.352878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4b1cb6f5-d06a-4dab-83c8-9063830b28d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.359324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35352) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.360130 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4b1cb6f5-d06a-4dab-83c8-9063830b28d0 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/09026ad1-da90-48e7-ae79-ff9c6f1b53b1 HTTP/1.1" status: 404 len: 333 time: 0.0347230 Nov 24 04:15:08.391074 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-82a9de7a-701f-4300-af1e-ca7edb6ac4a8 req-b09ddd73-e8ad-4740-b428-aab5d3ecfc67 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237831 Nov 24 04:15:08.392414 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-2569954c-f762-4577-960c-bc941c879406 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.392860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2569954c-f762-4577-960c-bc941c879406 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.398045 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2569954c-f762-4577-960c-bc941c879406 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/2b2caa5e-1110-46b8-b9b9-8cd8afcb8109 HTTP/1.1" status: 404 len: 337 time: 0.0347979 Nov 24 04:15:08.398386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35354) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.415651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router bf9bd32b-63d2-4dca-9608-1d504f99c603 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:15:08.426686 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-8af19952-e757-4d9e-8f1f-db78cadb61ea tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:08.427133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8af19952-e757-4d9e-8f1f-db78cadb61ea tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:08.432479 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8af19952-e757-4d9e-8f1f-db78cadb61ea tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/subnets/24f23be1-76a8-4e35-9977-5261ffd9a7ce HTTP/1.1" status: 404 len: 337 time: 0.0308723 Nov 24 04:15:08.432742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35356) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.521308 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:08.534355 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3225c3c6-7658-44cf-b2bd-092a5e150a0b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/bf9bd32b-63d2-4dca-9608-1d504f99c603/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8992627 Nov 24 04:15:08.534802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-24abaeec-e5d4-4365-905b-aec48b72ebd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:08.535354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35358) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.536307 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-24abaeec-e5d4-4365-905b-aec48b72ebd8 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 1096 time: 0.0777140 Nov 24 04:15:08.556965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] Sync routers for ids ['bf9bd32b-63d2-4dca-9608-1d504f99c603'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:08.587311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Deleting port 6069ea67-8627-41f6-b533-5ca8850bfd72 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:08.587607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.590137 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db85d507-ecd9-4c52-b6f8-c2b87d550e7c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:08.594386 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-db85d507-ecd9-4c52-b6f8-c2b87d550e7c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports/2df7ed69-ddcd-49aa-bbcc-d78c0421af1e HTTP/1.1" status: 200 len: 911 time: 0.0552285 Nov 24 04:15:08.594549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35360) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:08.594647 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] Routers {'bf9bd32b-63d2-4dca-9608-1d504f99c603'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:08.595506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['bf9bd32b-63d2-4dca-9608-1d504f99c603'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:08.638684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:08.654062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] Routers {'bf9bd32b-63d2-4dca-9608-1d504f99c603'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:08.654564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['bf9bd32b-63d2-4dca-9608-1d504f99c603'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:08.698430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:08.699470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f766add8-109f-4fcf-8ee3-03f57d5e039a None None] The sync data for ids ['bf9bd32b-63d2-4dca-9608-1d504f99c603'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:08.743035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7ce01a18-bc83-44b5-8423-3707980b930f None None] Provisioning complete for port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:08.743653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ce01a18-bc83-44b5-8423-3707980b930f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.749086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.762060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-48a616bc-2f17-445e-bdb7-5d680b8ddb29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:08.763550 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-48a616bc-2f17-445e-bdb7-5d680b8ddb29 service neutron] 10.222.0.21 "GET /v2.0/networks?id=38418e10-00b7-4e21-8d7a-91bfeb87756f HTTP/1.1" status: 200 len: 898 time: 0.2195389 Nov 24 04:15:08.792506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] DHCP port deletion for a288e794-7129-48ec-b278-2ea8bf1fe00e request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:08.796629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Calling delete_port for 6069ea67-8627-41f6-b533-5ca8850bfd72 owned by {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:08.835043 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-0b7a823d-b331-401a-b101-83011f8e951a service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4 HTTP/1.1" status: 200 len: 217 time: 0.0596199 Nov 24 04:15:08.839583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.909484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] Deleting port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:08.909924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:08.931798 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d72690-0859-4597-a4e3-f890c1034191 req-73f8a9c3-5b37-48db-ae55-983097733ddc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:08.933372 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-21d72690-0859-4597-a4e3-f890c1034191 req-73f8a9c3-5b37-48db-ae55-983097733ddc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 943 time: 0.1735613 Nov 24 04:15:08.954115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-52c3f308-c77b-415e-863c-740c1e4ae3e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:08.955652 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-52c3f308-c77b-415e-863c-740c1e4ae3e6 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=f2125981-3937-4d3b-9f58-7dca17c52922 HTTP/1.1" status: 200 len: 835 time: 0.1118860 Nov 24 04:15:08.990969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] For port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,segment=NetworkSegment(7bf5b14e-f40d-4760-a2d5-49f2d2712f10),segment_id=7bf5b14e-f40d-4760-a2d5-49f2d2712f10)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:08.991387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.006455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] Calling delete_port for 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:09.012822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7ebd619-e967-45a4-97b4-8a814795be0f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:09.047710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7ce01a18-bc83-44b5-8423-3707980b930f None None] Provisioning complete for port 6069ea67-8627-41f6-b533-5ca8850bfd72 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:09.048092 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ce01a18-bc83-44b5-8423-3707980b930f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.056586 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-21d72690-0859-4597-a4e3-f890c1034191 req-8dbdd1cd-fbbd-47d0-b7ae-77e427f4b83a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1155076 Nov 24 04:15:09.064649 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-e62e70f1-3f5d-4fed-8ea5-aa0f0400ba84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:09.066180 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-e62e70f1-3f5d-4fed-8ea5-aa0f0400ba84 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=38418e10-00b7-4e21-8d7a-91bfeb87756f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0916276 Nov 24 04:15:09.070386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.114501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.121611 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Port': ['ID=6069ea67-8627-41f6-b533-5ca8850bfd72,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:09.136337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.140906 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cd602182-706a-4d0c-8095-c25b793c246c tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/ports/6069ea67-8627-41f6-b533-5ca8850bfd72 HTTP/1.1" status: 204 len: 168 time: 0.7070875 Nov 24 04:15:09.143603 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35364) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:09.154046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7ce01a18-bc83-44b5-8423-3707980b930f None None] Port 6069ea67-8627-41f6-b533-5ca8850bfd72 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:09.186098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port e7ebd619-e967-45a4-97b4-8a814795be0f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:09.186641 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.233766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.270870 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-4ca22274-ded7-43d6-a4c4-22c39f3e1cc3 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1914890 Nov 24 04:15:09.274636 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.313374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] No DVR routers for this DVR port 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:09.324804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4672385-acea-4a8a-a163-684d41fc47ba None None] Pushing event deleted for resources: {'Port': ['ID=1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:09.338997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-27910bc3-2ec8-43c6-9e0d-cd0a984027a2 None None] Provisioning complete for port e7ebd619-e967-45a4-97b4-8a814795be0f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:09.339600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-27910bc3-2ec8-43c6-9e0d-cd0a984027a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.424452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:09.452355 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.458181 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-77d7680a-8f4e-405d-8c31-16adcac5f09b req-74dd2910-33e4-44ea-ab7d-2b9a9f1c9015 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1797075 Nov 24 04:15:09.459123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:09.459469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1e68ab7f-7c0b-48e9-8df5-f86a7b3e491b not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:09.488318 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a288e794-7129-48ec-b278-2ea8bf1fe00e']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:09.505835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 2df7ed69-ddcd-49aa-bbcc-d78c0421af1e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:09.506201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.507752 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-27910bc3-2ec8-43c6-9e0d-cd0a984027a2 None None] Provisioning complete for port 2df7ed69-ddcd-49aa-bbcc-d78c0421af1e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:09.508316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-27910bc3-2ec8-43c6-9e0d-cd0a984027a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.508937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7bf5b14e-f40d-4760-a2d5-49f2d2712f10') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:09.509362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7bf5b14e-f40d-4760-a2d5-49f2d2712f10') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:09.521224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.539132 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.548322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Releasing vlan 167 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:09.550605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:09.553935 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:09.562415 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-27910bc3-2ec8-43c6-9e0d-cd0a984027a2 None None] Port 2df7ed69-ddcd-49aa-bbcc-d78c0421af1e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:09.612153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.618779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.625717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 2df7ed69-ddcd-49aa-bbcc-d78c0421af1e owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:09.631699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.635481 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] 10.222.0.48 "DELETE /v2.0/networks/a288e794-7129-48ec-b278-2ea8bf1fe00e HTTP/1.1" status: 204 len: 168 time: 0.4909430 Nov 24 04:15:09.647408 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2262bb-3d89-4d8e-ab2d-e8bb8fd72019 tempest-PortsTestJSON-432053255 tempest-PortsTestJSON-432053255-project] Pushing event deleted for resources: {'Network': ['ID=a288e794-7129-48ec-b278-2ea8bf1fe00e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:09.681637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c848f8f1-c896-466b-9923-455ce5c662d6 None None] Provisioning complete for port 2df7ed69-ddcd-49aa-bbcc-d78c0421af1e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:09.682022 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c848f8f1-c896-466b-9923-455ce5c662d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.715664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c848f8f1-c896-466b-9923-455ce5c662d6 None None] Port 2df7ed69-ddcd-49aa-bbcc-d78c0421af1e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:09.819025 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:09.846682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=2df7ed69-ddcd-49aa-bbcc-d78c0421af1e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:09.902257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35370) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:09.941873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.003698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 45a441c0-edd7-4702-b94f-f2ff19ae82d4 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:15:10.062770 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ddabd412-b5c5-4959-8f65-1a4a6198d0eb admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=b1bda997a7f64c3885e8ed4cd7b28f2f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1587975 Nov 24 04:15:10.064992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35374) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:10.119922 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.137851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:10.147413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89b731e2-6963-4183-9b54-abebed676195 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.154882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'port_id': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'mac_address': 'fa:16:3e:f2:a8:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 152, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:15:10.173474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89b731e2-6963-4183-9b54-abebed676195 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.196892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.211696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45a441c0-edd7-4702-b94f-f2ff19ae82d4 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:15:10.230409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89b731e2-6963-4183-9b54-abebed676195 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.233385 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89b731e2-6963-4183-9b54-abebed676195 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.234393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:10.235286 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-89b731e2-6963-4183-9b54-abebed676195 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/16fb3cce-8746-4113-8285-e490ab03bd0e HTTP/1.1" status: 204 len: 168 time: 0.1691952 Nov 24 04:15:10.242808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.249904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b731e2-6963-4183-9b54-abebed676195 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16fb3cce-8746-4113-8285-e490ab03bd0e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:10.306348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=45a441c0-edd7-4702-b94f-f2ff19ae82d4,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:10.435812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router bf9bd32b-63d2-4dca-9608-1d504f99c603 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:10.464092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de69d97c-1d37-45c4-8dd2-1b7c3fd33ec3 req-f1bc813a-747e-4565-8579-16a7b5d796cc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:10.466675 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-de69d97c-1d37-45c4-8dd2-1b7c3fd33ec3 req-f1bc813a-747e-4565-8579-16a7b5d796cc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 944 time: 0.0729496 Nov 24 04:15:10.473610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['45a441c0-edd7-4702-b94f-f2ff19ae82d4'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:15:10.552270 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:10.560585 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca88cda6-7584-4f1f-bd51-6f5788e5e46c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/bf9bd32b-63d2-4dca-9608-1d504f99c603/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9649591 Nov 24 04:15:10.564286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35380) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:10.565172 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] Sync routers for ids ['bf9bd32b-63d2-4dca-9608-1d504f99c603'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:10.579165 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] Routers {'bf9bd32b-63d2-4dca-9608-1d504f99c603'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:10.579720 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['bf9bd32b-63d2-4dca-9608-1d504f99c603'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:10.593849 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-cad48562-6462-4f26-8fc9-337dabc246b5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=bf9bd32b-63d2-4dca-9608-1d504f99c603 HTTP/1.1" status: 200 len: 205 time: 0.0284946 Nov 24 04:15:10.594064 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-de69d97c-1d37-45c4-8dd2-1b7c3fd33ec3 req-1912db9c-c993-4a89-aa44-e53e6fb9eaa8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0896862 Nov 24 04:15:10.594468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35382) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:10.628724 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:10.638796 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] Routers {'bf9bd32b-63d2-4dca-9608-1d504f99c603'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:10.639405 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['bf9bd32b-63d2-4dca-9608-1d504f99c603'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:10.668780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.673486 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:10.674215 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac39c4f9-dad6-4487-afb8-14311c581a66 None None] The sync data for ids ['bf9bd32b-63d2-4dca-9608-1d504f99c603'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:10.827569 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.829700 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.855474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.872407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.872920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router bf9bd32b-63d2-4dca-9608-1d504f99c603 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:10.880860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.882007 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e4f3beb6-0b42-4106-b7a6-841e2f0fca1f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/bf9bd32b-63d2-4dca-9608-1d504f99c603 HTTP/1.1" status: 204 len: 168 time: 0.2865567 Nov 24 04:15:10.884760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35384) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:10.936218 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet eb81f251-4e12-4f7c-817e-c211acff608f {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:10.939561 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:10.987736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.070565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.127116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.157298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=eb81f251-4e12-4f7c-817e-c211acff608f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:11.160774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.164013 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b5d3d4a9-4fb1-4518-98c9-dc49d4cde8f9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/eb81f251-4e12-4f7c-817e-c211acff608f HTTP/1.1" status: 204 len: 168 time: 0.2782645 Nov 24 04:15:11.166542 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35386) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:11.168360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d56428d-d80d-4506-a04b-2510eed8860d None None] Network eea2cba5-dd2e-4dbc-99a1-67de75200d88 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:11.241578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.294457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port e7ebd619-e967-45a4-97b4-8a814795be0f {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:11.295060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.349600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] DHCP port deletion for eea2cba5-dd2e-4dbc-99a1-67de75200d88 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:11.361996 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port e7ebd619-e967-45a4-97b4-8a814795be0f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7ebd619-e967-45a4-97b4-8a814795be0f,segment=NetworkSegment(8b495893-2e31-46c6-932c-b7aa065eeb95),segment_id=8b495893-2e31-46c6-932c-b7aa065eeb95)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:11.362391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.380779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for e7ebd619-e967-45a4-97b4-8a814795be0f owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:11.396916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] Deleting port e7ebd619-e967-45a4-97b4-8a814795be0f {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:11.397302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.458411 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.459777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] For port e7ebd619-e967-45a4-97b4-8a814795be0f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e7ebd619-e967-45a4-97b4-8a814795be0f,segment=NetworkSegment(8b495893-2e31-46c6-932c-b7aa065eeb95),segment_id=8b495893-2e31-46c6-932c-b7aa065eeb95)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:11.460447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.472769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] Calling delete_port for e7ebd619-e967-45a4-97b4-8a814795be0f owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:11.485326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=e7ebd619-e967-45a4-97b4-8a814795be0f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:11.487208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port e7ebd619-e967-45a4-97b4-8a814795be0f on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:11.556028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.582113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] Pushing event deleted for resources: {'Port': ['ID=e7ebd619-e967-45a4-97b4-8a814795be0f,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:11.585555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e807f009-3733-4215-aa5e-b61358fb68b5 None None] No DVR routers for this DVR port e7ebd619-e967-45a4-97b4-8a814795be0f on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:11.843779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.871527 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eea2cba5-dd2e-4dbc-99a1-67de75200d88']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:11.888523 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d2426e-48ce-405f-81f2-59c5d7d43a3e req-38eb7833-b23a-4ad2-af6e-9292ff8c3f67 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:11.890023 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-04d2426e-48ce-405f-81f2-59c5d7d43a3e req-38eb7833-b23a-4ad2-af6e-9292ff8c3f67 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 944 time: 0.1080110 Nov 24 04:15:11.891647 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b495893-2e31-46c6-932c-b7aa065eeb95') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:11.891943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b495893-2e31-46c6-932c-b7aa065eeb95') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:11.907433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.929229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.941365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 171 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:11.941959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:11.944618 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:12.003777 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-04d2426e-48ce-405f-81f2-59c5d7d43a3e req-9860c6d1-4074-4428-9fbe-78688536968d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1053905 Nov 24 04:15:12.015936 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.019339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 45a441c0-edd7-4702-b94f-f2ff19ae82d4 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:12.021172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.026853 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/eea2cba5-dd2e-4dbc-99a1-67de75200d88 HTTP/1.1" status: 204 len: 168 time: 0.8593283 Nov 24 04:15:12.031422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35390) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:12.038951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-106759076', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:12.045601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f75d133-918d-4795-9b5f-dbaf0c4213ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=eea2cba5-dd2e-4dbc-99a1-67de75200d88,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:12.062120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.063579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.072961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:15:12.077515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:12.077890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.122557 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.133535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.172349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.194849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:15:12.197124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-509daeed-94b8-4ece-8aa3-999e26cdcd44" -d '{"events": [{"server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "name": "network-vif-plugged", "status": "completed", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:15:12.209981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:12.216853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.240385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:15:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a680fa17-edc8-4446-9fd8-9d8dd763e996 x-openstack-request-id: req-a680fa17-edc8-4446-9fd8-9d8dd763e996 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:15:12.240679 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "name": "network-vif-plugged", "status": "completed", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:15:12.240933 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-a680fa17-edc8-4446-9fd8-9d8dd763e996 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:15:12.241322 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'code': 200} Nov 24 04:15:12.260358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.270882 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=45a441c0-edd7-4702-b94f-f2ff19ae82d4,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:12.457016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.462195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b3ea9bd-ea4c-4925-b478-0f8fb2303176 req-abc8573e-e757-4fbd-8f14-b32cfbb27627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:12.463703 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-2b3ea9bd-ea4c-4925-b478-0f8fb2303176 req-abc8573e-e757-4fbd-8f14-b32cfbb27627 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 1098 time: 0.0450330 Nov 24 04:15:12.475822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.518517 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-2b3ea9bd-ea4c-4925-b478-0f8fb2303176 req-779b6c46-211d-41b1-9b24-1884f1bfca63 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463383 Nov 24 04:15:12.576176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 172.26.5.200 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/dcb75fb9-009a-4adf-adcf-334d92bb5dd6) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:12.678897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.712348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.748316 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:12.753176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:12.755618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:12.767150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f0e8bbe-3d85-421f-99df-0afc9a6ff177 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:12.789488 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=dcb75fb9-009a-4adf-adcf-334d92bb5dd6,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:12.863514 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-8760c216-887f-4846-87b1-d669c74a61b1 None None] Provisioning complete for port dcb75fb9-009a-4adf-adcf-334d92bb5dd6 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:12.863912 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8760c216-887f-4846-87b1-d669c74a61b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:12.903810 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-8760c216-887f-4846-87b1-d669c74a61b1 None None] Port dcb75fb9-009a-4adf-adcf-334d92bb5dd6 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:12.939542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7ebd619-e967-45a4-97b4-8a814795be0f no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:12.965854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e7ebd619-e967-45a4-97b4-8a814795be0f {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:12.966083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e7ebd619-e967-45a4-97b4-8a814795be0f not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:13.028294 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:13.119134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae059f97-0fe5-49ae-94cc-fe646cc61750 req-9d39a2db-168b-40ef-8c65-d1466864a831 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:13.120769 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ae059f97-0fe5-49ae-94cc-fe646cc61750 req-9d39a2db-168b-40ef-8c65-d1466864a831 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 945 time: 0.0491352 Nov 24 04:15:13.170225 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ae059f97-0fe5-49ae-94cc-fe646cc61750 req-33be154f-cf5b-4d64-baca-f320ffb64ebb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432248 Nov 24 04:15:13.224718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:13.348505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 3f826730-f72e-48ae-9805-c87a8e2d96fe is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:15:13.454571 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:13.465131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] Sync routers for ids ['3f826730-f72e-48ae-9805-c87a8e2d96fe'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:13.476410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] Routers {'3f826730-f72e-48ae-9805-c87a8e2d96fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:13.476960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f826730-f72e-48ae-9805-c87a8e2d96fe'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:13.479654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:13.481293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-235dd9d9-75ac-4a71-9d57-1bfcc1275987 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 1.4487464 Nov 24 04:15:13.483945 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35396) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:13.510206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:13.520472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] Routers {'3f826730-f72e-48ae-9805-c87a8e2d96fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:13.521079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f826730-f72e-48ae-9805-c87a8e2d96fe'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:13.603864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35398) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:13.604154 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-77979bfa-f508-4815-9edb-1ea7c35ada45 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/routers/3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 200 len: 884 time: 0.1184018 Nov 24 04:15:13.697392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:13.698044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e376506c-4ed5-4428-9e9f-152e738c64de None None] The sync data for ids ['3f826730-f72e-48ae-9805-c87a8e2d96fe'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:13.836613 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ca50c872-02a6-4ae7-80a2-c973fa918fdf tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 887 time: 0.2296553 Nov 24 04:15:13.837250 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35400) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:13.841463 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-106759076'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:14.132223 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:14.142774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:14.535715 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 3f826730-f72e-48ae-9805-c87a8e2d96fe has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:14.547732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30adc9f3-bee2-4af6-a513-f922e50ec033 req-d7998a65-11dd-4c3d-b520-7dd4e236325d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:14.549201 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-30adc9f3-bee2-4af6-a513-f922e50ec033 req-d7998a65-11dd-4c3d-b520-7dd4e236325d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 945 time: 0.0700753 Nov 24 04:15:14.670695 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-30adc9f3-bee2-4af6-a513-f922e50ec033 req-cdc36dd2-7af6-4f43-a8f5-db97984d298d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1150665 Nov 24 04:15:14.689049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:14.695734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:14.696893 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3e54d895-e4a2-459c-aa82-bbda5a8e6dbc tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 200 len: 891 time: 0.8587365 Nov 24 04:15:14.699698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35406) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:14.701793 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] Sync routers for ids ['3f826730-f72e-48ae-9805-c87a8e2d96fe'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:14.713589 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] Routers {'3f826730-f72e-48ae-9805-c87a8e2d96fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:14.714213 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f826730-f72e-48ae-9805-c87a8e2d96fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:14.751954 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:14.763406 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] Routers {'3f826730-f72e-48ae-9805-c87a8e2d96fe'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:14.763998 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3f826730-f72e-48ae-9805-c87a8e2d96fe'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:14.789779 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56725265-a941-4a9b-8cf7-b6b4c3dd6609 req-9a24d0d7-1540-485d-b3e2-384953ba96e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:14.791325 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-56725265-a941-4a9b-8cf7-b6b4c3dd6609 req-9a24d0d7-1540-485d-b3e2-384953ba96e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 945 time: 0.0523479 Nov 24 04:15:14.795986 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:14.796632 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a74bf88d-5339-48d6-ae35-232b56055699 None None] The sync data for ids ['3f826730-f72e-48ae-9805-c87a8e2d96fe'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:14.815483 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-af0dd154-39bf-4aba-a2e5-0267c66f6f4a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/routers/3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 200 len: 891 time: 0.1141181 Nov 24 04:15:14.817562 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35408) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:14.850027 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ebc64530-3e51-4145-8d6c-65754a5c7250 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 200 len: 205 time: 0.0313339 Nov 24 04:15:14.852491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35410) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:14.868670 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-56725265-a941-4a9b-8cf7-b6b4c3dd6609 req-c35aa61f-aafa-49ab-91fd-fde97b00ce75 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700161 Nov 24 04:15:14.890368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35412) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:14.934034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-986b2944-7915-42fd-abf0-6363e12b5e6e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:14.936084 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-986b2944-7915-42fd-abf0-6363e12b5e6e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 1093 time: 0.0436449 Nov 24 04:15:14.938920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35414) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:14.943232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address': '172.20.0.8'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:14.959873 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:14.967687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.064733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.068748 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.115967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port dcb75fb9-009a-4adf-adcf-334d92bb5dd6 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:15.116301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.198827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.211009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for dcb75fb9-009a-4adf-adcf-334d92bb5dd6 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:15.212942 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.189 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/1d119c6f-4c97-40f0-9f66-69256f1b2a87) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:15.318550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.351922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.376666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.388774 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:15.395953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:15.398594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:15.403033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=dcb75fb9-009a-4adf-adcf-334d92bb5dd6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:15.417384 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74f016c7-2e88-4866-b611-d51977410867 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:15.435490 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=1d119c6f-4c97-40f0-9f66-69256f1b2a87,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:15.448710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.449076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.449422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.449765 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.450104 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.450471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.450810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.451144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.451480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.451814 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.452146 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.452813 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:15.464900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.557594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.559777 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.604903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.605394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router 3f826730-f72e-48ae-9805-c87a8e2d96fe {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:15.612779 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.617318 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b307896-3a6f-4ed0-9b2c-1455ab4dd9b8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 204 len: 168 time: 0.7599490 Nov 24 04:15:15.617318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35416) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:15.622551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-933349217'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:15.644172 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:15.647721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.670498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 195, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:15.679452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.679877 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 32e92489-7b83-4904-b785-7273b155118a of type vlan for network 818951db-b4d1-430d-9edf-c256c83751e3 Nov 24 04:15:15.726592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.751240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.756719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:15.757507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:15.796183 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1776855 Nov 24 04:15:15.801282 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35418) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:15.815670 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '818951db-b4d1-430d-9edf-c256c83751e3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:15.828346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c170b90-c710-463a-a721-accd09792bf0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=818951db-b4d1-430d-9edf-c256c83751e3,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:15.838242 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 818951db-b4d1-430d-9edf-c256c83751e3 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:15.988954 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.061019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:16.065179 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.159250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.373036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.430387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.439850 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.478362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=3dd19467-963b-4885-9c50-0108d4f786cf,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:16.520030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '32e92489-7b83-4904-b785-7273b155118a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '818951db-b4d1-430d-9edf-c256c83751e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:16.520392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 818951db-b4d1-430d-9edf-c256c83751e3, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:16.527820 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=1d119c6f-4c97-40f0-9f66-69256f1b2a87,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:16.549482 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.552210 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 818951db-b4d1-430d-9edf-c256c83751e3 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:16.597793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 818951db-b4d1-430d-9edf-c256c83751e3) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:16.603986 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:16.605007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.614429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ff9f546-7448-4e48-bade-fbcf93a9188e None None] Network 818951db-b4d1-430d-9edf-c256c83751e3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:16.654373 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a146067b-746c-4e93-962f-c2f146bb5356 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8520029 Nov 24 04:15:16.657829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35420) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:16.663121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-824668801', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:16.667825 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP 66c2cbfa-c6dc-4450-89c5-0378168c210b associated. External IP: 172.26.5.189, port: 45a441c0-edd7-4702-b94f-f2ff19ae82d4. Nov 24 04:15:16.688950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.690119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.744864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.750558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.771219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-818951db-b4d1-430d-9edf-c256c83751e3', 'network_id': '818951db-b4d1-430d-9edf-c256c83751e3', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '3dd19467-963b-4885-9c50-0108d4f786cf'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:16.772148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.776630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:16.780572 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-04201f8d-ec32-4b65-b570-c7e1074c0d6d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.1191621 Nov 24 04:15:16.780971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35422) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:16.926361 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Allocated IP 2001:db8::2 (818951db-b4d1-430d-9edf-c256c83751e3/3dd19467-963b-4885-9c50-0108d4f786cf/bdddb217-e342-4032-ab4b-9628f0a08cd8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:17.075803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.077216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.083674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.123575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Network 818951db-b4d1-430d-9edf-c256c83751e3 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:17.126952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:17.130440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:17.137947 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Pushing event updated for resources: {'Port': ['ID=bdddb217-e342-4032-ab4b-9628f0a08cd8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:17.160812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 3fa77305-8276-4287-a9eb-5efe6a409e17 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:17.168303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.168886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.169631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.169883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.170098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.170438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.170936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.171332 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.171594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.172123 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.172439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.172762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.201535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Attempting to bind port bdddb217-e342-4032-ab4b-9628f0a08cd8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:17.201902 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Attempting to bind port bdddb217-e342-4032-ab4b-9628f0a08cd8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '32e92489-7b83-4904-b785-7273b155118a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '818951db-b4d1-430d-9edf-c256c83751e3'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:17.202289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Attempting to bind port bdddb217-e342-4032-ab4b-9628f0a08cd8 on network 818951db-b4d1-430d-9edf-c256c83751e3 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:17.207920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:17.208446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Checking segment: {'id': '32e92489-7b83-4904-b785-7273b155118a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '818951db-b4d1-430d-9edf-c256c83751e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:17.208845 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.209229 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Bound using segment: {'id': '32e92489-7b83-4904-b785-7273b155118a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '818951db-b4d1-430d-9edf-c256c83751e3'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:17.209687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Bound port: bdddb217-e342-4032-ab4b-9628f0a08cd8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32e92489-7b83-4904-b785-7273b155118a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': '818951db-b4d1-430d-9edf-c256c83751e3'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:17.210062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.271915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] For port bdddb217-e342-4032-ab4b-9628f0a08cd8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:17.275908 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] For port bdddb217-e342-4032-ab4b-9628f0a08cd8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=bdddb217-e342-4032-ab4b-9628f0a08cd8,segment=NetworkSegment(32e92489-7b83-4904-b785-7273b155118a),segment_id=32e92489-7b83-4904-b785-7273b155118a)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:17.281131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.290793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:17.307474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] Sync routers for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:17.311405 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.335598 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:17.336137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:17.347791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8::1 (818951db-b4d1-430d-9edf-c256c83751e3/3dd19467-963b-4885-9c50-0108d4f786cf/4fccbb51-df9c-4020-9e19-d99096b4c125) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:17.355798 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9100aba2-024e-4eb4-b6ea-dad16e419d89 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4143343 Nov 24 04:15:17.357252 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35424) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:17.357749 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:15:17.361158 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45831637-aa8a-4d83-b2e2-892416f4e321" -d '{"events": [{"name": "network-changed", "server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:15:17.386056 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:15:17.395525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505d426d-5910-4a24-957a-18bab93f3f61 None None] Pushing event updated for resources: {'Port': ['ID=bdddb217-e342-4032-ab4b-9628f0a08cd8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:17.436221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:15:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce6d05f1-2fe3-4357-9a3d-d835eb31bd62 x-openstack-request-id: req-ce6d05f1-2fe3-4357-9a3d-d835eb31bd62 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:15:17.436521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:15:17.436781 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-ce6d05f1-2fe3-4357-9a3d-d835eb31bd62 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:15:17.437198 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'status': 'completed', 'code': 200} Nov 24 04:15:17.483131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:17.499371 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-72734233-714b-4f06-8cf7-52657821d880 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/66c2cbfa-c6dc-4450-89c5-0378168c210b HTTP/1.1" status: 200 len: 991 time: 0.1347260 Nov 24 04:15:17.514169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-b4e678df-c155-42b3-9b5c-041119cd505e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:17.516016 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-b4e678df-c155-42b3-9b5c-041119cd505e service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 1098 time: 0.0606606 Nov 24 04:15:17.524022 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.587219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.652701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-fadc750e-9d6d-4294-bb67-53a0ef7f2250 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:17.655320 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-fadc750e-9d6d-4294-bb67-53a0ef7f2250 service neutron] 10.222.0.21 "GET /v2.0/networks?id=38418e10-00b7-4e21-8d7a-91bfeb87756f HTTP/1.1" status: 200 len: 898 time: 0.1317391 Nov 24 04:15:17.665257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 818951db-b4d1-430d-9edf-c256c83751e3 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:17.669500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:17.672280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=4fccbb51-df9c-4020-9e19-d99096b4c125,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:17.674646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:17.675170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.715638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.715982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.716325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.716666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.717001 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.717338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.717667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.717991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.718341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.719211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.719541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.719864 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:17.751968 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-12ed9c13-560f-4812-aa8b-524b6aeb6a2c service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4 HTTP/1.1" status: 200 len: 999 time: 0.0874805 Nov 24 04:15:17.810055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-bae7daf7-e6fe-470d-a79d-fdba75f90dec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:17.811850 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-bae7daf7-e6fe-470d-a79d-fdba75f90dec service neutron] 10.222.0.21 "GET /v2.0/subnets?id=f2125981-3937-4d3b-9f58-7dca17c52922 HTTP/1.1" status: 200 len: 835 time: 0.0538509 Nov 24 04:15:17.815017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:17.816988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '66c2cbfa-c6dc-4450-89c5-0378168c210b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.189', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'port_id': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1279, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'mac_address': 'fa:16:3e:f2:a8:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:15:15Z', 'updated_at': '2021-11-24T04:15:15Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:02Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:17.843173 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] Checking router: 3fa77305-8276-4287-a9eb-5efe6a409e17 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:17.852926 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:17.853530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:17.865205 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-0c5d07bf-aaa3-454b-a7e3-479f49683bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:17.866910 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-0c5d07bf-aaa3-454b-a7e3-479f49683bd2 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=38418e10-00b7-4e21-8d7a-91bfeb87756f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0462203 Nov 24 04:15:17.967832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:17.971848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-56305378-0dba-4eb8-9c73-b54e2a2a54c7 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0967643 Nov 24 04:15:18.066184 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45831637-aa8a-4d83-b2e2-892416f4e321 req-8d93a891-4515-4815-9a59-525379f3cf73 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877404 Nov 24 04:15:18.103336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.107993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.108856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.183632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=4fccbb51-df9c-4020-9e19-d99096b4c125,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:18.216000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '66c2cbfa-c6dc-4450-89c5-0378168c210b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.189', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'port_id': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1279, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'mac_address': 'fa:16:3e:f2:a8:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:15:15Z', 'updated_at': '2021-11-24T04:15:15Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:02Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:18.245431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ece14d0a-b36b-48fc-b634-22e8c31e4923 None None] The sync data for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv is: [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '66c2cbfa-c6dc-4450-89c5-0378168c210b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.189', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'port_id': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1279, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'mac_address': 'fa:16:3e:f2:a8:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:15:15Z', 'updated_at': '2021-11-24T04:15:15Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:02Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:18.249877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 818951db-b4d1-430d-9edf-c256c83751e3 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:18.251447 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:18.380149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:15:18.471117 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-221a7900-d208-4179-b609-d67797ead830 None None] New status for floating IP 66c2cbfa-c6dc-4450-89c5-0378168c210b: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:15:18.484160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0756d97-6ae5-4788-9ce2-1adba589e05a None None] Network 818951db-b4d1-430d-9edf-c256c83751e3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:18.487483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:18.492677 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f8d903b0-795d-4d5f-8de6-8f4d70587a65 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/6ff1a90e-7325-4ba8-8912-ffed3e3c3d12/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7099550 Nov 24 04:15:18.495308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35428) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:18.498287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] Sync routers for ids ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:18.501500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35430) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:18.546374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] Routers {'6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:18.547281 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a88017ed-322a-4794-9352-782f31f9d2c7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:18.547463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:18.549522 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a88017ed-322a-4794-9352-782f31f9d2c7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports/4fccbb51-df9c-4020-9e19-d99096b4c125 HTTP/1.1" status: 200 len: 911 time: 0.0527260 Nov 24 04:15:18.552616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35432) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:18.557900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '3dd19467-963b-4885-9c50-0108d4f786cf'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:18.586234 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f52b8bd3-4fcf-4c24-bf1f-37ba2b2584f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/66c2cbfa-c6dc-4450-89c5-0378168c210b HTTP/1.1" status: 200 len: 991 time: 0.0822539 Nov 24 04:15:18.596654 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:18.629720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3eba6100-3d91-4dd8-a7ee-6e0a229809bc None None] Provisioning complete for port bdddb217-e342-4032-ab4b-9628f0a08cd8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:18.630034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3eba6100-3d91-4dd8-a7ee-6e0a229809bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.631530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] Routers {'6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:18.632234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:18.709377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:18.710044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c101f7e-f331-4ab1-b8f3-87af962d6b92 None None] The sync data for ids ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:18.718125 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.802029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3eba6100-3d91-4dd8-a7ee-6e0a229809bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.835555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-3eba6100-3d91-4dd8-a7ee-6e0a229809bc None None] For port bdddb217-e342-4032-ab4b-9628f0a08cd8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=bdddb217-e342-4032-ab4b-9628f0a08cd8,segment=NetworkSegment(32e92489-7b83-4904-b785-7273b155118a),segment_id=32e92489-7b83-4904-b785-7273b155118a)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:18.840006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3eba6100-3d91-4dd8-a7ee-6e0a229809bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:18.894461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eba6100-3d91-4dd8-a7ee-6e0a229809bc None None] Pushing event updated for resources: {'Port': ['ID=bdddb217-e342-4032-ab4b-9628f0a08cd8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:19.004366 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device bdddb217-e342-4032-ab4b-9628f0a08cd8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:19.064248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port bdddb217-e342-4032-ab4b-9628f0a08cd8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:19.065050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.092574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6be4df45-b522-4426-b883-bed87a081991 None None] Provisioning complete for port bdddb217-e342-4032-ab4b-9628f0a08cd8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:19.092945 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6be4df45-b522-4426-b883-bed87a081991 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.107678 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.117234 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.124826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:19.126741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.128226 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/ports/4fccbb51-df9c-4020-9e19-d99096b4c125 HTTP/1.1" status: 200 len: 911 time: 0.5744402 Nov 24 04:15:19.131171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35434) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:19.186802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b089ac-9b7b-44a7-9f28-4972f9389231 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=4fccbb51-df9c-4020-9e19-d99096b4c125,revision_number=3']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:19.249708 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6be4df45-b522-4426-b883-bed87a081991 None None] Provisioning complete for port 4fccbb51-df9c-4020-9e19-d99096b4c125 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:19.250087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6be4df45-b522-4426-b883-bed87a081991 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.285230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6be4df45-b522-4426-b883-bed87a081991 None None] Port 4fccbb51-df9c-4020-9e19-d99096b4c125 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:19.410599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-621d3e59-12cf-45b4-aee6-161f8ef68b99 None None] Provisioning complete for port 4fccbb51-df9c-4020-9e19-d99096b4c125 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:19.410890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-621d3e59-12cf-45b4-aee6-161f8ef68b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.445286 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-621d3e59-12cf-45b4-aee6-161f8ef68b99 None None] Port 4fccbb51-df9c-4020-9e19-d99096b4c125 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:19.477723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.564136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1d5e105c-c877-4a9a-821a-6067479684cc None None] Provisioning complete for port 4fccbb51-df9c-4020-9e19-d99096b4c125 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:19.564645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1d5e105c-c877-4a9a-821a-6067479684cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:19.587639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35436) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:19.617898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-1d5e105c-c877-4a9a-821a-6067479684cc None None] Port 4fccbb51-df9c-4020-9e19-d99096b4c125 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:19.657851 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-af3b7169-72b8-4b29-bea4-6987f1c6ff2d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/66c2cbfa-c6dc-4450-89c5-0378168c210b HTTP/1.1" status: 200 len: 993 time: 0.0687919 Nov 24 04:15:20.031851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 4fccbb51-df9c-4020-9e19-d99096b4c125 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:20.032181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.115629 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.128267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 4fccbb51-df9c-4020-9e19-d99096b4c125 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:20.291730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.320417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=4fccbb51-df9c-4020-9e19-d99096b4c125,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:20.415714 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.569751 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:20.646660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:20.651576 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c4cd2535-6533-44d8-b21b-62b15650caf7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/6ff1a90e-7325-4ba8-8912-ffed3e3c3d12/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5191967 Nov 24 04:15:20.654262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35438) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:20.656607 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] Sync routers for ids ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:20.670048 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] Routers {'6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:20.670690 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:20.680701 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a6fcb3a9-8c77-4762-8565-a0984aa84ae4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 HTTP/1.1" status: 200 len: 205 time: 0.0253086 Nov 24 04:15:20.683036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35440) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:20.702244 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:20.711389 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] Routers {'6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:20.711976 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:20.743026 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:20.743664 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea56e8a-4459-4bbe-96f5-d287bebe98f4 None None] The sync data for ids ['6ff1a90e-7325-4ba8-8912-ffed3e3c3d12'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:20.757572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.916655 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.918911 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.946269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device bdddb217-e342-4032-ab4b-9628f0a08cd8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:20.963822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.964281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router 6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:20.971287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:20.975171 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8766e2d3-08df-46fc-ae03-f5dddc640757 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 HTTP/1.1" status: 204 len: 168 time: 0.2884681 Nov 24 04:15:20.975171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35442) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:20.998293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port bdddb217-e342-4032-ab4b-9628f0a08cd8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:20.998672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.026050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 3dd19467-963b-4885-9c50-0108d4f786cf {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:21.029329 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.073755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.154890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.210852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.244731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.248363 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/3dd19467-963b-4885-9c50-0108d4f786cf HTTP/1.1" status: 204 len: 168 time: 0.2723470 Nov 24 04:15:21.249481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e98211-76b3-440d-a4bf-20752f2b667b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=3dd19467-963b-4885-9c50-0108d4f786cf,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:21.250763 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d0a84cf-4a30-4897-bcd0-6c1b5adb0955 None None] Network 818951db-b4d1-430d-9edf-c256c83751e3 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:21.251688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35444) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:21.329938 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.382878 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port bdddb217-e342-4032-ab4b-9628f0a08cd8 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:21.383224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.416628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] DHCP port deletion for 818951db-b4d1-430d-9edf-c256c83751e3 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:21.452590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port bdddb217-e342-4032-ab4b-9628f0a08cd8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=bdddb217-e342-4032-ab4b-9628f0a08cd8,segment=NetworkSegment(32e92489-7b83-4904-b785-7273b155118a),segment_id=32e92489-7b83-4904-b785-7273b155118a)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:21.453147 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.465682 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for bdddb217-e342-4032-ab4b-9628f0a08cd8 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:21.466529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] Deleting port bdddb217-e342-4032-ab4b-9628f0a08cd8 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:21.466914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.527166 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] For port bdddb217-e342-4032-ab4b-9628f0a08cd8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=bdddb217-e342-4032-ab4b-9628f0a08cd8,segment=NetworkSegment(32e92489-7b83-4904-b785-7273b155118a),segment_id=32e92489-7b83-4904-b785-7273b155118a)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:21.527560 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.540293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] Calling delete_port for bdddb217-e342-4032-ab4b-9628f0a08cd8 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:21.543201 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.568424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=bdddb217-e342-4032-ab4b-9628f0a08cd8,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:21.572032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port bdddb217-e342-4032-ab4b-9628f0a08cd8 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:21.657247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.680143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['818951db-b4d1-430d-9edf-c256c83751e3']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:21.690043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32e92489-7b83-4904-b785-7273b155118a') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:21.690371 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32e92489-7b83-4904-b785-7273b155118a') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:21.700001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.713503 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.720437 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 195 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:21.720865 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:21.724077 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: from cryptography.utils import int_from_bytes Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: from cryptography.utils import int_from_bytes Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:15:21.758378 dv-neutron-819049-1-hyperv neutron-server[103382]: self.session.flush() Nov 24 04:15:21.763651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.785766 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.789076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] Pushing event deleted for resources: {'Port': ['ID=bdddb217-e342-4032-ab4b-9628f0a08cd8,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:21.790939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.792669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f9e011b-2175-47e6-8d91-a62399d0143e None None] No DVR routers for this DVR port bdddb217-e342-4032-ab4b-9628f0a08cd8 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:21.800379 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/818951db-b4d1-430d-9edf-c256c83751e3 HTTP/1.1" status: 204 len: 168 time: 0.5412910 Nov 24 04:15:21.800733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35446) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:21.805500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1132326115', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:21.823232 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f863493-01f3-498e-92bd-f57227588264 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=818951db-b4d1-430d-9edf-c256c83751e3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:21.831363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.832637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.883749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.887872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.905031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.906837 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a450682d-b0eb-4739-865c-5af094e15ff3 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.1045599 Nov 24 04:15:21.909517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35448) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:21.915105 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1461131917'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:21.935596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:21.938928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.962093 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 166, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:21.971392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:21.971753 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 94781c48-22d1-430a-9697-fbecc1a618ff of type vlan for network 7f92439f-8378-4f63-91b3-a644bb7cf187 Nov 24 04:15:22.012232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.038689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.044220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:22.044805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.085945 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.1749766 Nov 24 04:15:22.088548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35450) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:22.093251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:22.134361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb978b1-95dc-49d2-9cfe-c9d5fba9223a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=7f92439f-8378-4f63-91b3-a644bb7cf187,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:22.144695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:22.209323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:22.212927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.391632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.454322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=69691129-5818-4377-bdd6-3212ec5d848e,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:22.462972 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:22.463329 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 7f92439f-8378-4f63-91b3-a644bb7cf187, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:22.480425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:22.489190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 7f92439f-8378-4f63-91b3-a644bb7cf187) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:22.493193 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:22.493776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.498447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0abea7f6-51a9-43ec-b885-7ff2457ff2ae None None] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:22.511137 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b53a98d2-cec7-4bda-8629-e8b6e83e76ff tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4210446 Nov 24 04:15:22.513371 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35452) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:22.641320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-7f92439f-8378-4f63-91b3-a644bb7cf187', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:22.642248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.772213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Allocated IP 2001:db8::2 (7f92439f-8378-4f63-91b3-a644bb7cf187/69691129-5818-4377-bdd6-3212ec5d848e/55982f00-fe7b-45f3-8085-8ff923cc22b5) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:22.788341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.928955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.936049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:22.962301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device bdddb217-e342-4032-ab4b-9628f0a08cd8 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:22.998895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: bdddb217-e342-4032-ab4b-9628f0a08cd8 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:22.999236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device bdddb217-e342-4032-ab4b-9628f0a08cd8 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:23.003554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:23.007946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:23.009687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Pushing event updated for resources: {'Port': ['ID=55982f00-fe7b-45f3-8085-8ff923cc22b5,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:23.011849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:23.030054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8::1 (7f92439f-8378-4f63-91b3-a644bb7cf187/69691129-5818-4377-bdd6-3212ec5d848e/7cf06dc7-0729-4b75-ae1b-680f08a2eec1) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:23.065172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Attempting to bind port 55982f00-fe7b-45f3-8085-8ff923cc22b5 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:23.065540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Attempting to bind port 55982f00-fe7b-45f3-8085-8ff923cc22b5 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:23.065904 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Attempting to bind port 55982f00-fe7b-45f3-8085-8ff923cc22b5 on network 7f92439f-8378-4f63-91b3-a644bb7cf187 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:23.070913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:23.071285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Checking segment: {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:23.071682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.072075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Bound using segment: {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:23.072996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Bound port: 55982f00-fe7b-45f3-8085-8ff923cc22b5, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:23.072996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.133770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] For port 55982f00-fe7b-45f3-8085-8ff923cc22b5, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:23.136851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] For port 55982f00-fe7b-45f3-8085-8ff923cc22b5, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=55982f00-fe7b-45f3-8085-8ff923cc22b5,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:23.140924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.145523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.180307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.198601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13f7779-4d57-4444-af12-d58ff69fab65 None None] Pushing event updated for resources: {'Port': ['ID=55982f00-fe7b-45f3-8085-8ff923cc22b5,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:23.225049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:23.228112 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:23.231934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:23.232481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.271774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:23.354043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.632162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.636566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.637370 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:23.702298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:23.765912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:23.767342 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:23.884552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:15:23.975734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:23.983831 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9985f2ea-50d5-463b-aa2d-53db0577ec2c tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4662402 Nov 24 04:15:23.983831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35454) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:23.987306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:23.989135 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2127179402'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:24.004249 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:24.004871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:24.013283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:24.017006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.048838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:24.059964 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.060326 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment feaf85db-e887-4fd8-aa12-cd2459593c18 of type vlan for network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 Nov 24 04:15:24.092405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:24.103255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.129933 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.135820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:24.136417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.173805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29c3333f-4161-4d50-9168-64ed61a72556 None None] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:24.174478 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.1891966 Nov 24 04:15:24.177639 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35456) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:24.181931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:24.221919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30e03dd-c4b2-4032-911c-78950e7f7c24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=37cd34bf-4eaa-4b9e-8de8-6793ecf44447,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:24.256519 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:24.311079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e2033dc2-09a9-4889-8739-eeac653894fe None None] Provisioning complete for port 55982f00-fe7b-45f3-8085-8ff923cc22b5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:24.311453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e2033dc2-09a9-4889-8739-eeac653894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.566323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e2033dc2-09a9-4889-8739-eeac653894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.578183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:24.581981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.595047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:23Z', 'revision_number': 2, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:23Z', 'revision_number': 2, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:24.638174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:24.638526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Updating router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:15:24.641565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-e2033dc2-09a9-4889-8739-eeac653894fe None None] For port 55982f00-fe7b-45f3-8085-8ff923cc22b5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=55982f00-fe7b-45f3-8085-8ff923cc22b5,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:24.661975 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e2033dc2-09a9-4889-8739-eeac653894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.689537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.747050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2033dc2-09a9-4889-8739-eeac653894fe None None] Pushing event updated for resources: {'Port': ['ID=55982f00-fe7b-45f3-8085-8ff923cc22b5,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:24.783156 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.849089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=47d1091c-df73-405b-b47d-f124d67cec78,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:24.856670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:24.857170 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 37cd34bf-4eaa-4b9e-8de8-6793ecf44447, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:24.876750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:24.887795 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 37cd34bf-4eaa-4b9e-8de8-6793ecf44447) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:24.894291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:24.895168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:24.914128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c59ef624-d3e3-410e-b7b2-10dbb4aaf606 None None] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:24.916002 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-0f4db545-4e6f-4599-a586-8f5c72ad8e27 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.7367625 Nov 24 04:15:24.918407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35458) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:25.005816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-322de991-88e5-44f9-a2cf-db77a11d19c4 None None] Provisioning complete for port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:25.006348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-322de991-88e5-44f9-a2cf-db77a11d19c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.037234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 55982f00-fe7b-45f3-8085-8ff923cc22b5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:25.301576 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.309282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-322de991-88e5-44f9-a2cf-db77a11d19c4 None None] Port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:25.320470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.335494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.393215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-322de991-88e5-44f9-a2cf-db77a11d19c4 None None] Provisioning complete for port 55982f00-fe7b-45f3-8085-8ff923cc22b5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:25.393591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-322de991-88e5-44f9-a2cf-db77a11d19c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.453040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 55982f00-fe7b-45f3-8085-8ff923cc22b5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:25.453364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.463437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb569e7b-25cd-41f1-bd20-abcb854d20a5 None None] Pushing event updated for resources: {'Port': ['ID=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:25.524135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:25.525000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.570961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8:1::1 (37cd34bf-4eaa-4b9e-8de8-6793ecf44447/47d1091c-df73-405b-b47d-f124d67cec78/fc5fd07b-fea3-463e-bbbd-971ce3873cfb) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:25.603786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Attempting to bind port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:25.604238 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Attempting to bind port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:25.604540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Attempting to bind port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 on network 7f92439f-8378-4f63-91b3-a644bb7cf187 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:25.681728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:25.684077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Checking segment: {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:25.684077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.684077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Bound using segment: {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:25.684077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Bound port: 7cf06dc7-0729-4b75-ae1b-680f08a2eec1, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94781c48-22d1-430a-9697-fbecc1a618ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 166, 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:25.684077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.694495 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.733289 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.771319 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:25.776414 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:25.780019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:25.780554 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.818609 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:25.834829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Allocated IP 2001:db8:1::2 (37cd34bf-4eaa-4b9e-8de8-6793ecf44447/47d1091c-df73-405b-b47d-f124d67cec78/668b547d-9069-4b82-a319-1e82299cbe88) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:25.842080 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] For port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:25.852584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] For port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:25.861722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.900445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:25.931627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4c9d0ec1-3e2d-412d-aafd-bbc9210b4243 None None] Provisioning complete for port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:25.931999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4c9d0ec1-3e2d-412d-aafd-bbc9210b4243 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.018770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:26.019399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:26.025652 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb569e7b-25cd-41f1-bd20-abcb854d20a5 None None] Pushing event updated for resources: {'Port': ['ID=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:26.173374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.179170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.179967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.188420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:26.248093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4c9d0ec1-3e2d-412d-aafd-bbc9210b4243 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.248394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:26.263179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.308672 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:26.310115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:26.318754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.378389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4c9d0ec1-3e2d-412d-aafd-bbc9210b4243 None None] For port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:26.415901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:26.417154 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:26.420129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4c9d0ec1-3e2d-412d-aafd-bbc9210b4243 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.431031 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:26.437631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:26.441941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Pushing event updated for resources: {'Port': ['ID=668b547d-9069-4b82-a319-1e82299cbe88,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:26.582344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9d0ec1-3e2d-412d-aafd-bbc9210b4243 None None] Pushing event updated for resources: {'Port': ['ID=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:26.588790 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Attempting to bind port 668b547d-9069-4b82-a319-1e82299cbe88 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:26.589187 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Attempting to bind port 668b547d-9069-4b82-a319-1e82299cbe88 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:26.589557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Attempting to bind port 668b547d-9069-4b82-a319-1e82299cbe88 on network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:26.600170 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:26.600569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Checking segment: {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:26.600948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.601345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Bound using segment: {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:26.601830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Bound port: 668b547d-9069-4b82-a319-1e82299cbe88, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:26.602267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.604310 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-588ba972-1846-4cf9-b2b9-f26685179b5f None None] Provisioning complete for port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:26.604616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-588ba972-1846-4cf9-b2b9-f26685179b5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.714108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:25Z', 'revision_number': 3, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:25Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:25Z', 'revision_number': 1, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:26.754927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-224d210a-66b9-4d20-b0d8-9c958705459e None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:25Z', 'revision_number': 3, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:25Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:25Z', 'revision_number': 1, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:26.781400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] For port 668b547d-9069-4b82-a319-1e82299cbe88, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:26.800492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] For port 668b547d-9069-4b82-a319-1e82299cbe88, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=668b547d-9069-4b82-a319-1e82299cbe88,segment=NetworkSegment(feaf85db-e887-4fd8-aa12-cd2459593c18),segment_id=feaf85db-e887-4fd8-aa12-cd2459593c18)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:26.806024 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.811648 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:26.821716 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c25f784d-480a-4c34-a3b4-409a3db24db0 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9014707 Nov 24 04:15:26.824791 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35460) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:26.829967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-486761128'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:26.856251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:26.860827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.871730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee772d81-5765-45b2-874f-df33666bda70 None None] Pushing event updated for resources: {'Port': ['ID=668b547d-9069-4b82-a319-1e82299cbe88,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:26.888857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 164, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:26.900787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:26.901386 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 51ab971f-0ff0-40f6-91fa-0f3b895f8b18 of type vlan for network 7ac4223f-0e7f-42ee-962a-ce583a104284 Nov 24 04:15:26.956372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.006456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.013103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:27.013729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.057757 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2317560 Nov 24 04:15:27.060967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35462) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:27.068435 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:27.116858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a9d5ba7-a726-4d09-b8d7-f1d643a3b29b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=7ac4223f-0e7f-42ee-962a-ce583a104284,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:27.145553 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:27.206751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:27.211222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.415247 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.490130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=ac2c4331-99c7-4d2a-accb-9c963cb6ef3d,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:27.501738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:27.502102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: 7ac4223f-0e7f-42ee-962a-ce583a104284, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:27.522136 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:27.531843 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 7ac4223f-0e7f-42ee-962a-ce583a104284) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:27.536615 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:27.537228 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.541262 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0902f823-5b36-44ef-8ad8-a0eaeb8c8efb None None] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:27.557666 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-12a082f2-43e2-4b08-89f4-341ee863453b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.4952214 Nov 24 04:15:27.560504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35464) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:27.897463 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-7ac4223f-0e7f-42ee-962a-ce583a104284', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:27.898787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:27.975043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.041157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81200afc-a23f-44da-a35a-244c0e11e5f9 None None] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:28.124028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-b8252cf0-638d-4f4f-a6ef-76c14b6d2ba8 None None] Provisioning complete for port 668b547d-9069-4b82-a319-1e82299cbe88 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:28.125351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8252cf0-638d-4f4f-a6ef-76c14b6d2ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.152959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Allocated IP 2001:db8:2::2 (7ac4223f-0e7f-42ee-962a-ce583a104284/ac2c4331-99c7-4d2a-accb-9c963cb6ef3d/6a41f6e8-3f5f-4f29-abe1-402887a9a83c) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:28.414591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8252cf0-638d-4f4f-a6ef-76c14b6d2ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.437715 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.453487 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.499884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-b8252cf0-638d-4f4f-a6ef-76c14b6d2ba8 None None] For port 668b547d-9069-4b82-a319-1e82299cbe88, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=668b547d-9069-4b82-a319-1e82299cbe88,segment=NetworkSegment(feaf85db-e887-4fd8-aa12-cd2459593c18),segment_id=feaf85db-e887-4fd8-aa12-cd2459593c18)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:28.511171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8252cf0-638d-4f4f-a6ef-76c14b6d2ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.511400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8:2::1 (7ac4223f-0e7f-42ee-962a-ce583a104284/ac2c4331-99c7-4d2a-accb-9c963cb6ef3d/ec269bdd-0339-4dd4-af3f-77709fa00715) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:28.516096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:28.522584 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:28.525069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:28.528655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Pushing event updated for resources: {'Port': ['ID=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:28.621443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Attempting to bind port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:28.622104 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Attempting to bind port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:28.622275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Attempting to bind port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c on network 7ac4223f-0e7f-42ee-962a-ce583a104284 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:28.628897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8252cf0-638d-4f4f-a6ef-76c14b6d2ba8 None None] Pushing event updated for resources: {'Port': ['ID=668b547d-9069-4b82-a319-1e82299cbe88,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:28.633136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:28.633518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Checking segment: {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:28.633921 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.634329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Bound using segment: {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:28.634809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Bound port: 6a41f6e8-3f5f-4f29-abe1-402887a9a83c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:28.635193 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.658858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.707201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.707351 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] For port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:28.710987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] For port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:28.719721 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.752849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:28.755979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:28.759752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:28.760286 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.789210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3892706e-26e5-4f0f-9b3c-559c39f18ac6 None None] Provisioning complete for port 668b547d-9069-4b82-a319-1e82299cbe88 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:28.789706 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3892706e-26e5-4f0f-9b3c-559c39f18ac6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.821873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91bfcd2f-7e75-426c-a31e-91a62d5fc7b5 None None] Pushing event updated for resources: {'Port': ['ID=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:28.835235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=ec269bdd-0339-4dd4-af3f-77709fa00715,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:28.894328 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:28.900511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:28.920364 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:28.921287 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:28.947098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3892706e-26e5-4f0f-9b3c-559c39f18ac6 None None] Provisioning complete for port fc5fd07b-fea3-463e-bbbd-971ce3873cfb triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:28.947476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3892706e-26e5-4f0f-9b3c-559c39f18ac6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.019488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3892706e-26e5-4f0f-9b3c-559c39f18ac6 None None] Port fc5fd07b-fea3-463e-bbbd-971ce3873cfb cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:29.055403 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:29.106168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:29.230191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-49f9c141-0ef2-4fd3-80a3-3aeb7068177b None None] Provisioning complete for port fc5fd07b-fea3-463e-bbbd-971ce3873cfb triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:29.230564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-49f9c141-0ef2-4fd3-80a3-3aeb7068177b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.256548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:29.256930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.316037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-49f9c141-0ef2-4fd3-80a3-3aeb7068177b None None] Port fc5fd07b-fea3-463e-bbbd-971ce3873cfb cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:29.366415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.376272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.377093 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.385349 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:28Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:28Z', 'revision_number': 1, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 2, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:29.392863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 668b547d-9069-4b82-a319-1e82299cbe88 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:29.419380 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:29.419650 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Updating router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 port ec269bdd-0339-4dd4-af3f-77709fa00715 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:15:29.451931 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.456625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 668b547d-9069-4b82-a319-1e82299cbe88 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:29.457052 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.492397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=ec269bdd-0339-4dd4-af3f-77709fa00715,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:29.527454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:29.529175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:29.552736 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a652d98e-9f8f-486b-b536-88d490d08837 None None] Provisioning complete for port fc5fd07b-fea3-463e-bbbd-971ce3873cfb triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:29.553115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a652d98e-9f8f-486b-b536-88d490d08837 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.589949 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a652d98e-9f8f-486b-b536-88d490d08837 None None] Port fc5fd07b-fea3-463e-bbbd-971ce3873cfb cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:29.650330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:29.759713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:29.764886 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ffd79183-7b3c-4235-b612-d4afa9c8199a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2028294 Nov 24 04:15:29.767902 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35466) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:29.773750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1294849707'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:29.799326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:29.803083 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.817612 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.823991 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.832958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] vlan segment allocate from pool success with {'vlan_id': 169, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:29.844161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.844787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added segment 86a4c1a5-c436-4006-b3f2-37001fb20917 of type vlan for network f945a66c-3c93-40a8-9da1-69b90d32ebd9 Nov 24 04:15:29.875608 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Pushing event updated for resources: {'Port': ['ID=ec269bdd-0339-4dd4-af3f-77709fa00715,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:29.893545 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.902899 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.903948 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.904495 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.910135 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.910790 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.911338 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.911856 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.912389 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.912916 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.913302 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.913914 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.914468 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:15:29.926427 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.933322 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:29.934332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.949103 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Attempting to bind port ec269bdd-0339-4dd4-af3f-77709fa00715 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:29.949475 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Attempting to bind port ec269bdd-0339-4dd4-af3f-77709fa00715 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:29.949830 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Attempting to bind port ec269bdd-0339-4dd4-af3f-77709fa00715 on network 7ac4223f-0e7f-42ee-962a-ce583a104284 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:29.954998 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:29.955372 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Checking segment: {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:29.955770 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.957001 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Bound using segment: {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:29.957468 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Bound port: ec269bdd-0339-4dd4-af3f-77709fa00715, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51ab971f-0ff0-40f6-91fa-0f3b895f8b18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:29.958119 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:29.974335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35468) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:29.974582 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.2053721 Nov 24 04:15:29.981369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'subnet': {'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:30.018485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80d4eeac-e4a6-4165-ae91-db98df6a71f4 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Network': ['ID=f945a66c-3c93-40a8-9da1-69b90d32ebd9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:30.033282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:30.042525 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] For port ec269bdd-0339-4dd4-af3f-77709fa00715, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:30.047373 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] For port ec269bdd-0339-4dd4-af3f-77709fa00715, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ec269bdd-0339-4dd4-af3f-77709fa00715,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:30.053132 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.095511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Made reservation on behalf of fabef9b50edc4ad7a8072f36b9e15b43 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:30.099513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.101164 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd547a1b-9c12-40bb-8ad8-0146876bf0f4 None None] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:30.101407 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Updating router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 port fc5fd07b-fea3-463e-bbbd-971ce3873cfb binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:15:30.135916 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Pushing event updated for resources: {'Port': ['ID=ec269bdd-0339-4dd4-af3f-77709fa00715,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:30.143219 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.179074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-135e81cd-314f-41f1-9cce-1b2ec0c5b64d None None] Provisioning complete for port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:30.179550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-135e81cd-314f-41f1-9cce-1b2ec0c5b64d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.321403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.331598 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-135e81cd-314f-41f1-9cce-1b2ec0c5b64d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.373154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-135e81cd-314f-41f1-9cce-1b2ec0c5b64d None None] For port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:30.378754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-135e81cd-314f-41f1-9cce-1b2ec0c5b64d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.393328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Checking segment: {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:30.393851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network hostable DHCP agents. Network: f945a66c-3c93-40a8-9da1-69b90d32ebd9, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:30.409730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Subnet': ['ID=011464d7-db3f-45c9-be81-833a94cc7636,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:30.420705 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.426070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:30.427315 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.441363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-135e81cd-314f-41f1-9cce-1b2ec0c5b64d None None] Pushing event updated for resources: {'Port': ['ID=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:30.442851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, f945a66c-3c93-40a8-9da1-69b90d32ebd9) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:30.448588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:30.449746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.455506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4814b3bc-dc4a-47de-a7ed-2e927b152a2c None None] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:30.472550 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9c1d6ba8-bcfb-4126-9b7f-7c31b56eca33 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.4961531 Nov 24 04:15:30.475246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35470) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:30.486849 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Pushing event updated for resources: {'Port': ['ID=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:30.559810 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Attempting to bind port fc5fd07b-fea3-463e-bbbd-971ce3873cfb on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:30.560183 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Attempting to bind port fc5fd07b-fea3-463e-bbbd-971ce3873cfb by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:30.560784 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Attempting to bind port fc5fd07b-fea3-463e-bbbd-971ce3873cfb on network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:30.568344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:30.568720 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Checking segment: {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:30.569111 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.569503 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Bound using segment: {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:30.569962 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Bound port: fc5fd07b-fea3-463e-bbbd-971ce3873cfb, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'feaf85db-e887-4fd8-aa12-cd2459593c18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:30.570366 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.668720 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] For port fc5fd07b-fea3-463e-bbbd-971ce3873cfb, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:30.681069 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] For port fc5fd07b-fea3-463e-bbbd-971ce3873cfb, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,segment=NetworkSegment(feaf85db-e887-4fd8-aa12-cd2459593c18),segment_id=feaf85db-e887-4fd8-aa12-cd2459593c18)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:30.687212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:30.688838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.691389 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.754769 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:30.755398 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:30.869248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-67016966-e612-4f04-9fbb-554384208654 None None] Provisioning complete for port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:30.869554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-67016966-e612-4f04-9fbb-554384208654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:30.889436 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895d7960-395e-466f-91e0-3d4896e7bf21 None None] Pushing event updated for resources: {'Port': ['ID=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:30.945828 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:30.954915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Allocated IP 2001:db8:3::2 (f945a66c-3c93-40a8-9da1-69b90d32ebd9/011464d7-db3f-45c9-be81-833a94cc7636/8d8305bd-1e5f-45eb-be1e-a49a402d6d68) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:31.068240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.170623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6a41f6e8-3f5f-4f29-abe1-402887a9a83c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:31.186139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-67016966-e612-4f04-9fbb-554384208654 None None] Provisioning complete for port ec269bdd-0339-4dd4-af3f-77709fa00715 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:31.187472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-67016966-e612-4f04-9fbb-554384208654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.290831 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:28Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:30Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:30Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:31.323950 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca386ed4-a7a9-477f-a8da-77594fc61f56 None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:28Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:30Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:30Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:31.504050 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.516467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.540060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:31.540429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.585975 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Allocated IP 2001:db8:3::1 (f945a66c-3c93-40a8-9da1-69b90d32ebd9/011464d7-db3f-45c9-be81-833a94cc7636/f892111a-06cb-4b09-8ef0-9e87667ec966) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:31.624097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:31.631918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-67016966-e612-4f04-9fbb-554384208654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.632493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:31.635144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:31.640925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Pushing event updated for resources: {'Port': ['ID=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:31.722859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-67016966-e612-4f04-9fbb-554384208654 None None] For port ec269bdd-0339-4dd4-af3f-77709fa00715, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ec269bdd-0339-4dd4-af3f-77709fa00715,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:31.738094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-67016966-e612-4f04-9fbb-554384208654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.751468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.759279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Attempting to bind port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:31.759655 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Attempting to bind port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:31.760214 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Attempting to bind port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 on network f945a66c-3c93-40a8-9da1-69b90d32ebd9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:31.792588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:31.792971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Checking segment: {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:31.793372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.793764 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Bound using segment: {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:31.794275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Bound port: 8d8305bd-1e5f-45eb-be1e-a49a402d6d68, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:31.794658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.803441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.864516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:31.871705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:31.876188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67016966-e612-4f04-9fbb-554384208654 None None] Pushing event updated for resources: {'Port': ['ID=ec269bdd-0339-4dd4-af3f-77709fa00715,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:31.882677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:31.884215 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.910039 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Provisioning complete for port fc5fd07b-fea3-463e-bbbd-971ce3873cfb triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:31.910448 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:31.938076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] For port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:31.944030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=f892111a-06cb-4b09-8ef0-9e87667ec966,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:31.959469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] For port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,segment=NetworkSegment(86a4c1a5-c436-4006-b3f2-37001fb20917),segment_id=86a4c1a5-c436-4006-b3f2-37001fb20917)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:31.968738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.069730 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.087204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cfc58bf-e40d-4694-bd8a-5203f0b0981b None None] Pushing event updated for resources: {'Port': ['ID=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:32.101685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.143364 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] For port fc5fd07b-fea3-463e-bbbd-971ce3873cfb, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,segment=NetworkSegment(feaf85db-e887-4fd8-aa12-cd2459593c18),segment_id=feaf85db-e887-4fd8-aa12-cd2459593c18)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:32.150435 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.190331 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Provisioning complete for port ec269bdd-0339-4dd4-af3f-77709fa00715 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:32.191033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.236873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb31324b-2d01-4bf7-bd45-e5d63da73658 None None] Pushing event updated for resources: {'Port': ['ID=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:32.282814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:32.307116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:32.307749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:32.407731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:32.422504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.427207 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.428033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.496719 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5cea0c54-4550-41ad-a867-7aaf867c14f1 None None] Provisioning complete for port ec269bdd-0339-4dd4-af3f-77709fa00715 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:32.496719 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5cea0c54-4550-41ad-a867-7aaf867c14f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.696374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f892111a-06cb-4b09-8ef0-9e87667ec966', 'name': '', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:6f:fc:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1306, 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:31Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 1, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '011464d7-db3f-45c9-be81-833a94cc7636', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:32.723451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:32.723808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Updating router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 port f892111a-06cb-4b09-8ef0-9e87667ec966 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:15:32.750637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:32.769376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event updated for resources: {'Port': ['ID=f892111a-06cb-4b09-8ef0-9e87667ec966,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:32.843983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:32.845713 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:32.967556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:33.094015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:33.099638 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a447106c-3ac4-4322-9dfb-d74fa8326ef7 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6219420 Nov 24 04:15:33.102455 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35472) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:33.107389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:33.107505 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.115829 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.169899 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda70b32-a007-46e6-85cc-e5b7c578aac5 None None] Pushing event updated for resources: {'Port': ['ID=f892111a-06cb-4b09-8ef0-9e87667ec966,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:33.175215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-148e13b2-8ccf-483d-bde0-7e592cb39139 None None] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:33.192930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ec269bdd-0339-4dd4-af3f-77709fa00715 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:33.306090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Attempting to bind port f892111a-06cb-4b09-8ef0-9e87667ec966 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:33.306490 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Attempting to bind port f892111a-06cb-4b09-8ef0-9e87667ec966 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:33.306853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Attempting to bind port f892111a-06cb-4b09-8ef0-9e87667ec966 on network f945a66c-3c93-40a8-9da1-69b90d32ebd9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:33.308716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-c0c7b22c-b4d1-4455-b760-e7985bb60c02 None None] Provisioning complete for port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:33.309083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c0c7b22c-b4d1-4455-b760-e7985bb60c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.344995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:33.345369 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Checking segment: {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:33.345775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.346198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Bound using segment: {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:33.346686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Bound port: f892111a-06cb-4b09-8ef0-9e87667ec966, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86a4c1a5-c436-4006-b3f2-37001fb20917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 169, 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:33.347062 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.442997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ec269bdd-0339-4dd4-af3f-77709fa00715 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:33.443260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.484550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added routes are [{'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 24 04:15:33.498391 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Removed routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 24 04:15:33.498762 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.527363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] For port f892111a-06cb-4b09-8ef0-9e87667ec966, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:33.559460 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] For port f892111a-06cb-4b09-8ef0-9e87667ec966, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f892111a-06cb-4b09-8ef0-9e87667ec966,segment=NetworkSegment(86a4c1a5-c436-4006-b3f2-37001fb20917),segment_id=86a4c1a5-c436-4006-b3f2-37001fb20917)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:33.574253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.604137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c0c7b22c-b4d1-4455-b760-e7985bb60c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.681215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.684897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.785372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:33.843555 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda70b32-a007-46e6-85cc-e5b7c578aac5 None None] Pushing event updated for resources: {'Port': ['ID=f892111a-06cb-4b09-8ef0-9e87667ec966,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:33.856248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:33.857859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:33.859311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:33.862981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c0c7b22c-b4d1-4455-b760-e7985bb60c02 None None] For port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,segment=NetworkSegment(86a4c1a5-c436-4006-b3f2-37001fb20917),segment_id=86a4c1a5-c436-4006-b3f2-37001fb20917)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:33.890078 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:33.897597 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:33.901491 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2ae2e3d6-e94f-481d-9222-02503f1872f2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 954 time: 0.7954731 Nov 24 04:15:33.901629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35474) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:33.911565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c0c7b22c-b4d1-4455-b760-e7985bb60c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.004153 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0633b7f4-a665-4ac0-91d5-94beb07f6d6f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 954 time: 0.1013496 Nov 24 04:15:34.006743 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35476) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:34.011556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'routes': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:34.021437 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c7b22c-b4d1-4455-b760-e7985bb60c02 None None] Pushing event updated for resources: {'Port': ['ID=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:34.024795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:34.071253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:34.071633 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.174923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Provisioning complete for port f892111a-06cb-4b09-8ef0-9e87667ec966 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:34.175300 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.311266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fc5fd07b-fea3-463e-bbbd-971ce3873cfb up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:34.398095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 24 04:15:34.398753 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Removed routes are [{'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 24 04:15:34.413591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.431156 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.462512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] For port f892111a-06cb-4b09-8ef0-9e87667ec966, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f892111a-06cb-4b09-8ef0-9e87667ec966,segment=NetworkSegment(86a4c1a5-c436-4006-b3f2-37001fb20917),segment_id=86a4c1a5-c436-4006-b3f2-37001fb20917)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:34.466429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:33Z', 'revision_number': 6, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f892111a-06cb-4b09-8ef0-9e87667ec966', 'name': '', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:6f:fc:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1306, 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:31Z', 'updated_at': '2021-11-24T04:15:33Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '011464d7-db3f-45c9-be81-833a94cc7636', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:34.469410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port fc5fd07b-fea3-463e-bbbd-971ce3873cfb triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:34.469832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.472442 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.523682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad57bce1-d962-480c-8f3d-833b33a50d30 None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:33Z', 'revision_number': 6, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f892111a-06cb-4b09-8ef0-9e87667ec966', 'name': '', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:6f:fc:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1306, 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:31Z', 'updated_at': '2021-11-24T04:15:33Z', 'revision_number': 4, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '011464d7-db3f-45c9-be81-833a94cc7636', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:34.582305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Provisioning complete for port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:34.582623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.632212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0991d2e3-ef12-419f-9c31-55c156ed73a9 None None] Pushing event updated for resources: {'Port': ['ID=f892111a-06cb-4b09-8ef0-9e87667ec966,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:34.670508 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.676466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.795265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:34.871523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9a26646a-0fec-413b-a177-63b6875ca966 None None] Provisioning complete for port f892111a-06cb-4b09-8ef0-9e87667ec966 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:34.871822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a26646a-0fec-413b-a177-63b6875ca966 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.925960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:34.945095 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:34.951785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35478) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:34.952912 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7e6d772b-28f0-47fd-add5-d6d4d9281641 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 704 time: 0.9438491 Nov 24 04:15:35.012793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4fee2013-2210-4658-a4a0-c7e3130f2e21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:35.098773 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aa6c43bc-2a69-4d7d-a725-abe08066a392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 704 time: 0.1451643 Nov 24 04:15:35.100345 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35480) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:35.105326 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:35.152313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2e6a664e-1e3d-4b75-b2e6-0c17883669ec None None] Provisioning complete for port f892111a-06cb-4b09-8ef0-9e87667ec966 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:35.152777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2e6a664e-1e3d-4b75-b2e6-0c17883669ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:35.206898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:35.207279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:35.322847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f892111a-06cb-4b09-8ef0-9e87667ec966 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:35.370287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f892111a-06cb-4b09-8ef0-9e87667ec966 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:35.370667 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:35.425081 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:35.437484 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:35.438455 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:35.459432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:35.529372 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:35.746871 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:34Z', 'revision_number': 7, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f892111a-06cb-4b09-8ef0-9e87667ec966', 'name': '', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:6f:fc:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1306, 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:31Z', 'updated_at': '2021-11-24T04:15:34Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '011464d7-db3f-45c9-be81-833a94cc7636', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:35.773178 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:35.782437 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:35.783070 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:35.956446 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:35.994280 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port f892111a-06cb-4b09-8ef0-9e87667ec966 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:35.994744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.081419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port f892111a-06cb-4b09-8ef0-9e87667ec966, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f892111a-06cb-4b09-8ef0-9e87667ec966,segment=NetworkSegment(86a4c1a5-c436-4006-b3f2-37001fb20917),segment_id=86a4c1a5-c436-4006-b3f2-37001fb20917)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:36.082423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.095809 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for f892111a-06cb-4b09-8ef0-9e87667ec966 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:36.158247 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:34Z', 'revision_number': 7, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f892111a-06cb-4b09-8ef0-9e87667ec966', 'name': '', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:6f:fc:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1306, 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:31Z', 'updated_at': '2021-11-24T04:15:34Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '011464d7-db3f-45c9-be81-833a94cc7636', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:36.189157 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecaf45d9-db04-434f-9874-8fd756e0b7a8 None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:34Z', 'revision_number': 7, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f892111a-06cb-4b09-8ef0-9e87667ec966', 'name': '', 'network_id': 'f945a66c-3c93-40a8-9da1-69b90d32ebd9', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:6f:fc:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1306, 'fixed_ips': [{'subnet_id': '011464d7-db3f-45c9-be81-833a94cc7636', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:31Z', 'updated_at': '2021-11-24T04:15:34Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '011464d7-db3f-45c9-be81-833a94cc7636', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:36.266072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.297025 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=f892111a-06cb-4b09-8ef0-9e87667ec966,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:36.414376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.606605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:36.698708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:36.703865 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c0266ca6-b9f2-4d31-8484-557fb43f0bd1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6024888 Nov 24 04:15:36.706680 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35482) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:36.708453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:36.719687 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:36.720299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:36.757290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 011464d7-db3f-45c9-be81-833a94cc7636 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:36.760439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.800128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.807826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:36.886800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.959780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.987792 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=011464d7-db3f-45c9-be81-833a94cc7636,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:36.991664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:36.997850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35484) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:36.998395 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6ffd4038-d4f7-413c-993f-c4f47aac20a1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/011464d7-db3f-45c9-be81-833a94cc7636 HTTP/1.1" status: 204 len: 168 time: 0.2900960 Nov 24 04:15:37.000189 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6127046-4f77-4eda-8595-91d94ec42944 None None] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:37.076695 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.115914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:36Z', 'revision_number': 8, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:37.135984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:37.136330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.145227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:37.159117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:37.159728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:37.201006 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,segment=NetworkSegment(86a4c1a5-c436-4006-b3f2-37001fb20917),segment_id=86a4c1a5-c436-4006-b3f2-37001fb20917)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:37.201382 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.215754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:37.254105 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:37.280789 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] DHCP port deletion for f945a66c-3c93-40a8-9da1-69b90d32ebd9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:37.302341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.328352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:37.332091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:37.414590 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.424749 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Deleting port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:37.425131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.434318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f945a66c-3c93-40a8-9da1-69b90d32ebd9']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:37.444039 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '86a4c1a5-c436-4006-b3f2-37001fb20917') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:37.444342 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '86a4c1a5-c436-4006-b3f2-37001fb20917') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:37.454300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.468880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.473904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 169 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:37.474334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:37.477375 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:37.538421 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.547757 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.553479 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/f945a66c-3c93-40a8-9da1-69b90d32ebd9 HTTP/1.1" status: 204 len: 168 time: 0.5513964 Nov 24 04:15:37.553834 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35486) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:37.563264 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e161bd3c-f0d6-4981-850c-7361bf9c2941 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=f945a66c-3c93-40a8-9da1-69b90d32ebd9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:37.671409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] For port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:37.671714 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.687374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Calling delete_port for 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:37.690873 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:15:37.693141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.719536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Network f945a66c-3c93-40a8-9da1-69b90d32ebd9 is not hosted by any dhcp agent {{(pid=103382) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:15:37.719536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] No DVR routers for this DVR port 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:37.723734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a73af19-2f99-4afd-aa85-ec6b6658b362 None None] Pushing event deleted for resources: {'Port': ['ID=8d8305bd-1e5f-45eb-be1e-a49a402d6d68,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:37.740492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:36Z', 'revision_number': 8, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:37.771778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08720e9-502e-42b5-a5fe-6d808dfa156c None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:36Z', 'revision_number': 8, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ec269bdd-0339-4dd4-af3f-77709fa00715', 'name': '', 'network_id': '7ac4223f-0e7f-42ee-962a-ce583a104284', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:32:ca:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1301, 'fixed_ips': [{'subnet_id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:28Z', 'updated_at': '2021-11-24T04:15:31Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': 'ac2c4331-99c7-4d2a-accb-9c963cb6ef3d', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:37.898240 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:37.955212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82f0bba2-e159-4f1b-adf5-1545b6a265bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.147390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port ec269bdd-0339-4dd4-af3f-77709fa00715 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:38.147735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.243267 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port ec269bdd-0339-4dd4-af3f-77709fa00715, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ec269bdd-0339-4dd4-af3f-77709fa00715,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:38.243635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.256546 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for ec269bdd-0339-4dd4-af3f-77709fa00715 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:38.428117 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.454097 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=ec269bdd-0339-4dd4-af3f-77709fa00715,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:38.569030 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.748981 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.758082 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:38.848724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:38.853912 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b3e8ed78-8bab-4427-af9f-e482d1e56a8f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.2989502 Nov 24 04:15:38.856719 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35492) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:38.859435 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:38.870865 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:38.871479 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:38.915888 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet ac2c4331-99c7-4d2a-accb-9c963cb6ef3d {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:38.917799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.960538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:38.964718 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:39.034005 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:39.051649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.053302 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:39.053668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 8d8305bd-1e5f-45eb-be1e-a49a402d6d68 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:39.054081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f892111a-06cb-4b09-8ef0-9e87667ec966 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:39.072993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: f892111a-06cb-4b09-8ef0-9e87667ec966 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:39.073345 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f892111a-06cb-4b09-8ef0-9e87667ec966 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:39.116525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.145047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=ac2c4331-99c7-4d2a-accb-9c963cb6ef3d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:39.148493 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.154087 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-82ca204b-315f-4d43-8fb8-1bacbd696f50 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/ac2c4331-99c7-4d2a-accb-9c963cb6ef3d HTTP/1.1" status: 204 len: 168 time: 0.2939165 Nov 24 04:15:39.154866 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35494) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:39.158106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e043f68-31cb-451d-bfb8-f3a45d93f26e None None] Network 7ac4223f-0e7f-42ee-962a-ce583a104284 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:39.169282 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:38Z', 'revision_number': 9, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:39.199619 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:39.208441 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:39.209056 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:39.235219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.294429 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:39.294903 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.302065 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:39.352404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] DHCP port deletion for 7ac4223f-0e7f-42ee-962a-ce583a104284 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:39.360783 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:39.361276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.374443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 6a41f6e8-3f5f-4f29-abe1-402887a9a83c owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:39.399691 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] Deleting port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:39.400074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.461591 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.468134 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] For port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,segment=NetworkSegment(51ab971f-0ff0-40f6-91fa-0f3b895f8b18),segment_id=51ab971f-0ff0-40f6-91fa-0f3b895f8b18)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:39.468592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.482108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] Calling delete_port for 6a41f6e8-3f5f-4f29-abe1-402887a9a83c owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:39.491475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:39.493810 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:39.511361 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:38Z', 'revision_number': 9, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:39.537852 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3f34f34-e92e-4fd1-b4c8-a8ef61b8e0d7 None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:38Z', 'revision_number': 9, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'fc5fd07b-fea3-463e-bbbd-971ce3873cfb', 'name': '', 'network_id': '37cd34bf-4eaa-4b9e-8de8-6793ecf44447', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:8c:9e:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1295, 'fixed_ips': [{'subnet_id': '47d1091c-df73-405b-b47d-f124d67cec78', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:25Z', 'updated_at': '2021-11-24T04:15:32Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '47d1091c-df73-405b-b47d-f124d67cec78', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:39.572269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.584214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.598343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] Pushing event deleted for resources: {'Port': ['ID=6a41f6e8-3f5f-4f29-abe1-402887a9a83c,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:39.601839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda6a353-2a50-49c1-86b2-37fce5c1dc26 None None] No DVR routers for this DVR port 6a41f6e8-3f5f-4f29-abe1-402887a9a83c on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:39.604316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ac4223f-0e7f-42ee-962a-ce583a104284']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:39.617188 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '51ab971f-0ff0-40f6-91fa-0f3b895f8b18') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:39.617496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '51ab971f-0ff0-40f6-91fa-0f3b895f8b18') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:39.631183 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.644239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.650401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 164 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:39.650789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:39.653803 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:39.710953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.715565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:39.720055 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/7ac4223f-0e7f-42ee-962a-ce583a104284 HTTP/1.1" status: 204 len: 168 time: 0.5639148 Nov 24 04:15:39.722890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35496) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:39.734521 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5345716-22a2-420c-9042-72cd4352a1a9 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=7ac4223f-0e7f-42ee-962a-ce583a104284,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:40.053426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.076185 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.291856 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port fc5fd07b-fea3-463e-bbbd-971ce3873cfb {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:40.292194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.380226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port fc5fd07b-fea3-463e-bbbd-971ce3873cfb, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,segment=NetworkSegment(feaf85db-e887-4fd8-aa12-cd2459593c18),segment_id=feaf85db-e887-4fd8-aa12-cd2459593c18)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:40.380584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.393464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for fc5fd07b-fea3-463e-bbbd-971ce3873cfb owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:40.556422 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.584375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=fc5fd07b-fea3-463e-bbbd-971ce3873cfb,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:40.693162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.856323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:40.881891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:40.975676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:40.980975 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-02ecf187-ec0c-470c-abe4-0f5eeeeaed36 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.2569635 Nov 24 04:15:40.984669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35500) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:40.988309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:40.998975 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:40.999621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.034979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ec269bdd-0339-4dd4-af3f-77709fa00715 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:41.042705 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 47d1091c-df73-405b-b47d-f124d67cec78 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:41.046480 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.082772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: ec269bdd-0339-4dd4-af3f-77709fa00715 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:41.083363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ec269bdd-0339-4dd4-af3f-77709fa00715 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:41.083516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6a41f6e8-3f5f-4f29-abe1-402887a9a83c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:41.089974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.113495 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 6a41f6e8-3f5f-4f29-abe1-402887a9a83c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:41.113752 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 6a41f6e8-3f5f-4f29-abe1-402887a9a83c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:41.128056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:41.172378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.230699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.264165 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.268569 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/47d1091c-df73-405b-b47d-f124d67cec78 HTTP/1.1" status: 204 len: 168 time: 0.2828496 Nov 24 04:15:41.269587 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89073fcd-74b9-440e-8b62-c3d1198a497f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=47d1091c-df73-405b-b47d-f124d67cec78,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:41.270808 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35502) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:41.274807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81b49030-0888-4932-808f-50fcd6da6a09 None None] Network 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:41.352064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.404760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 668b547d-9069-4b82-a319-1e82299cbe88 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:41.405048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.419622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:40Z', 'revision_number': 10, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.448059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:41.457372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:41.457975 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.473301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 668b547d-9069-4b82-a319-1e82299cbe88, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=668b547d-9069-4b82-a319-1e82299cbe88,segment=NetworkSegment(feaf85db-e887-4fd8-aa12-cd2459593c18),segment_id=feaf85db-e887-4fd8-aa12-cd2459593c18)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:41.474327 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.490915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 668b547d-9069-4b82-a319-1e82299cbe88 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:41.520631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] DHCP port deletion for 37cd34bf-4eaa-4b9e-8de8-6793ecf44447 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:41.566945 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:41.570432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.602277 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=668b547d-9069-4b82-a319-1e82299cbe88,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:41.604104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port 668b547d-9069-4b82-a319-1e82299cbe88 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:41.661803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Deleting port 668b547d-9069-4b82-a319-1e82299cbe88 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:41.662099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.684737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.706347 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['37cd34bf-4eaa-4b9e-8de8-6793ecf44447']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.715598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'feaf85db-e887-4fd8-aa12-cd2459593c18') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.715899 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'feaf85db-e887-4fd8-aa12-cd2459593c18') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.725393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.739398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.745151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 182 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:41.745528 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:41.749268 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:41.769680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] For port 668b547d-9069-4b82-a319-1e82299cbe88, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:41.770077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.790084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Calling delete_port for 668b547d-9069-4b82-a319-1e82299cbe88 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:41.793694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Port 668b547d-9069-4b82-a319-1e82299cbe88 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:15:41.795174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.812819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.830689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:41.833868 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/37cd34bf-4eaa-4b9e-8de8-6793ecf44447 HTTP/1.1" status: 204 len: 168 time: 0.5597517 Nov 24 04:15:41.835037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36088280-1de9-4628-ab2d-be1ad42954f8 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=37cd34bf-4eaa-4b9e-8de8-6793ecf44447,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:41.836666 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35504) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:41.846411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] No DVR routers for this DVR port 668b547d-9069-4b82-a319-1e82299cbe88 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:41.848023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf66add-4058-4b92-ab06-ba699086515e None None] Pushing event deleted for resources: {'Port': ['ID=668b547d-9069-4b82-a319-1e82299cbe88,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:41.879868 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:40Z', 'revision_number': 10, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:41.907467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8448b360-1607-4460-a6bc-95499854ac7e None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:40Z', 'revision_number': 10, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None, '_interfaces': [{'id': '7cf06dc7-0729-4b75-ae1b-680f08a2eec1', 'name': '', 'network_id': '7f92439f-8378-4f63-91b3-a644bb7cf187', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'mac_address': 'fa:16:3e:4f:13:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 1291, 'fixed_ips': [{'subnet_id': '69691129-5818-4377-bdd6-3212ec5d848e', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:15:22Z', 'updated_at': '2021-11-24T04:15:26Z', 'revision_number': 5, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'subnets': [{'id': '69691129-5818-4377-bdd6-3212ec5d848e', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:42.136252 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:42.164802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:42.693225 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:42.693481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:42.778214 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 7cf06dc7-0729-4b75-ae1b-680f08a2eec1, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:42.778578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:42.794934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:42.960616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fc5fd07b-fea3-463e-bbbd-971ce3873cfb no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:42.964957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:42.980995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fc5fd07b-fea3-463e-bbbd-971ce3873cfb {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:42.981617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fc5fd07b-fea3-463e-bbbd-971ce3873cfb not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:42.982032 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 668b547d-9069-4b82-a319-1e82299cbe88 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:42.991654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=7cf06dc7-0729-4b75-ae1b-680f08a2eec1,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:43.003381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 668b547d-9069-4b82-a319-1e82299cbe88 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:43.003738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 668b547d-9069-4b82-a319-1e82299cbe88 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:43.088337 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:43.242741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:43.316328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:43.322252 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-08737a57-068f-4876-bd09-093966d0eb3f tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4841914 Nov 24 04:15:43.324023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35506) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:43.326574 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:43.336889 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:43.337493 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:43.375512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting subnet 69691129-5818-4377-bdd6-3212ec5d848e {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:43.378654 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:43.407847 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:43.421993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:43.461240 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:42Z', 'revision_number': 11, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:43.487216 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:43.495287 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:43.495878 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:43.504541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:43.562251 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:43.565496 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:43.591021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Subnet': ['ID=69691129-5818-4377-bdd6-3212ec5d848e,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:43.597934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:43.603807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35508) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:43.604318 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-97bbb7bd-b2fa-4373-8aaf-4e41949b5441 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/69691129-5818-4377-bdd6-3212ec5d848e HTTP/1.1" status: 204 len: 168 time: 0.2792966 Nov 24 04:15:43.605979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b905040-1a29-4bb7-b43b-93ca8f5e50df None None] Network 7f92439f-8378-4f63-91b3-a644bb7cf187 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:43.622791 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:42Z', 'revision_number': 11, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:43.650561 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dafb279b-4a5f-4101-9abf-11efd759141a None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:42Z', 'revision_number': 11, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:43.711666 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.019952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] DHCP port deletion for 7f92439f-8378-4f63-91b3-a644bb7cf187 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:44.044991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Deleting port 55982f00-fe7b-45f3-8085-8ff923cc22b5 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:44.045349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.077046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] Deleting port 55982f00-fe7b-45f3-8085-8ff923cc22b5 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:44.077426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.110457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] For port 55982f00-fe7b-45f3-8085-8ff923cc22b5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=55982f00-fe7b-45f3-8085-8ff923cc22b5,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:44.110602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.124239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Calling delete_port for 55982f00-fe7b-45f3-8085-8ff923cc22b5 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:44.145990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] For port 55982f00-fe7b-45f3-8085-8ff923cc22b5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=55982f00-fe7b-45f3-8085-8ff923cc22b5,segment=NetworkSegment(94781c48-22d1-430a-9697-fbecc1a618ff),segment_id=94781c48-22d1-430a-9697-fbecc1a618ff)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:44.146421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.159264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] Calling delete_port for 55982f00-fe7b-45f3-8085-8ff923cc22b5 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:44.209460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.235865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Port': ['ID=55982f00-fe7b-45f3-8085-8ff923cc22b5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:44.237034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.239674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No DVR routers for this DVR port 55982f00-fe7b-45f3-8085-8ff923cc22b5 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:44.267142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] No DVR routers for this DVR port 55982f00-fe7b-45f3-8085-8ff923cc22b5 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:44.270849 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe700773-2e25-4cc6-89e6-461ebb602f51 None None] Pushing event deleted for resources: {'Port': ['ID=55982f00-fe7b-45f3-8085-8ff923cc22b5,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:44.319931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.339963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7f92439f-8378-4f63-91b3-a644bb7cf187']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:44.349544 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '94781c48-22d1-430a-9697-fbecc1a618ff') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:44.349844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '94781c48-22d1-430a-9697-fbecc1a618ff') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:44.359224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.372050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.377809 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Releasing vlan 166 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:44.378224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:44.381220 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:44.437852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.444201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.447256 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/networks/7f92439f-8378-4f63-91b3-a644bb7cf187 HTTP/1.1" status: 204 len: 168 time: 0.8421252 Nov 24 04:15:44.450116 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35512) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:44.455453 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'routes': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:44.458802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34caed41-a442-47eb-85f7-b72ed2736f67 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Pushing event deleted for resources: {'Network': ['ID=7f92439f-8378-4f63-91b3-a644bb7cf187,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:44.607021 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Added routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 24 04:15:44.607258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.extraroute_db [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Removed routes are [] {{(pid=103380) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 24 04:15:44.607582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.741162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.744287 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.818229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:44.892840 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:44.899522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:44.900941 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8eaf0d79-1ac7-4a13-99b1-9783d1e6c392 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 705 time: 0.4497855 Nov 24 04:15:44.902956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Sync routers for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:44.908726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35514) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:44.916309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Routers {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:44.916940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:44.935115 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ec218f6f-6861-4cf5-8eb9-8895fbe76106 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 205 time: 0.0293303 Nov 24 04:15:44.937905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35516) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:45.013555 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.128321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:45.152576 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:45.152840 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 7cf06dc7-0729-4b75-ae1b-680f08a2eec1 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:45.153246 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 55982f00-fe7b-45f3-8085-8ff923cc22b5 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:45.171853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Set router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:45.175923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.178028 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.196626 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 55982f00-fe7b-45f3-8085-8ff923cc22b5 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:45.196982 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 55982f00-fe7b-45f3-8085-8ff923cc22b5 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:45.224263 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.224802 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:45.226700 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f23d23e-588f-404a-9bb3-f5d989e9e4d5', 'name': 'tempest-RoutersIpV6Test-router-1132326115', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:21Z', 'updated_at': '2021-11-24T04:15:42Z', 'revision_number': 11, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:45.231759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.232868 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b519d4cf-2d1e-4511-a639-49a9101e9869 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 204 len: 168 time: 0.2939620 Nov 24 04:15:45.237633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35518) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:45.241934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-643912214', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:45.254907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Checking router: 1f23d23e-588f-404a-9bb3-f5d989e9e4d5 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:45.262987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Routers set() bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:45.263354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Router IDs set() for agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 04:15:45.263977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_agentschedulers_db [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'1f23d23e-588f-404a-9bb3-f5d989e9e4d5'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent'). {{(pid=103382) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Nov 24 04:15:45.264284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.264428 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646c3327-773b-4a0b-ae64-aa67c77a7d2a None None] The sync data for ids ['1f23d23e-588f-404a-9bb3-f5d989e9e4d5'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:45.265296 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.317076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.321657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.340854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.342097 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-193c633e-c983-4ae4-a15a-e72e69372ef1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.1034942 Nov 24 04:15:45.344869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35520) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:45.349399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Request body: {'router': {'admin_state_up': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:45.552492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-622007', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-602086', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4759'] for router, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.562327 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-621715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-664368', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-602068'] for router, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.653822 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Router 41a89d6d-ffe9-40d1-b17c-7a87ec440ccd is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:15:45.727688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:45.736033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.737365 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-adb6239f-331c-4667-a9ad-546f6a65493a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "PUT /v2.0/routers/41a89d6d-ffe9-40d1-b17c-7a87ec440ccd HTTP/1.1" status: 200 len: 697 time: 0.3915122 Nov 24 04:15:45.737746 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] Sync routers for ids ['41a89d6d-ffe9-40d1-b17c-7a87ec440ccd'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:45.739978 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35522) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:45.748485 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] Routers {'41a89d6d-ffe9-40d1-b17c-7a87ec440ccd'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:45.749206 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['41a89d6d-ffe9-40d1-b17c-7a87ec440ccd'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:45.818788 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-19550830-16c2-40cc-bead-5df263e03d31 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/routers/41a89d6d-ffe9-40d1-b17c-7a87ec440ccd HTTP/1.1" status: 200 len: 703 time: 0.0775869 Nov 24 04:15:45.821392 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35524) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:45.849656 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a534097d-3d8e-4a97-b358-fd58d4539a64 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=41a89d6d-ffe9-40d1-b17c-7a87ec440ccd HTTP/1.1" status: 200 len: 205 time: 0.0271287 Nov 24 04:15:45.852207 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35526) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:45.904261 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] Set router 41a89d6d-ffe9-40d1-b17c-7a87ec440ccd gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:45.930913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:45.958396 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '41a89d6d-ffe9-40d1-b17c-7a87ec440ccd', 'name': 'tempest-RoutersIpV6Test-router-643912214', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:45Z', 'updated_at': '2021-11-24T04:15:45Z', 'revision_number': 2, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:45.984403 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] Checking router: 41a89d6d-ffe9-40d1-b17c-7a87ec440ccd for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:45.992610 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] Routers {'41a89d6d-ffe9-40d1-b17c-7a87ec440ccd'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:45.993208 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['41a89d6d-ffe9-40d1-b17c-7a87ec440ccd'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:46.060694 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] Set router 41a89d6d-ffe9-40d1-b17c-7a87ec440ccd gateway port host: None {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:46.113421 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '41a89d6d-ffe9-40d1-b17c-7a87ec440ccd', 'name': 'tempest-RoutersIpV6Test-router-643912214', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:45Z', 'updated_at': '2021-11-24T04:15:45Z', 'revision_number': 2, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:46.144777 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e38e39ea-487d-43a7-8b18-046a6c3f73bf None None] The sync data for ids ['41a89d6d-ffe9-40d1-b17c-7a87ec440ccd'] in dv-neutron-819049-1-hyperv is: [{'id': '41a89d6d-ffe9-40d1-b17c-7a87ec440ccd', 'name': 'tempest-RoutersIpV6Test-router-643912214', 'tenant_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:45Z', 'updated_at': '2021-11-24T04:15:45Z', 'revision_number': 2, 'project_id': 'fabef9b50edc4ad7a8072f36b9e15b43', 'gw_port_host': None}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:46.374916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:46.376955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:46.422855 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:46.423426 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Fanout notify agent at l3_agent the message router_deleted on router 41a89d6d-ffe9-40d1-b17c-7a87ec440ccd {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:46.430456 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:46.431540 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0d773769-fbd8-40ef-a070-26ac049c3c6b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/41a89d6d-ffe9-40d1-b17c-7a87ec440ccd HTTP/1.1" status: 204 len: 168 time: 0.5784085 Nov 24 04:15:46.434933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35528) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.462064 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b77b878c-a2e6-435d-8383-6f8415e82846 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=41a89d6d-ffe9-40d1-b17c-7a87ec440ccd HTTP/1.1" status: 200 len: 205 time: 0.0260663 Nov 24 04:15:46.464387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35530) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.507909 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-ac15350c-d60a-4523-b388-001263f37c4b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:46.508910 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ac15350c-d60a-4523-b388-001263f37c4b tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/41a89d6d-ffe9-40d1-b17c-7a87ec440ccd HTTP/1.1" status: 404 len: 336 time: 0.0436513 Nov 24 04:15:46.511399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35532) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.536113 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-eaebecd6-91a7-4c49-a943-643bebbd5911 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:46.536569 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eaebecd6-91a7-4c49-a943-643bebbd5911 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:46.539580 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eaebecd6-91a7-4c49-a943-643bebbd5911 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/011464d7-db3f-45c9-be81-833a94cc7636 HTTP/1.1" status: 404 len: 337 time: 0.0272977 Nov 24 04:15:46.542079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35534) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.568516 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-f7e4e455-bc17-4b86-8bdf-7171ba779372 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:46.569164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f7e4e455-bc17-4b86-8bdf-7171ba779372 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:46.571903 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f7e4e455-bc17-4b86-8bdf-7171ba779372 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/ac2c4331-99c7-4d2a-accb-9c963cb6ef3d HTTP/1.1" status: 404 len: 337 time: 0.0288806 Nov 24 04:15:46.574443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35536) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.598636 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a3f2828-05c6-4da9-af69-fce02123f92d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:46.599079 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0a3f2828-05c6-4da9-af69-fce02123f92d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:46.601959 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0a3f2828-05c6-4da9-af69-fce02123f92d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/47d1091c-df73-405b-b47d-f124d67cec78 HTTP/1.1" status: 404 len: 337 time: 0.0265374 Nov 24 04:15:46.604579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35538) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.637426 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-f8771a26-efd6-4934-9ab6-3fb71b3915a6 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:46.637796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f8771a26-efd6-4934-9ab6-3fb71b3915a6 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:46.640781 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f8771a26-efd6-4934-9ab6-3fb71b3915a6 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/69691129-5818-4377-bdd6-3212ec5d848e HTTP/1.1" status: 404 len: 337 time: 0.0351937 Nov 24 04:15:46.643208 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35540) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.668381 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c49f8d29-4e9e-4213-a1f0-88eae943612a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 200 len: 205 time: 0.0241506 Nov 24 04:15:46.671123 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35542) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.707227 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-e5e67bed-8c82-4b0f-afbb-01f6c03c49e2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:46.708259 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e5e67bed-8c82-4b0f-afbb-01f6c03c49e2 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/1f23d23e-588f-404a-9bb3-f5d989e9e4d5 HTTP/1.1" status: 404 len: 336 time: 0.0362456 Nov 24 04:15:46.710966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35544) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.739365 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ecbc8912-4052-4fb3-af17-52fdfb35258d tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 HTTP/1.1" status: 200 len: 205 time: 0.0272942 Nov 24 04:15:46.741630 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35546) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.782291 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-cace8264-513d-49f4-96d2-fd8457a3b4a5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:46.783350 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cace8264-513d-49f4-96d2-fd8457a3b4a5 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/6ff1a90e-7325-4ba8-8912-ffed3e3c3d12 HTTP/1.1" status: 404 len: 336 time: 0.0407875 Nov 24 04:15:46.785868 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35548) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.812573 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.pecan_wsgi.hooks.translation [None req-c11633de-14fe-44c1-b483-4f8784e13816 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:46.813029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c11633de-14fe-44c1-b483-4f8784e13816 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103381) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:46.818372 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c11633de-14fe-44c1-b483-4f8784e13816 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/3dd19467-963b-4885-9c50-0108d4f786cf HTTP/1.1" status: 404 len: 337 time: 0.0292597 Nov 24 04:15:46.818727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35550) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.844734 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ed309277-5aa2-4cc3-b5c9-b1e36fddc2f1 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 200 len: 205 time: 0.0248094 Nov 24 04:15:46.846939 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35552) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.887842 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-e95d2fcd-9c99-47a4-aac8-5dac6e918cae tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:46.888844 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e95d2fcd-9c99-47a4-aac8-5dac6e918cae tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/3f826730-f72e-48ae-9805-c87a8e2d96fe HTTP/1.1" status: 404 len: 336 time: 0.0410016 Nov 24 04:15:46.891434 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35554) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.918452 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e35053e3-8268-4202-9f5d-38f595890f24 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=bf9bd32b-63d2-4dca-9608-1d504f99c603 HTTP/1.1" status: 200 len: 205 time: 0.0259235 Nov 24 04:15:46.921226 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35556) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.957520 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-e4193cfe-c66b-4d44-b4e8-dc27dd810825 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:46.958604 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e4193cfe-c66b-4d44-b4e8-dc27dd810825 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/bf9bd32b-63d2-4dca-9608-1d504f99c603 HTTP/1.1" status: 404 len: 336 time: 0.0364740 Nov 24 04:15:46.961192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35558) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:46.992274 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-b4d872ba-5c09-424c-a068-27b108eac7a6 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:46.992744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b4d872ba-5c09-424c-a068-27b108eac7a6 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:46.995825 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b4d872ba-5c09-424c-a068-27b108eac7a6 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/eb81f251-4e12-4f7c-817e-c211acff608f HTTP/1.1" status: 404 len: 337 time: 0.0337191 Nov 24 04:15:46.998400 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35560) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.025483 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-08bc33bf-b5a1-4a77-87cf-00f10bb8b59a tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=3f8a03ce-f479-4712-b238-c3ff5cffb899 HTTP/1.1" status: 200 len: 205 time: 0.0256240 Nov 24 04:15:47.027697 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35562) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.066945 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-e9c39e1c-a16d-4c72-9a39-6bfc58b6f902 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:47.068296 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e9c39e1c-a16d-4c72-9a39-6bfc58b6f902 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/3f8a03ce-f479-4712-b238-c3ff5cffb899 HTTP/1.1" status: 404 len: 336 time: 0.0396464 Nov 24 04:15:47.070706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35564) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.096071 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-115a347d-0fb8-4d5a-ae68-aa89456ce4ba tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:47.096509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-115a347d-0fb8-4d5a-ae68-aa89456ce4ba tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:47.099379 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-115a347d-0fb8-4d5a-ae68-aa89456ce4ba tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/77aafc96-4615-4a35-b02c-4068c68d9ab0 HTTP/1.1" status: 404 len: 337 time: 0.0277638 Nov 24 04:15:47.101640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35566) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.130640 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-296b3737-7940-4c92-b9ea-06b3733f3497 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "GET /v2.0/ports?device_id=1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 HTTP/1.1" status: 200 len: 205 time: 0.0279093 Nov 24 04:15:47.133338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35568) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.168854 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.api.v2.resource [None req-79c951fa-0ce7-4aa0-a84c-9a4b42d1993e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] delete failed (client error): The resource could not be found. Nov 24 04:15:47.169797 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-79c951fa-0ce7-4aa0-a84c-9a4b42d1993e tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/routers/1dd8c0a6-a0d2-406e-8a2c-bb9e3dece5b1 HTTP/1.1" status: 404 len: 336 time: 0.0355844 Nov 24 04:15:47.172900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35570) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.197238 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-d5c6d941-4b0e-4964-9a60-f5142ba68fcf tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:47.197748 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d5c6d941-4b0e-4964-9a60-f5142ba68fcf tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:47.200568 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d5c6d941-4b0e-4964-9a60-f5142ba68fcf tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/2e9268d5-7892-4616-9ccf-7721d2a741d2 HTTP/1.1" status: 404 len: 337 time: 0.0267591 Nov 24 04:15:47.202737 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35572) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.226759 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.pecan_wsgi.hooks.translation [None req-ffa1e6f1-1163-42e3-897a-c44612cc0108 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] DELETE failed (client error): The resource could not be found. Nov 24 04:15:47.227195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ffa1e6f1-1163-42e3-897a-c44612cc0108 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103380) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 04:15:47.230033 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ffa1e6f1-1163-42e3-897a-c44612cc0108 tempest-RoutersIpV6Test-1362640785 tempest-RoutersIpV6Test-1362640785-project] 10.222.0.48 "DELETE /v2.0/subnets/4051a88a-38c2-4c5e-b906-042c17c43cba HTTP/1.1" status: 404 len: 337 time: 0.0264401 Nov 24 04:15:47.469050 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35578) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.598897 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-60158eaf-6e5f-4235-8e20-3e0c9245b2ef admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=fabef9b50edc4ad7a8072f36b9e15b43&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1286726 Nov 24 04:15:47.601316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35582) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:47.651365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2fd03c4d-43e6-40d4-941b-975d68907326 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:47.672610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2fd03c4d-43e6-40d4-941b-975d68907326 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:47.718040 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2fd03c4d-43e6-40d4-941b-975d68907326 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:47.720634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2fd03c4d-43e6-40d4-941b-975d68907326 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:47.721774 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2fd03c4d-43e6-40d4-941b-975d68907326 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/3dea3031-a1c9-4a61-b6e7-593cc29e5a2c HTTP/1.1" status: 204 len: 168 time: 0.1195674 Nov 24 04:15:47.729239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd03c4d-43e6-40d4-941b-975d68907326 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dea3031-a1c9-4a61-b6e7-593cc29e5a2c,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:48.341893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35604) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:48.442524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-750867180', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:48.466208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.467213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.516639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.520887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.539970 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.541220 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ad7ac4f7-556d-4edf-8129-3fb36afe302e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 711 time: 0.1977220 Nov 24 04:15:48.544060 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35608) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:48.549752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-697334101'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:48.571382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:48.575029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.588466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.665672 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.669393 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.692675 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] vlan segment allocate from pool success with {'vlan_id': 195, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:48.707556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=746eae88-5067-434f-a7f5-15a6f7be38a4,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:48.711387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.711732 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Added segment 6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949 of type vlan for network abf8162e-342f-48d3-8724-08bc35ee99ae Nov 24 04:15:48.751051 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.775077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.781213 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:48.781792 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.813316 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.2682273 Nov 24 04:15:48.816537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35610) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:48.821640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'subnet': {'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:48.851617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c8a5af6-70a2-4880-bde6-65e346de0299 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Network': ['ID=abf8162e-342f-48d3-8724-08bc35ee99ae,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:48.862795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network abf8162e-342f-48d3-8724-08bc35ee99ae details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:48.923851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:48.927525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:48.986416 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35614) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:49.045348 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-313e8061-686d-4044-a392-12022a7d520f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/66c2cbfa-c6dc-4450-89c5-0378168c210b HTTP/1.1" status: 200 len: 993 time: 0.0575254 Nov 24 04:15:49.133682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.191982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Subnet': ['ID=2e4a04d6-291e-40a0-a67f-da0ddfe763e2,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:49.214178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Checking segment: {'id': '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:49.214569 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network hostable DHCP agents. Network: abf8162e-342f-48d3-8724-08bc35ee99ae, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:49.232532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network abf8162e-342f-48d3-8724-08bc35ee99ae is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:49.242863 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, abf8162e-342f-48d3-8724-08bc35ee99ae) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:49.251183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:49.252033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.252211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b9d714f-3305-4ae6-be79-a3a1208447c2 None None] Network abf8162e-342f-48d3-8724-08bc35ee99ae requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:49.270918 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2a173495-2b17-40ed-922a-a15a761ff925 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4531443 Nov 24 04:15:49.273717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35620) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:49.278867 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'network': {'name': 'tempest-router-network01--66582673'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:49.304483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:49.308098 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.333293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] vlan segment allocate from pool success with {'vlan_id': 174, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:49.342325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.342671 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Added segment a4ffcac7-6f90-4810-83d4-fda885e97f91 of type vlan for network 9a60c328-9734-4436-9b31-6508f4dc33aa Nov 24 04:15:49.363404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35622) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:49.382825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.408760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-abf8162e-342f-48d3-8724-08bc35ee99ae', 'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae', 'tenant_id': 'a74af4a1bbbe4607bf2e9ca69c90e3fa', 'fixed_ips': [{'subnet_id': '2e4a04d6-291e-40a0-a67f-da0ddfe763e2'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:49.409627 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.410718 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.416322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:49.416924 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.450809 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.1759868 Nov 24 04:15:49.453690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35624) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:49.460575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'network': {'name': 'tempest-router-network02--2114198247'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:49.506549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e4a3d6-6e24-4eb8-a953-bda8ecfe0d91 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Network': ['ID=9a60c328-9734-4436-9b31-6508f4dc33aa,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:49.519685 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:49.523293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.534729 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 9a60c328-9734-4436-9b31-6508f4dc33aa details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:49.539750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 1d119c6f-4c97-40f0-9f66-69256f1b2a87 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:49.540344 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.554638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] vlan segment allocate from pool success with {'vlan_id': 156, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:49.565287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.566409 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Added segment 57191ded-58d1-49b7-804c-f716d5a5a056 of type vlan for network 91b88d0a-d969-4d96-9310-bcbf237c050f Nov 24 04:15:49.612750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Allocated IP 2001:db8::2 (abf8162e-342f-48d3-8724-08bc35ee99ae/2e4a04d6-291e-40a0-a67f-da0ddfe763e2/322c5e09-5e5e-42ff-929e-20d32a6e85c5) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:49.614434 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.633585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.634190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.644415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.649075 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 1d119c6f-4c97-40f0-9f66-69256f1b2a87 owned by network:floatingip {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:49.650575 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:49.651123 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.692582 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.2348866 Nov 24 04:15:49.693929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:49.700904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'subnet': {'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:49.747035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf3caeb-45ac-427d-a9c5-17d201fc8ed5 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Network': ['ID=91b88d0a-d969-4d96-9310-bcbf237c050f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:49.765132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 91b88d0a-d969-4d96-9310-bcbf237c050f details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:49.793522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.817314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.839969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:49.843604 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=1d119c6f-4c97-40f0-9f66-69256f1b2a87,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:49.846205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.848602 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.899862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Network abf8162e-342f-48d3-8724-08bc35ee99ae is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:49.902772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:49.911038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:49.927780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Pushing event updated for resources: {'Port': ['ID=322c5e09-5e5e-42ff-929e-20d32a6e85c5,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:49.933660 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-b3ca0d08-38b0-4c57-b9d4-84e25be284c9 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0646856 Nov 24 04:15:49.944976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:49.945575 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP 66c2cbfa-c6dc-4450-89c5-0378168c210b disassociated (deleted). External IP: 172.26.5.189, port: 45a441c0-edd7-4702-b94f-f2ff19ae82d4. Nov 24 04:15:50.001932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Attempting to bind port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:50.002483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Attempting to bind port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:50.003429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Attempting to bind port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 on network abf8162e-342f-48d3-8724-08bc35ee99ae {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:50.008738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:50.009195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Checking segment: {'id': '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:50.009702 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.010261 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Bound using segment: {'id': '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:50.010826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Bound port: 322c5e09-5e5e-42ff-929e-20d32a6e85c5, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 195, 'network_id': 'abf8162e-342f-48d3-8724-08bc35ee99ae'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:50.011311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.069784 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.082983 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-8450bb25-cb93-4319-9c80-289131678a5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:50.084508 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-8450bb25-cb93-4319-9c80-289131678a5e service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1099 time: 0.0908985 Nov 24 04:15:50.091477 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] For port 322c5e09-5e5e-42ff-929e-20d32a6e85c5, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:50.096172 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] For port 322c5e09-5e5e-42ff-929e-20d32a6e85c5, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=322c5e09-5e5e-42ff-929e-20d32a6e85c5,segment=NetworkSegment(6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949),segment_id=6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:50.103219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.134029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Subnet': ['ID=ca9d3d4d-17cf-4c9c-a5cf-87897304dd22,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:50.161523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Checking segment: {'id': 'a4ffcac7-6f90-4810-83d4-fda885e97f91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:50.161523 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network hostable DHCP agents. Network: 9a60c328-9734-4436-9b31-6508f4dc33aa, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:50.181009 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network 9a60c328-9734-4436-9b31-6508f4dc33aa is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:50.192378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 9a60c328-9734-4436-9b31-6508f4dc33aa) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:50.192690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a48b1a-2c55-478a-bab1-387928667b9b None None] Pushing event updated for resources: {'Port': ['ID=322c5e09-5e5e-42ff-929e-20d32a6e85c5,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:50.202835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b880ba6-64b4-46b2-9f37-6fe6383e22aa None None] Network 9a60c328-9734-4436-9b31-6508f4dc33aa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:50.206803 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:50.207407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.235057 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eeb89fac-a227-4131-b834-ce20dd1c8d2e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5381978 Nov 24 04:15:50.237303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35628) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:50.243852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'subnet': {'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:50.244284 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-9af63245-ee19-4090-a713-9ba2338fa268 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:50.245812 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-9af63245-ee19-4090-a713-9ba2338fa268 service neutron] 10.222.0.21 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 898 time: 0.1051302 Nov 24 04:15:50.359891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:50.361570 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-9a585a5f-3f37-424b-9f00-1e0e1ac6335c service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 1001 time: 0.1062977 Nov 24 04:15:50.364301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.426060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-9a60c328-9734-4436-9b31-6508f4dc33aa', 'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa', 'tenant_id': 'a74af4a1bbbe4607bf2e9ca69c90e3fa', 'fixed_ips': [{'subnet_id': 'ca9d3d4d-17cf-4c9c-a5cf-87897304dd22'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:50.426959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.431710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 3fa77305-8276-4287-a9eb-5efe6a409e17 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:50.450182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-0cff124e-b36a-4b58-879d-762152c6db41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:50.452432 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-0cff124e-b36a-4b58-879d-762152c6db41 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 200 len: 834 time: 0.0824759 Nov 24 04:15:50.598198 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-bd83d415-66ff-4aed-a6b2-8fe5ecaa63a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:50.599784 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-bd83d415-66ff-4aed-a6b2-8fe5ecaa63a1 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=5056a387-4f26-43bd-ad60-c8135c9a7757&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0908561 Nov 24 04:15:50.602782 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:50.605891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.608265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.611689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Allocated IP 2001:db8::2 (9a60c328-9734-4436-9b31-6508f4dc33aa/ca9d3d4d-17cf-4c9c-a5cf-87897304dd22/d8c60255-38c2-4391-bb44-e19793f87b5f) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:50.624124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] Sync routers for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:50.671771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:50.672426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:50.679611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Subnet': ['ID=2c22b9c6-2820-440b-bc9c-009784bcf2d1,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:50.687398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Checking segment: {'id': '57191ded-58d1-49b7-804c-f716d5a5a056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:50.687839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network hostable DHCP agents. Network: 91b88d0a-d969-4d96-9310-bcbf237c050f, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:50.705187 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network 91b88d0a-d969-4d96-9310-bcbf237c050f is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:50.716292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 91b88d0a-d969-4d96-9310-bcbf237c050f) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:50.722180 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:50.723390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:50.735953 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-06dd7b22-0e26-4c0e-b2c2-4c383e9f9cc7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/floatingips/66c2cbfa-c6dc-4450-89c5-0378168c210b HTTP/1.1" status: 204 len: 168 time: 1.3677483 Nov 24 04:15:50.735953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:15:50.736896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361" -d '{"events": [{"name": "network-changed", "server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:15:50.739880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6778d624-3477-4d44-aa86-afa91e3dc3e9 None None] Network 91b88d0a-d969-4d96-9310-bcbf237c050f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:50.741769 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-97914dc6-4cba-4313-bd7e-065f3538c4c8 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304960 Nov 24 04:15:50.751853 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-25df7d86-7479-4f2a-b825-4af09d4fcacf tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5131662 Nov 24 04:15:50.754295 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35634) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:50.866946 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-47b2aa82-6f8c-445a-b5a8-7c9efa9c4215 req-ff158d8d-6b34-4651-aef3-aa4c11c3d00b service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1184418 Nov 24 04:15:50.868625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:15:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53d8b85c-c79b-49ed-b41c-1beaa5d3655d x-openstack-request-id: req-53d8b85c-c79b-49ed-b41c-1beaa5d3655d {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:15:50.869017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:15:50.869336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-53d8b85c-c79b-49ed-b41c-1beaa5d3655d {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:15:50.869851 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'status': 'completed', 'code': 200} Nov 24 04:15:50.928163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:50.994074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.035029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-988b9c43-bfd0-4599-82fa-b34537d86ae9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:51.036524 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-988b9c43-bfd0-4599-82fa-b34537d86ae9 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 1098 time: 0.1522787 Nov 24 04:15:51.065742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.262915 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836e72f-2424-4bda-a296-1699fc143b8b req-c86839a1-505d-49bd-a348-d11d45bb793b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:51.264960 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1836e72f-2424-4bda-a296-1699fc143b8b req-c86839a1-505d-49bd-a348-d11d45bb793b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 945 time: 0.1601493 Nov 24 04:15:51.278426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 322c5e09-5e5e-42ff-929e-20d32a6e85c5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:51.298729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.328974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-e472c9bf-4d5e-48a8-8e55-5ebe0d569794 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:51.330504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-e472c9bf-4d5e-48a8-8e55-5ebe0d569794 service neutron] 10.222.0.21 "GET /v2.0/networks?id=38418e10-00b7-4e21-8d7a-91bfeb87756f HTTP/1.1" status: 200 len: 898 time: 0.2608364 Nov 24 04:15:51.335672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Network 9a60c328-9734-4436-9b31-6508f4dc33aa is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:51.380449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:51.398022 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:51.399890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Pushing event updated for resources: {'Port': ['ID=d8c60255-38c2-4391-bb44-e19793f87b5f,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:51.409266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b428113f-16ec-4548-8d49-0ee71fadeee1 None None] Network abf8162e-342f-48d3-8724-08bc35ee99ae requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:51.417969 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-91b88d0a-d969-4d96-9310-bcbf237c050f', 'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f', 'tenant_id': 'a74af4a1bbbe4607bf2e9ca69c90e3fa', 'fixed_ips': [{'subnet_id': '2c22b9c6-2820-440b-bc9c-009784bcf2d1'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:51.418821 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.445159 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-78d95e90-d391-484c-9388-dbefcecf5aa5 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4 HTTP/1.1" status: 200 len: 217 time: 0.0789242 Nov 24 04:15:51.493104 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1836e72f-2424-4bda-a296-1699fc143b8b req-d467cd4b-653f-4bd8-bf92-c9244391c3ca tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2058997 Nov 24 04:15:51.552036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-be8ebb81-f114-4135-84d6-70bc0d1a3365 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:51.553725 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-be8ebb81-f114-4135-84d6-70bc0d1a3365 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=f2125981-3937-4d3b-9f58-7dca17c52922 HTTP/1.1" status: 200 len: 835 time: 0.0979898 Nov 24 04:15:51.574059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2436f820-1f8b-438d-9193-bd407aab87e3 None None] Provisioning complete for port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:51.575013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2436f820-1f8b-438d-9193-bd407aab87e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.642672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-78425f60-e537-47fe-b8e1-fff1b8bfb967 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:51.644064 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-78425f60-e537-47fe-b8e1-fff1b8bfb967 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=38418e10-00b7-4e21-8d7a-91bfeb87756f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0806720 Nov 24 04:15:51.663329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:51.663698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.678033 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Attempting to bind port d8c60255-38c2-4391-bb44-e19793f87b5f on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:51.678440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Attempting to bind port d8c60255-38c2-4391-bb44-e19793f87b5f by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a4ffcac7-6f90-4810-83d4-fda885e97f91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:51.678805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Attempting to bind port d8c60255-38c2-4391-bb44-e19793f87b5f on network 9a60c328-9734-4436-9b31-6508f4dc33aa {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:51.730623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:51.730998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Checking segment: {'id': 'a4ffcac7-6f90-4810-83d4-fda885e97f91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:51.731403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.731799 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Bound using segment: {'id': 'a4ffcac7-6f90-4810-83d4-fda885e97f91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:51.732278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Bound port: d8c60255-38c2-4391-bb44-e19793f87b5f, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a4ffcac7-6f90-4810-83d4-fda885e97f91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 174, 'network_id': '9a60c328-9734-4436-9b31-6508f4dc33aa'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:51.732659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:51.742165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Allocated IP 2001:db8::1 (9a60c328-9734-4436-9b31-6508f4dc33aa/ca9d3d4d-17cf-4c9c-a5cf-87897304dd22/036be06e-a47b-4d7d-a480-111a8519e12f) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:51.803226 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-a4eb735a-caa0-4bc3-80ba-1ebc6592edb6 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1377134 Nov 24 04:15:51.897755 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Allocated IP 2001:db8::2 (91b88d0a-d969-4d96-9310-bcbf237c050f/2c22b9c6-2820-440b-bc9c-009784bcf2d1/9d5344ac-5ac2-49e2-934f-bfad0a00ed35) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:51.994548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:02Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:52.005967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] For port d8c60255-38c2-4391-bb44-e19793f87b5f, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:52.074910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] Checking router: 3fa77305-8276-4287-a9eb-5efe6a409e17 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:52.081125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] For port d8c60255-38c2-4391-bb44-e19793f87b5f, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d8c60255-38c2-4391-bb44-e19793f87b5f,segment=NetworkSegment(a4ffcac7-6f90-4810-83d4-fda885e97f91),segment_id=a4ffcac7-6f90-4810-83d4-fda885e97f91)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:52.085378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2436f820-1f8b-438d-9193-bd407aab87e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.091403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.103751 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.197289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:52.197864 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:52.242077 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.263777 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4114ba7e-9074-4ee3-9bb3-aadaed9c6361 req-692b1ba8-2a95-490c-a79e-414c85ad6dd9 service neutron] 10.222.0.21 "GET /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4282355 Nov 24 04:15:52.288216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2436f820-1f8b-438d-9193-bd407aab87e3 None None] For port 322c5e09-5e5e-42ff-929e-20d32a6e85c5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=322c5e09-5e5e-42ff-929e-20d32a6e85c5,segment=NetworkSegment(6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949),segment_id=6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:52.307503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.309742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2436f820-1f8b-438d-9193-bd407aab87e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.317533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f319ba-a920-4a9a-9b47-27e56da5e6b6 None None] Pushing event updated for resources: {'Port': ['ID=d8c60255-38c2-4391-bb44-e19793f87b5f,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:52.401402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network 9a60c328-9734-4436-9b31-6508f4dc33aa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:52.408469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:52.411205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:52.412153 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.416811 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Port': ['ID=036be06e-a47b-4d7d-a480-111a8519e12f,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:52.473139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-0a1906a7-6d1c-41e6-81e5-77f2be9a19a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:52.474798 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-0a1906a7-6d1c-41e6-81e5-77f2be9a19a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 945 time: 0.1697638 Nov 24 04:15:52.494750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:15:52.494750 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:15:52.508669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.524438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:52.526015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2436f820-1f8b-438d-9193-bd407aab87e3 None None] Pushing event updated for resources: {'Port': ['ID=322c5e09-5e5e-42ff-929e-20d32a6e85c5,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:52.554881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.560728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9c5b8cc4-c292-4080-a458-d4194147abcc None None] Provisioning complete for port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:52.561665 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9c5b8cc4-c292-4080-a458-d4194147abcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.643744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc0dcee-6306-4b4e-bb74-4f72217db7f5 req-fad540f1-5612-4de6-a477-6c9c465695c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:52.646617 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3dc0dcee-6306-4b4e-bb74-4f72217db7f5 req-fad540f1-5612-4de6-a477-6c9c465695c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 945 time: 0.0635881 Nov 24 04:15:52.679814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.681613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Network 91b88d0a-d969-4d96-9310-bcbf237c050f is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:52.708411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:52.712978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:52.719684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Pushing event updated for resources: {'Port': ['ID=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:52.720215 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3dc0dcee-6306-4b4e-bb74-4f72217db7f5 req-d5dbe288-818f-4795-a5e6-60ee5d729e57 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=bc748bf0-50f6-406a-9e3c-703c4e328b94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638974 Nov 24 04:15:52.761874 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:52.762226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:52.964619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 45a441c0-edd7-4702-b94f-f2ff19ae82d4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=45a441c0-edd7-4702-b94f-f2ff19ae82d4,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:52.964988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.011846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 45a441c0-edd7-4702-b94f-f2ff19ae82d4 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:53.035014 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Attempting to bind port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:53.035620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Attempting to bind port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '57191ded-58d1-49b7-804c-f716d5a5a056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:53.035732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Attempting to bind port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 on network 91b88d0a-d969-4d96-9310-bcbf237c050f {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:53.052660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:53.053040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Checking segment: {'id': '57191ded-58d1-49b7-804c-f716d5a5a056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:53.053444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.053832 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Bound using segment: {'id': '57191ded-58d1-49b7-804c-f716d5a5a056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:53.054333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Bound port: 9d5344ac-5ac2-49e2-934f-bfad0a00ed35, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '57191ded-58d1-49b7-804c-f716d5a5a056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 156, 'network_id': '91b88d0a-d969-4d96-9310-bcbf237c050f'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:53.054716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.117553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.131641 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.132541 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.159204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] For port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:53.163117 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] For port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,segment=NetworkSegment(57191ded-58d1-49b7-804c-f716d5a5a056),segment_id=57191ded-58d1-49b7-804c-f716d5a5a056)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:53.166543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:02Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:53.193665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Port': ['ID=036be06e-a47b-4d7d-a480-111a8519e12f,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:53.206075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.231262 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9a657ae-7f50-4947-8ad2-81ee3263e8be None None] The sync data for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv is: [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:55Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'e009693e-ddac-4259-989a-571f846daec3', 'name': '', 'network_id': '38418e10-00b7-4e21-8d7a-91bfeb87756f', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:8b:5e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_interface', 'standard_attr_id': 1243, 'fixed_ips': [{'subnet_id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:53Z', 'updated_at': '2021-11-24T04:15:02Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'f2125981-3937-4d3b-9f58-7dca17c52922', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:53.279359 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee31a4a-0500-4031-852e-c3cbe0acca7d None None] Pushing event updated for resources: {'Port': ['ID=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:53.292896 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.332267 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d8c60255-38c2-4391-bb44-e19793f87b5f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:53.378204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=45a441c0-edd7-4702-b94f-f2ff19ae82d4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:53.427738 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port d8c60255-38c2-4391-bb44-e19793f87b5f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:53.428096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.439900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port 45a441c0-edd7-4702-b94f-f2ff19ae82d4 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:53.443835 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.447326 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-60b45c76-fce2-4a06-bd9c-47d1af97625b req-1c1f5b39-0a6f-4629-9187-0ec07ebe44b6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "DELETE /v2.0/ports/45a441c0-edd7-4702-b94f-f2ff19ae82d4 HTTP/1.1" status: 204 len: 173 time: 0.9285905 Nov 24 04:15:53.447793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'name': 'network-vif-deleted', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:15:53.450134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5fbbc73e-1fcc-4b2c-92f9-8428b419c06a" -d '{"events": [{"server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "name": "network-vif-deleted", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:15:53.469074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network 9a60c328-9734-4436-9b31-6508f4dc33aa is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:53.475807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:53.580534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:15:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc563f22-d437-4f3d-ada8-d7d938ef9745 x-openstack-request-id: req-fc563f22-d437-4f3d-ada8-d7d938ef9745 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:15:53.580890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c0e09302-129f-434e-b906-27aba7da5f5a", "name": "network-vif-deleted", "tag": "45a441c0-edd7-4702-b94f-f2ff19ae82d4", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:15:53.581171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-fc563f22-d437-4f3d-ada8-d7d938ef9745 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:15:53.581600 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0e09302-129f-434e-b906-27aba7da5f5a', 'name': 'network-vif-deleted', 'tag': '45a441c0-edd7-4702-b94f-f2ff19ae82d4', 'status': 'completed', 'code': 200} Nov 24 04:15:53.598295 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.663632 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port d8c60255-38c2-4391-bb44-e19793f87b5f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d8c60255-38c2-4391-bb44-e19793f87b5f,segment=NetworkSegment(a4ffcac7-6f90-4810-83d4-fda885e97f91),segment_id=a4ffcac7-6f90-4810-83d4-fda885e97f91)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:53.669113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.670692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 322c5e09-5e5e-42ff-929e-20d32a6e85c5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:53.693325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Router 2e96b48b-df64-4537-8613-8a72b3074c26 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:15:53.723575 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60b72558-5a3f-45d1-a077-1f34063b983e None None] New status for floating IP 66c2cbfa-c6dc-4450-89c5-0378168c210b: DOWN {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:15:53.741063 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4a2c1e4-2264-4bd8-8d4d-80ef24842cfb None None] Network 9a60c328-9734-4436-9b31-6508f4dc33aa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:53.851768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:53.872913 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ff148dc9-a27c-4bc3-95a4-e5097dcd34a4 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1141844 Nov 24 04:15:53.874263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35644) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:53.913242 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e6615df1-a346-4e4b-bb0b-1c6ff4f6f8da req-512e75a9-0f84-41fd-840a-489526a7e2af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=c0e09302-129f-434e-b906-27aba7da5f5a HTTP/1.1" status: 200 len: 210 time: 0.0519409 Nov 24 04:15:53.927695 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] Sync routers for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:53.981924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ea33657a-ec7d-4faa-b145-1e5ad5c81a45 None None] Provisioning complete for port d8c60255-38c2-4391-bb44-e19793f87b5f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:53.983324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ea33657a-ec7d-4faa-b145-1e5ad5c81a45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:53.986012 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=d8c60255-38c2-4391-bb44-e19793f87b5f,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:53.993414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:53.994035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:54.059993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:54.075079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:54.075985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:54.142696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:54.143337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:54.190635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:54.191266 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84142b05-f92b-495b-9f8d-6e7cf3a1cebf None None] The sync data for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:54.322782 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-a9cce1ce-a690-4411-b1c9-cc0ce21a65d3 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:15:54.323847 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a9cce1ce-a690-4411-b1c9-cc0ce21a65d3 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.4484570 Nov 24 04:15:54.326724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35646) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:54.386171 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:15:54.628606 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ae15932c-b2b9-4cc6-b5fa-e0ca45f33882 None None] Provisioning complete for port d8c60255-38c2-4391-bb44-e19793f87b5f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:54.629082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae15932c-b2b9-4cc6-b5fa-e0ca45f33882 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:54.660366 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:54.692991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e1be50b-22d1-4088-a129-68fce16924df None None] Network 91b88d0a-d969-4d96-9310-bcbf237c050f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:54.810208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ae15932c-b2b9-4cc6-b5fa-e0ca45f33882 None None] Provisioning complete for port 036be06e-a47b-4d7d-a480-111a8519e12f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:54.810582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ae15932c-b2b9-4cc6-b5fa-e0ca45f33882 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:54.872539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ae15932c-b2b9-4cc6-b5fa-e0ca45f33882 None None] Port 036be06e-a47b-4d7d-a480-111a8519e12f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:54.940520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting port 036be06e-a47b-4d7d-a480-111a8519e12f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:54.940862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:54.976449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35650) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:54.995199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Provisioning complete for port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:54.995453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.042846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.049250 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8133dcce-e21f-45c8-841d-c13377f8e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.058372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Calling delete_port for 036be06e-a47b-4d7d-a480-111a8519e12f owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:55.080065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8133dcce-e21f-45c8-841d-c13377f8e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.087183 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.130408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] For port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,segment=NetworkSegment(57191ded-58d1-49b7-804c-f716d5a5a056),segment_id=57191ded-58d1-49b7-804c-f716d5a5a056)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:55.138389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.192185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8133dcce-e21f-45c8-841d-c13377f8e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.195449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8133dcce-e21f-45c8-841d-c13377f8e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.197155 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8133dcce-e21f-45c8-841d-c13377f8e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/bc748bf0-50f6-406a-9e3c-703c4e328b94 HTTP/1.1" status: 204 len: 168 time: 0.2196400 Nov 24 04:15:55.213366 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8133dcce-e21f-45c8-841d-c13377f8e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc748bf0-50f6-406a-9e3c-703c4e328b94,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:55.227027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Provisioning complete for port 036be06e-a47b-4d7d-a480-111a8519e12f triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:55.227402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.239317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35654) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:55.271970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Pushing event updated for resources: {'Port': ['ID=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:55.286783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f67fbc9b-31c9-4ec0-b2d4-80cd33de15f8 None None] Port 036be06e-a47b-4d7d-a480-111a8519e12f cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:55.352013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d8c60255-38c2-4391-bb44-e19793f87b5f up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:55.411412 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1e8ef8f5-56b1-4f44-aa56-84b9f9f464c3 None None] Provisioning complete for port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:55.411890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1e8ef8f5-56b1-4f44-aa56-84b9f9f464c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.438466 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port d8c60255-38c2-4391-bb44-e19793f87b5f triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:55.438946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.573344 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:55.616807 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.622985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:55.623998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.640110 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.648161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Port': ['ID=036be06e-a47b-4d7d-a480-111a8519e12f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:55.752203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.916163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Router 2e96b48b-df64-4537-8613-8a72b3074c26 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:55.925669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port e009693e-ddac-4259-989a-571f846daec3 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:55.926018 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:55.991878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:56.001090 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f1e833d8-b1d5-408e-a260-8f1e255dcfd2 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6732023 Nov 24 04:15:56.001886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35656) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:56.003878 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] Sync routers for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:56.016325 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:56.016960 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:56.046131 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-d2039bd3-d4d0-4232-bf70-d1fb76959a13 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] delete failed (client error): The resource could not be found. Nov 24 04:15:56.047795 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d2039bd3-d4d0-4232-bf70-d1fb76959a13 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/routers/tempest-non_exist_router-456799896 HTTP/1.1" status: 404 len: 334 time: 0.0444932 Nov 24 04:15:56.051303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35658) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:56.052647 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:56.056335 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8c4671ac-a098-4cf7-ae00-01e5c99d411a tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'router': {'external_gateway_info': {'network_id': '2e96b48b-df64-4537-8613-8a72b3074c26'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:56.063289 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:56.063914 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:56.099561 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:56.100123 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9fb7f78-8b23-4161-821a-533326b1264f None None] The sync data for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:56.146742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 45a441c0-edd7-4702-b94f-f2ff19ae82d4 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:56.167997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: 45a441c0-edd7-4702-b94f-f2ff19ae82d4 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:56.168358 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 45a441c0-edd7-4702-b94f-f2ff19ae82d4 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:56.274862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8c4671ac-a098-4cf7-ae00-01e5c99d411a tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.294794 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-8c4671ac-a098-4cf7-ae00-01e5c99d411a tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] update failed (client error): The resource could not be found. Nov 24 04:15:56.295987 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8c4671ac-a098-4cf7-ae00-01e5c99d411a tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26 HTTP/1.1" status: 404 len: 339 time: 0.2434316 Nov 24 04:15:56.299536 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35660) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:56.304538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1843748761'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:56.305987 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port e009693e-ddac-4259-989a-571f846daec3, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=e009693e-ddac-4259-989a-571f846daec3,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:56.306538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.319483 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for e009693e-ddac-4259-989a-571f846daec3 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:56.330474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'network': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:56.333897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.357217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] vlan segment allocate from pool success with {'vlan_id': 151, 'physical_network': 'physnet1'} {{(pid=103381) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:56.366349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.366701 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.segments_db [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Added segment fe520185-ec31-4be9-8463-464c87a71a19 of type vlan for network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 Nov 24 04:15:56.406162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.430515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.436174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:56.436818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.478073 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.1771610 Nov 24 04:15:56.480751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35662) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:56.487919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'subnet': {'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:56.508956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08642126-5527-4edf-9282-457058f5f743 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Network': ['ID=69362e7a-a0ee-4e89-ad8e-01c5119caf00,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:56.519693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:56.535633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.599509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=e009693e-ddac-4259-989a-571f846daec3,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:56.674657 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Made reservation on behalf of a74af4a1bbbe4607bf2e9ca69c90e3fa for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:56.678163 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:56.859044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.037928 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.147718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Subnet': ['ID=f73d7ee3-4a00-43a5-81a2-c651fb36b49e,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:57.189844 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Checking segment: {'id': 'fe520185-ec31-4be9-8463-464c87a71a19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:57.190235 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network hostable DHCP agents. Network: 69362e7a-a0ee-4e89-ad8e-01c5119caf00, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:15:57.215768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:15:57.217173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:15:57.230607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 69362e7a-a0ee-4e89-ad8e-01c5119caf00) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:57.233992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 3fa77305-8276-4287-a9eb-5efe6a409e17 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:57.236881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:57.237492 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.241265 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-009eaef7-b232-41e2-a55d-2f708fe57ea3 None None] Network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:57.259417 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e5bc5c6b-2da7-44aa-9a91-ef3c628d1921 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.7774396 Nov 24 04:15:57.262345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35664) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:57.267238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-a343d9ce-a7a0-4aa7-b8b2-8cda41ce6721 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'router': {'external_gateway_info': {'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:57.373185 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:57.379444 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e1032d93-5ecc-4136-8198-19620f18c7af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/3fa77305-8276-4287-a9eb-5efe6a409e17/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1388934 Nov 24 04:15:57.381988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35666) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:57.440540 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting subnet f2125981-3937-4d3b-9f58-7dca17c52922 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:15:57.445656 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.460227 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] Sync routers for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:57.488400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a343d9ce-a7a0-4aa7-b8b2-8cda41ce6721 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.490398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:57.491027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:57.496072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.550869 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:57.551483 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.583048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.593758 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-a343d9ce-a7a0-4aa7-b8b2-8cda41ce6721 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 04:15:57.595587 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a343d9ce-a7a0-4aa7-b8b2-8cda41ce6721 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26 HTTP/1.1" status: 400 len: 364 time: 0.3316722 Nov 24 04:15:57.599566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35668) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:57.649888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.689407 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.693555 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/subnets/f2125981-3937-4d3b-9f58-7dca17c52922 HTTP/1.1" status: 204 len: 168 time: 0.3103926 Nov 24 04:15:57.694127 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-69362e7a-a0ee-4e89-ad8e-01c5119caf00', 'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00', 'tenant_id': 'a74af4a1bbbe4607bf2e9ca69c90e3fa', 'fixed_ips': [{'subnet_id': 'f73d7ee3-4a00-43a5-81a2-c651fb36b49e'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:15:57.694684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7b0fc2-9545-43f6-b1ce-03209b07884a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Subnet': ['ID=f2125981-3937-4d3b-9f58-7dca17c52922,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:57.694994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.697195 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35670) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:57.708363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:57.718562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb90a43b-1b31-4197-8087-781a8e1bffbf None None] Network 38418e10-00b7-4e21-8d7a-91bfeb87756f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:15:57.806048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.913842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.918582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:57.982447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 1fe8009f-8694-49b5-a31d-087301231349 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:57.982793 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.066921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 1fe8009f-8694-49b5-a31d-087301231349, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=1fe8009f-8694-49b5-a31d-087301231349,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:58.067441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.081512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 1fe8009f-8694-49b5-a31d-087301231349 owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:58.128385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Allocated IP 2001:db8:1::2 (69362e7a-a0ee-4e89-ad8e-01c5119caf00/f73d7ee3-4a00-43a5-81a2-c651fb36b49e/81b1897c-d3a1-4640-a84f-b891f8bed721) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:58.194934 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Allocated IP 2001:db8::1 (abf8162e-342f-48d3-8724-08bc35ee99ae/2e4a04d6-291e-40a0-a67f-da0ddfe763e2/450da18f-5648-423c-8273-f57a9c40d318) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:15:58.227160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] DHCP port deletion for 38418e10-00b7-4e21-8d7a-91bfeb87756f request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:58.258580 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71'}], 'enable_snat': True}, 'gw_port_id': '1fe8009f-8694-49b5-a31d-087301231349', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:15:56Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': '1fe8009f-8694-49b5-a31d-087301231349', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1d:67:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1237, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:14:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:58.282043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.290637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] Checking router: 3fa77305-8276-4287-a9eb-5efe6a409e17 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:15:58.308885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=1fe8009f-8694-49b5-a31d-087301231349,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:58.327337 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8980db68-8af2-435b-a38c-d2340d30cc0d None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:15:58.331794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.367901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.371894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] Routers {'3fa77305-8276-4287-a9eb-5efe6a409e17'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:58.372813 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['3fa77305-8276-4287-a9eb-5efe6a409e17'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:58.381842 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.417485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network abf8162e-342f-48d3-8724-08bc35ee99ae is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:58.420675 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:58.424364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:58.424904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.430922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Port': ['ID=450da18f-5648-423c-8273-f57a9c40d318,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:58.472610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.488498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] Deleting port 4ef31e67-d644-4395-835a-e1c0164a7504 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:58.488886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.489993 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.492868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.497106 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] Set router 3fa77305-8276-4287-a9eb-5efe6a409e17 gateway port host: None {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:15:58.546961 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.547532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Fanout notify agent at l3_agent the message router_deleted on router 3fa77305-8276-4287-a9eb-5efe6a409e17 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:15:58.555314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.556519 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-0e438952-7a01-4592-b681-7cf0ced8d6f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/routers/3fa77305-8276-4287-a9eb-5efe6a409e17 HTTP/1.1" status: 204 len: 168 time: 0.8583980 Nov 24 04:15:58.561803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35672) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:58.568465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.570018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.614884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:58.620557 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:58.623807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:15:58Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port_host': None}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:58.628360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:15:58.654716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.696422 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cab3965-6dd8-496c-9dfc-2ad3156ea991 None None] The sync data for ids ['3fa77305-8276-4287-a9eb-5efe6a409e17'] in dv-neutron-819049-1-hyperv is: [{'id': '3fa77305-8276-4287-a9eb-5efe6a409e17', 'name': 'tempest-TestNetworkBasicOps-router-504363531', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:14:49Z', 'updated_at': '2021-11-24T04:15:58Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port_host': None}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:58.727812 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 4ef31e67-d644-4395-835a-e1c0164a7504 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:15:58.728152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.783307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Pushing event updated for resources: {'Port': ['ID=81b1897c-d3a1-4640-a84f-b891f8bed721,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:58.793743 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] For port 4ef31e67-d644-4395-835a-e1c0164a7504, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4ef31e67-d644-4395-835a-e1c0164a7504,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:58.795474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.800290 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 4ef31e67-d644-4395-835a-e1c0164a7504, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=4ef31e67-d644-4395-835a-e1c0164a7504,segment=NetworkSegment(9aa54d37-a4e0-411f-959a-ce8a29b58669),segment_id=9aa54d37-a4e0-411f-959a-ce8a29b58669)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:15:58.800660 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.813955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 4ef31e67-d644-4395-835a-e1c0164a7504 owned by network:dhcp {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:58.833762 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] Calling delete_port for 4ef31e67-d644-4395-835a-e1c0164a7504 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:15:58.840464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-abe0351d-fbeb-4f7e-9a9e-40068c7fa939 None None] Provisioning complete for port 450da18f-5648-423c-8273-f57a9c40d318 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:58.840913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-abe0351d-fbeb-4f7e-9a9e-40068c7fa939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.842554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Attempting to bind port 81b1897c-d3a1-4640-a84f-b891f8bed721 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:15:58.842985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Attempting to bind port 81b1897c-d3a1-4640-a84f-b891f8bed721 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fe520185-ec31-4be9-8463-464c87a71a19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:15:58.843438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Attempting to bind port 81b1897c-d3a1-4640-a84f-b891f8bed721 on network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:15:58.875845 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.876576 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:15:58.876968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Checking segment: {'id': 'fe520185-ec31-4be9-8463-464c87a71a19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:15:58.877473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.877736 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Bound using segment: {'id': 'fe520185-ec31-4be9-8463-464c87a71a19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:15:58.878269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Bound port: 81b1897c-d3a1-4640-a84f-b891f8bed721, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fe520185-ec31-4be9-8463-464c87a71a19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 151, 'network_id': '69362e7a-a0ee-4e89-ad8e-01c5119caf00'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:15:58.878725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.881752 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.882659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.905943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:58.938328 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=4ef31e67-d644-4395-835a-e1c0164a7504,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:58.942826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port 4ef31e67-d644-4395-835a-e1c0164a7504 on host dv-neutron-819049-1-hyperv {{(pid=103380) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:58.952191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-abe0351d-fbeb-4f7e-9a9e-40068c7fa939 None None] Port 450da18f-5648-423c-8273-f57a9c40d318 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:58.987646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event updated for resources: {'Port': ['ID=450da18f-5648-423c-8273-f57a9c40d318,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:59.019291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Network abf8162e-342f-48d3-8724-08bc35ee99ae is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:15:59.020794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:15:59.027057 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] For port 81b1897c-d3a1-4640-a84f-b891f8bed721, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:15:59.030336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.033723 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] For port 81b1897c-d3a1-4640-a84f-b891f8bed721, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=81b1897c-d3a1-4640-a84f-b891f8bed721,segment=NetworkSegment(fe520185-ec31-4be9-8463-464c87a71a19),segment_id=fe520185-ec31-4be9-8463-464c87a71a19)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:15:59.043626 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.068336 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.072682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] Pushing event deleted for resources: {'Port': ['ID=4ef31e67-d644-4395-835a-e1c0164a7504,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:59.083628 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['38418e10-00b7-4e21-8d7a-91bfeb87756f']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.084077 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a18492b8-e858-4f48-b986-6244654d06f3 None None] No DVR routers for this DVR port 4ef31e67-d644-4395-835a-e1c0164a7504 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:15:59.122323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9aa54d37-a4e0-411f-959a-ce8a29b58669') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.123096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9aa54d37-a4e0-411f-959a-ce8a29b58669') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.144019 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.160937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.167808 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Releasing vlan 152 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:15:59.168215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.185996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Router 2e96b48b-df64-4537-8613-8a72b3074c26 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:15:59.202848 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:15:59.272634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.277856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.281880 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/networks/38418e10-00b7-4e21-8d7a-91bfeb87756f HTTP/1.1" status: 204 len: 168 time: 0.7190127 Nov 24 04:15:59.294757 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35674) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:59.308286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--750112511', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:59.313233 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902bc7ac-2939-4e28-ac3d-b6e74b357df6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Network': ['ID=38418e10-00b7-4e21-8d7a-91bfeb87756f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:59.334788 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:15:59.338467 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.368274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 167, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:15:59.381346 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.381710 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment d012a997-a23a-493b-b4eb-600dd03b33a3 of type vlan for network cc47f608-eaac-4acd-9462-96543f06a23d Nov 24 04:15:59.396491 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f726173a-d49e-4d87-9a4f-de4f99ff4d30 None None] Pushing event updated for resources: {'Port': ['ID=81b1897c-d3a1-4640-a84f-b891f8bed721,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:59.443389 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.471901 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.478518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:15:59.479164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.500778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-38b0dbae-ef52-468e-b891-fad34bb6bc4b None None] Provisioning complete for port 450da18f-5648-423c-8273-f57a9c40d318 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:15:59.501154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38b0dbae-ef52-468e-b891-fad34bb6bc4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.539886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-38b0dbae-ef52-468e-b891-fad34bb6bc4b None None] Port 450da18f-5648-423c-8273-f57a9c40d318 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:15:59.548578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=cc47f608-eaac-4acd-9462-96543f06a23d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:15:59.557068 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b777ef52-56ed-4cf4-824b-0e5aeda7fe46 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2528198 Nov 24 04:15:59.560722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35676) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:59.562000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network cc47f608-eaac-4acd-9462-96543f06a23d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:15:59.572168 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'admin_state_up': True, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:15:59.628485 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.630668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.687573 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e009693e-ddac-4259-989a-571f846daec3 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:59.716303 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.735498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: e009693e-ddac-4259-989a-571f846daec3 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:59.735749 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:15:59.736204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device e009693e-ddac-4259-989a-571f846daec3 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:59.736204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4ef31e67-d644-4395-835a-e1c0164a7504 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:15:59.741535 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-10fa88ce-5f0f-4fba-8867-39d7ef859b23 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1407449 Nov 24 04:15:59.744139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35678) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:15:59.746394 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] Sync routers for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:15:59.771036 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:59.771871 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.774028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 4ef31e67-d644-4395-835a-e1c0164a7504 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:15:59.774421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 4ef31e67-d644-4395-835a-e1c0164a7504 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:15:59.832560 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.851491 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:15:59.852694 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.866124 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7b719cba-d11a-4c1a-801d-2d6caf05524e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.893349 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:15:59.893998 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3045365-3915-4a51-8978-631460af5ad2 None None] The sync data for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:15:59.911266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:15:59.969187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-7b719cba-d11a-4c1a-801d-2d6caf05524e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 24 04:15:59.972980 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7b719cba-d11a-4c1a-801d-2d6caf05524e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26 HTTP/1.1" status: 409 len: 329 time: 0.2250435 Nov 24 04:15:59.973143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35680) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:00.121828 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.141010 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.255513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.62 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/a2998e69-c857-42ba-997c-e6b38755303c) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:00.306887 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.368725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.408130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.457448 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:00.461268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:00.466308 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:00.470129 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=a2998e69-c857-42ba-997c-e6b38755303c,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:00.478392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0898c1d8-1b66-4922-9e19-6a933236fad4 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:00.590083 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f1ce4edb-f49a-47da-a2a3-3c2e50002686 None None] Provisioning complete for port a2998e69-c857-42ba-997c-e6b38755303c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:00.590485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f1ce4edb-f49a-47da-a2a3-3c2e50002686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.600044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting port 450da18f-5648-423c-8273-f57a9c40d318 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:00.600516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.647722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f1ce4edb-f49a-47da-a2a3-3c2e50002686 None None] Port a2998e69-c857-42ba-997c-e6b38755303c cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:00.664854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cef80d23-b72a-44a5-8aa0-b82f04d92b9a None None] Network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:00.720020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.741240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Calling delete_port for 450da18f-5648-423c-8273-f57a9c40d318 owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:00.800204 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.805461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-99848690-1c43-4ec0-be6b-babc0280dc60 None None] Provisioning complete for port 81b1897c-d3a1-4640-a84f-b891f8bed721 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:00.806035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99848690-1c43-4ec0-be6b-babc0280dc60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.937044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99848690-1c43-4ec0-be6b-babc0280dc60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.971534 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-99848690-1c43-4ec0-be6b-babc0280dc60 None None] For port 81b1897c-d3a1-4640-a84f-b891f8bed721, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=81b1897c-d3a1-4640-a84f-b891f8bed721,segment=NetworkSegment(fe520185-ec31-4be9-8463-464c87a71a19),segment_id=fe520185-ec31-4be9-8463-464c87a71a19)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:00.973318 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:00.980205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99848690-1c43-4ec0-be6b-babc0280dc60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.006909 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Port': ['ID=450da18f-5648-423c-8273-f57a9c40d318,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:01.050571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99848690-1c43-4ec0-be6b-babc0280dc60 None None] Pushing event updated for resources: {'Port': ['ID=81b1897c-d3a1-4640-a84f-b891f8bed721,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:01.121383 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.171384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.330074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a68d301e-ae91-4391-b8c2-9eb7d3e8b7b9 None None] Provisioning complete for port 81b1897c-d3a1-4640-a84f-b891f8bed721 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:01.330714 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a68d301e-ae91-4391-b8c2-9eb7d3e8b7b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.377323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 81b1897c-d3a1-4640-a84f-b891f8bed721 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:01.435369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Router 2e96b48b-df64-4537-8613-8a72b3074c26 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:01.469240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 81b1897c-d3a1-4640-a84f-b891f8bed721 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:01.469616 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.520556 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:01.531889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c261e960-a25f-407f-a1bd-1a1efbf133ee tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5571976 Nov 24 04:16:01.532445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35682) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:01.569175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] Sync routers for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:01.580808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1fe8009f-8694-49b5-a31d-087301231349 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:01.583382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-69a76450-dee9-48c2-89a7-00c6b213458e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] show failed (client error): The resource could not be found. Nov 24 04:16:01.590639 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-69a76450-dee9-48c2-89a7-00c6b213458e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "GET /v2.0/routers/tempest-non_exist_router-259062447 HTTP/1.1" status: 404 len: 334 time: 0.0570643 Nov 24 04:16:01.591276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35684) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:01.596358 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-696f0f57-e6f2-4169-92f7-a6d1dcd4b43b tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Request body: {'router': {'name': 'new_name'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:01.603671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:01.604313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:01.633295 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.api.v2.resource [None req-696f0f57-e6f2-4169-92f7-a6d1dcd4b43b tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] update failed (client error): The resource could not be found. Nov 24 04:16:01.638046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 1fe8009f-8694-49b5-a31d-087301231349 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:01.638426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 1fe8009f-8694-49b5-a31d-087301231349 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:01.640979 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:01.643255 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-696f0f57-e6f2-4169-92f7-a6d1dcd4b43b tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "PUT /v2.0/routers/tempest-non_exist_router-314391680 HTTP/1.1" status: 404 len: 334 time: 0.0507381 Nov 24 04:16:01.644206 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35686) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:01.650742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] Routers {'2e96b48b-df64-4537-8613-8a72b3074c26'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:01.651357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['2e96b48b-df64-4537-8613-8a72b3074c26'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:01.689206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:01.689862 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40a50222-b342-47be-bace-2be3981f2df6 None None] The sync data for ids ['2e96b48b-df64-4537-8613-8a72b3074c26'] in dv-neutron-819049-1-hyperv is: [] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:01.708565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:16:01.714483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting subnet f73d7ee3-4a00-43a5-81a2-c651fb36b49e {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:16:01.718249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.769651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.825001 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:01.836690 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:01.850431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.851822 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:01.855655 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:01.855849 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-34ce5fb5-2d0f-4066-ac24-c89c5acb50c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 2.2906928 Nov 24 04:16:01.855969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35688) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:01.868661 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.893787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f3dd1ec7-f5f0-4168-871d-3b1675ce2760 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0367470 Nov 24 04:16:01.896384 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35690) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:01.936398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.970869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Subnet': ['ID=f73d7ee3-4a00-43a5-81a2-c651fb36b49e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:01.974682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:01.980066 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:01.981894 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ec0bcbed-1d3b-4715-9484-2b23c6fce498 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/subnets/f73d7ee3-4a00-43a5-81a2-c651fb36b49e HTTP/1.1" status: 204 len: 168 time: 0.3366575 Nov 24 04:16:01.983179 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35692) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:01.992498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0d7d287-0dae-4316-b3e8-06673eefa67e None None] Network 69362e7a-a0ee-4e89-ad8e-01c5119caf00 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:02.067043 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea652c7e-5b39-405b-b8a0-cc4dcacc8aa6 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:02.071263 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ea652c7e-5b39-405b-b8a0-cc4dcacc8aa6 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1714826 Nov 24 04:16:02.072101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35694) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:02.120864 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-76426131-7261-45b6-bc0e-c831bdccb429 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0451252 Nov 24 04:16:02.121261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35696) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:02.126879 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-602846484', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:02.133269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.195000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting port 81b1897c-d3a1-4640-a84f-b891f8bed721 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:02.195688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.211779 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:00Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:02.240749 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:02.241207 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Updating router a4275832-60be-4568-aa83-97963f2ab8c7 port a2998e69-c857-42ba-997c-e6b38755303c binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:16:02.243679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:16:02.248093 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.268631 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.275708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] For port 81b1897c-d3a1-4640-a84f-b891f8bed721, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=81b1897c-d3a1-4640-a84f-b891f8bed721,segment=NetworkSegment(fe520185-ec31-4be9-8463-464c87a71a19),segment_id=fe520185-ec31-4be9-8463-464c87a71a19)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:02.276127 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.277694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] DHCP port deletion for 69362e7a-a0ee-4e89-ad8e-01c5119caf00 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:02.290732 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Calling delete_port for 81b1897c-d3a1-4640-a84f-b891f8bed721 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:02.339210 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] Deleting port 81b1897c-d3a1-4640-a84f-b891f8bed721 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:02.340269 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.387188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.418169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Port': ['ID=81b1897c-d3a1-4640-a84f-b891f8bed721,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:02.425015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] No DVR routers for this DVR port 81b1897c-d3a1-4640-a84f-b891f8bed721 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:02.436400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] For port 81b1897c-d3a1-4640-a84f-b891f8bed721, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=81b1897c-d3a1-4640-a84f-b891f8bed721,segment=NetworkSegment(fe520185-ec31-4be9-8463-464c87a71a19),segment_id=fe520185-ec31-4be9-8463-464c87a71a19)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:02.436795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.450672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] Calling delete_port for 81b1897c-d3a1-4640-a84f-b891f8bed721 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:02.487823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.519508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.550622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.558050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['69362e7a-a0ee-4e89-ad8e-01c5119caf00']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:02.570731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fe520185-ec31-4be9-8463-464c87a71a19') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:02.571114 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fe520185-ec31-4be9-8463-464c87a71a19') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:02.575764 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:02.576795 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: cc47f608-eaac-4acd-9462-96543f06a23d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:16:02.580301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=eb8cba97-6bd4-453b-a877-4a1ba469598b,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:02.585850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] Pushing event deleted for resources: {'Port': ['ID=81b1897c-d3a1-4640-a84f-b891f8bed721,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:02.589660 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1c61578-bacf-4326-9e1d-d74c0cce50ec None None] No DVR routers for this DVR port 81b1897c-d3a1-4640-a84f-b891f8bed721 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:02.597538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.603311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network cc47f608-eaac-4acd-9462-96543f06a23d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:16:02.614451 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, cc47f608-eaac-4acd-9462-96543f06a23d) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:02.614672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.621061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Releasing vlan 151 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:16:02.621532 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.623716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1df3eeef-64bc-432f-9000-c26e4b1d7916 None None] Network cc47f608-eaac-4acd-9462-96543f06a23d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:16:02.625557 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:16:02.628102 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:02.628553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.657994 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-3da6407d-23ce-4288-bf5b-2b4692739bb1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.5327215 Nov 24 04:16:02.658354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35698) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:02.693822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.694506 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.705141 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.709205 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.719642 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/networks/69362e7a-a0ee-4e89-ad8e-01c5119caf00 HTTP/1.1" status: 204 len: 168 time: 0.7284820 Nov 24 04:16:02.719642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35700) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:02.753425 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71c73de-bfa9-4d48-93b4-bd132a7591c1 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Network': ['ID=69362e7a-a0ee-4e89-ad8e-01c5119caf00,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:02.753804 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a2fabf1-25cc-4d63-a500-0451e7c8724d None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:02.800110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting subnet 2c22b9c6-2820-440b-bc9c-009784bcf2d1 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:16:02.804271 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Attempting to bind port a2998e69-c857-42ba-997c-e6b38755303c on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:16:02.804956 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Attempting to bind port a2998e69-c857-42ba-997c-e6b38755303c by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:16:02.805123 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.805363 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Attempting to bind port a2998e69-c857-42ba-997c-e6b38755303c on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:02.821913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-cc47f608-eaac-4acd-9462-96543f06a23d', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:16:02.822318 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:16:02.822836 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.822975 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:02.823470 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.823957 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:16:02.824735 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Bound port: a2998e69-c857-42ba-997c-e6b38755303c, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:16:02.825208 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.831455 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2041b568-c380-4c80-9756-372905a5dd70 None None] Pushing event updated for resources: {'Port': ['ID=a2998e69-c857-42ba-997c-e6b38755303c,revision_number=2']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:02.861165 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.901586 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] For port a2998e69-c857-42ba-997c-e6b38755303c, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:16:02.907155 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] For port a2998e69-c857-42ba-997c-e6b38755303c, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a2998e69-c857-42ba-997c-e6b38755303c,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:16:02.916640 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.948190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-5db8c619-3ca0-4d35-aa31-c53a9f12130b None None] Provisioning complete for port a2998e69-c857-42ba-997c-e6b38755303c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:02.948571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5db8c619-3ca0-4d35-aa31-c53a9f12130b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:02.975569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f50f8836-98bc-415f-ba1f-d3184f12b479 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:02.999753 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:03.000387 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:03.005053 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2041b568-c380-4c80-9756-372905a5dd70 None None] Pushing event updated for resources: {'Port': ['ID=a2998e69-c857-42ba-997c-e6b38755303c,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:03.028747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.039378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Allocated IP 172.20.0.2 (cc47f608-eaac-4acd-9462-96543f06a23d/eb8cba97-6bd4-453b-a877-4a1ba469598b/d59f28e8-6a29-4fe0-acf9-da907f47c836) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:03.107981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.139990 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:03.146403 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Subnet': ['ID=2c22b9c6-2820-440b-bc9c-009784bcf2d1,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:03.150198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.153075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5db8c619-3ca0-4d35-aa31-c53a9f12130b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.154182 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f60871ea-904d-4180-81a7-d36992a1b5aa tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/subnets/2c22b9c6-2820-440b-bc9c-009784bcf2d1 HTTP/1.1" status: 204 len: 168 time: 0.4373236 Nov 24 04:16:03.156528 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35702) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:03.163828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdbf2580-d58a-4e0e-bbbd-0127d6bb95f1 None None] Network 91b88d0a-d969-4d96-9310-bcbf237c050f requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:03.218831 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting subnet ca9d3d4d-17cf-4c9c-a5cf-87897304dd22 {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:16:03.222515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.224367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5db8c619-3ca0-4d35-aa31-c53a9f12130b None None] For port a2998e69-c857-42ba-997c-e6b38755303c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a2998e69-c857-42ba-997c-e6b38755303c,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:03.278661 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5db8c619-3ca0-4d35-aa31-c53a9f12130b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.278938 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.317612 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.353352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 81b1897c-d3a1-4640-a84f-b891f8bed721 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:03.373584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.413734 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:00Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:03.426110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 81b1897c-d3a1-4640-a84f-b891f8bed721 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:03.426525 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 81b1897c-d3a1-4640-a84f-b891f8bed721 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:03.446332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.455284 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0acb04f-0f4e-4c7a-ac9b-57972673757b None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:00Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:03.476425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.497019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.499594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-418fed5b-5843-4abe-a818-6ef15c2d1241 None None] Network 9a60c328-9734-4436-9b31-6508f4dc33aa requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:03.502778 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/subnets/ca9d3d4d-17cf-4c9c-a5cf-87897304dd22 HTTP/1.1" status: 204 len: 168 time: 0.3452029 Nov 24 04:16:03.505108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35704) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:03.505410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.506628 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e01eb47e-e452-4a43-bc44-ee808a97f4d7 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Subnet': ['ID=ca9d3d4d-17cf-4c9c-a5cf-87897304dd22,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:03.511630 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db8c619-3ca0-4d35-aa31-c53a9f12130b None None] Pushing event updated for resources: {'Port': ['ID=a2998e69-c857-42ba-997c-e6b38755303c,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:03.514100 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-910bbe07-f5e8-443e-97ef-a90cbe0e987b None None] Provisioning complete for port a2998e69-c857-42ba-997c-e6b38755303c triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:03.514549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-910bbe07-f5e8-443e-97ef-a90cbe0e987b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.592503 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Network cc47f608-eaac-4acd-9462-96543f06a23d is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:03.599165 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:03.609034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:03.642706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.671101 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Pushing event updated for resources: {'Port': ['ID=d59f28e8-6a29-4fe0-acf9-da907f47c836,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:03.682109 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.1 (cc47f608-eaac-4acd-9462-96543f06a23d/eb8cba97-6bd4-453b-a877-4a1ba469598b/2bc693d7-de18-4334-babc-0cdd54f76d8d) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:03.717642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] DHCP port deletion for 91b88d0a-d969-4d96-9310-bcbf237c050f request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:03.737069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:03.737558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.756495 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Attempting to bind port d59f28e8-6a29-4fe0-acf9-da907f47c836 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:16:03.756629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Attempting to bind port d59f28e8-6a29-4fe0-acf9-da907f47c836 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:16:03.756965 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Attempting to bind port d59f28e8-6a29-4fe0-acf9-da907f47c836 on network cc47f608-eaac-4acd-9462-96543f06a23d {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:03.816533 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:16:03.816914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Checking segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:03.817317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.817704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Bound using segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:16:03.818367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Bound port: d59f28e8-6a29-4fe0-acf9-da907f47c836, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:16:03.818758 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.843406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] For port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,segment=NetworkSegment(57191ded-58d1-49b7-804c-f716d5a5a056),segment_id=57191ded-58d1-49b7-804c-f716d5a5a056)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:03.845175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.851930 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.870914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Calling delete_port for 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:03.893099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.940368 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network cc47f608-eaac-4acd-9462-96543f06a23d is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:03.943994 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:03.949758 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:03.988606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:03.990106 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=2bc693d7-de18-4334-babc-0cdd54f76d8d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.019797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.031002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Port': ['ID=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.033960 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] No DVR routers for this DVR port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:04.141085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.156282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Deleting port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:04.157089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.170449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['91b88d0a-d969-4d96-9310-bcbf237c050f']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:04.172025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] For port d59f28e8-6a29-4fe0-acf9-da907f47c836, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:16:04.187185 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '57191ded-58d1-49b7-804c-f716d5a5a056') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:04.187625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '57191ded-58d1-49b7-804c-f716d5a5a056') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:04.195915 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] For port d59f28e8-6a29-4fe0-acf9-da907f47c836, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d59f28e8-6a29-4fe0-acf9-da907f47c836,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:16:04.206708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.207917 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.222756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.224025 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] DHCP port deletion for 9a60c328-9734-4436-9b31-6508f4dc33aa request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:04.229961 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.230653 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Releasing vlan 156 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:16:04.231157 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:16:04.235237 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:16:04.276900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] For port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35, host dv-neutron-819049-1-hyperv, got binding levels [] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:04.277453 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.313251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.320805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.321408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Calling delete_port for 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:04.324613 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/networks/91b88d0a-d969-4d96-9310-bcbf237c050f HTTP/1.1" status: 204 len: 168 time: 0.8142815 Nov 24 04:16:04.327546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35706) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:04.329325 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.ipam_backend_mixin [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 was not found and therefore no delete operation was performed {{(pid=103382) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 04:16:04.341960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.365381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Network 91b88d0a-d969-4d96-9310-bcbf237c050f is not hosted by any dhcp agent {{(pid=103382) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 24 04:16:04.366000 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] No DVR routers for this DVR port 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:04.367968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2783b5-9933-4f67-ad19-8bf478ab2f46 None None] Pushing event updated for resources: {'Port': ['ID=d59f28e8-6a29-4fe0-acf9-da907f47c836,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.404659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c539264-b355-4c67-9753-c9e9a3f6945e None None] Pushing event deleted for resources: {'Port': ['ID=9d5344ac-5ac2-49e2-934f-bfad0a00ed35,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.416561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] Deleting port d8c60255-38c2-4391-bb44-e19793f87b5f {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:04.417203 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.454378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.457500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c42f1cb-96cc-4bf9-b705-353e11ef81ca tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Network': ['ID=91b88d0a-d969-4d96-9310-bcbf237c050f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.516554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] For port d8c60255-38c2-4391-bb44-e19793f87b5f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d8c60255-38c2-4391-bb44-e19793f87b5f,segment=NetworkSegment(a4ffcac7-6f90-4810-83d4-fda885e97f91),segment_id=a4ffcac7-6f90-4810-83d4-fda885e97f91)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:04.517175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.528396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting port d8c60255-38c2-4391-bb44-e19793f87b5f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:04.528794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.534357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] Calling delete_port for d8c60255-38c2-4391-bb44-e19793f87b5f owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:04.627209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] For port d8c60255-38c2-4391-bb44-e19793f87b5f, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d8c60255-38c2-4391-bb44-e19793f87b5f,segment=NetworkSegment(a4ffcac7-6f90-4810-83d4-fda885e97f91),segment_id=a4ffcac7-6f90-4810-83d4-fda885e97f91)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:04.627585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.641650 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Calling delete_port for d8c60255-38c2-4391-bb44-e19793f87b5f owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:04.655719 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.665669 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.671685 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.692552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] Pushing event deleted for resources: {'Port': ['ID=d8c60255-38c2-4391-bb44-e19793f87b5f,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.703362 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f49c967-40b3-4396-876f-777bc77825f0 None None] No DVR routers for this DVR port d8c60255-38c2-4391-bb44-e19793f87b5f on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:04.773061 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:04.811694 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=2bc693d7-de18-4334-babc-0cdd54f76d8d,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:04.885215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network cc47f608-eaac-4acd-9462-96543f06a23d is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:04.886761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:04.957026 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f0a7da87-cb9a-4b4c-9725-f697ae11f281 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.007298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:05.051459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.077552 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Port': ['ID=d8c60255-38c2-4391-bb44-e19793f87b5f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:05.081084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] No DVR routers for this DVR port d8c60255-38c2-4391-bb44-e19793f87b5f on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:05.123974 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:05.128989 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-de01ce45-fca4-46a2-a140-8d146510574e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/a4275832-60be-4568-aa83-97963f2ab8c7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4697163 Nov 24 04:16:05.131574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35708) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:05.189545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.271545 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a60c328-9734-4436-9b31-6508f4dc33aa']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:05.301289 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a4ffcac7-6f90-4810-83d4-fda885e97f91') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:05.301665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a4ffcac7-6f90-4810-83d4-fda885e97f91') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:05.333973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.361562 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d59f28e8-6a29-4fe0-acf9-da907f47c836 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:05.372245 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.393293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Releasing vlan 174 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:16:05.393716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: self.session.flush() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:16:05.396874 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:16:05.416166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.416643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.416772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port d59f28e8-6a29-4fe0-acf9-da907f47c836 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:05.417106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.417240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.417559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.418010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.418690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.419158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.422734 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-320e5c62-3088-43ea-afca-70ed89967a29 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4924 time: 0.2901952 Nov 24 04:16:05.425518 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35710) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:05.483501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.494619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.498427 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/networks/9a60c328-9734-4436-9b31-6508f4dc33aa HTTP/1.1" status: 204 len: 168 time: 1.1699173 Nov 24 04:16:05.503806 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35712) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:05.507713 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.510940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f30077-7729-448c-90f7-3f9d8bf58e54 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Network': ['ID=9a60c328-9734-4436-9b31-6508f4dc33aa,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:05.550028 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port d59f28e8-6a29-4fe0-acf9-da907f47c836, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d59f28e8-6a29-4fe0-acf9-da907f47c836,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:05.555314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.556456 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a2998e69-c857-42ba-997c-e6b38755303c up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:05.566699 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.567161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.567607 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.568052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.568486 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.568922 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:05.573597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35714) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:05.573917 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-375df5d3-aebd-4f0c-bcf2-c4bbd53450b3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3961 time: 0.1469359 Nov 24 04:16:05.592679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting subnet 2e4a04d6-291e-40a0-a67f-da0ddfe763e2 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:16:05.597294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.649885 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.656768 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=d59f28e8-6a29-4fe0-acf9-da907f47c836,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:05.666054 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a2998e69-c857-42ba-997c-e6b38755303c triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:05.666685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.769032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:05.791011 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ebdc1bf5-2554-4195-b9a8-33c53b899c79 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2877 time: 0.2154405 Nov 24 04:16:05.835219 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d8c60255-38c2-4391-bb44-e19793f87b5f no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:05.861037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: d8c60255-38c2-4391-bb44-e19793f87b5f {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:05.861385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d8c60255-38c2-4391-bb44-e19793f87b5f not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:05.861803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:05.884307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:05.884658 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 9d5344ac-5ac2-49e2-934f-bfad0a00ed35 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:05.891625 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24080e51-bace-44d4-be01-1a36e3e97d87 None None] Network cc47f608-eaac-4acd-9462-96543f06a23d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:05.980359 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d4a6b619-38e7-431a-bb92-1cfed1fd0dfd None None] Provisioning complete for port d59f28e8-6a29-4fe0-acf9-da907f47c836 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:05.980767 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d4a6b619-38e7-431a-bb92-1cfed1fd0dfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.078506 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35718) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:06.086816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1163844741', 'description': 'tempest-secgroup-smoke-1163844741 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:06.112393 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.148971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:06.161438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:06.162082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:06.202529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.206704 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.213822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.236454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Subnet': ['ID=2e4a04d6-291e-40a0-a67f-da0ddfe763e2,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:06.251206 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.256752 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-68f73404-5b99-4ef0-a244-6f31b92e6d07 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/subnets/2e4a04d6-291e-40a0-a67f-da0ddfe763e2 HTTP/1.1" status: 204 len: 168 time: 0.7493620 Nov 24 04:16:06.259049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44f3b8dc-8fb2-4cce-8838-31ccefd4cfbd None None] Network abf8162e-342f-48d3-8724-08bc35ee99ae requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:06.261175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35720) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:06.271891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.275957 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1930425 Nov 24 04:16:06.276268 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35722) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:06.280953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7e308cfa-0137-4e23-b917-0559eeed8035', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:06.287365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-323224fb-0358-47f9-bb20-df069b7c3de8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7e308cfa-0137-4e23-b917-0559eeed8035,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:06.316169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.364028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.386709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.391809 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.392678 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:06.421058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b9bf91d5-7476-4205-a32b-748b67715370,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:06.425182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Deleting port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:06.425726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.445215 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.449522 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bc730cc4-c523-4040-b3e6-f961e45cf4dd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1722040 Nov 24 04:16:06.452286 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35724) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:06.459395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7e308cfa-0137-4e23-b917-0559eeed8035', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:06.476427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-99993011-a6b4-43e7-9c22-03db0bb1b920 None None] Provisioning complete for port d59f28e8-6a29-4fe0-acf9-da907f47c836 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:06.476807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99993011-a6b4-43e7-9c22-03db0bb1b920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.495893 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] For port 322c5e09-5e5e-42ff-929e-20d32a6e85c5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=322c5e09-5e5e-42ff-929e-20d32a6e85c5,segment=NetworkSegment(6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949),segment_id=6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:06.496272 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.497955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.518108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Calling delete_port for 322c5e09-5e5e-42ff-929e-20d32a6e85c5 owned by network:dhcp {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:06.590619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.598136 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.629508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.653725 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ac3e22d-ccc1-4eda-93ef-4c0cc9833f45,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:06.666114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.666500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Port': ['ID=322c5e09-5e5e-42ff-929e-20d32a6e85c5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:06.670610 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-091b77dc-1c4e-44a9-9bcf-c66106fbd4df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2136526 Nov 24 04:16:06.670776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] No DVR routers for this DVR port 322c5e09-5e5e-42ff-929e-20d32a6e85c5 on host dv-neutron-819049-1-hyperv {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:06.670776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35726) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:06.678162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7e308cfa-0137-4e23-b917-0559eeed8035', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:06.684511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d960ddb-5ed2-44b7-89b5-843b898569e9 None None] DHCP port deletion for abf8162e-342f-48d3-8724-08bc35ee99ae request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:06.759143 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-99993011-a6b4-43e7-9c22-03db0bb1b920 None None] Provisioning complete for port 2bc693d7-de18-4334-babc-0cdd54f76d8d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:06.759509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-99993011-a6b4-43e7-9c22-03db0bb1b920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.779849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.793081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.800902 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-99993011-a6b4-43e7-9c22-03db0bb1b920 None None] Port 2bc693d7-de18-4334-babc-0cdd54f76d8d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:06.811511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:06.815177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['abf8162e-342f-48d3-8724-08bc35ee99ae']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:06.838454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:06.838736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6ef3a99a-0f0d-4f9f-84b8-a7bc322cd949') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:06.842761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:06.843375 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Updating router a4275832-60be-4568-aa83-97963f2ab8c7 port 2bc693d7-de18-4334-babc-0cdd54f76d8d binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:16:06.854804 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.871209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.878069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.887880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.892041 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Releasing vlan 195 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:16:06.892540 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:16:06.895913 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:16:06.909508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.933113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7ab0a9ec-d82f-4c8c-a7c3-f921e5678b34 None None] Provisioning complete for port 2bc693d7-de18-4334-babc-0cdd54f76d8d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:06.933493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7ab0a9ec-d82f-4c8c-a7c3-f921e5678b34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.967526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df7537f5-4190-41a9-bb66-afb36704fae6,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:06.981727 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.983522 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-215728c6-cbed-4d5d-a8e7-94544bc66e01 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3087554 Nov 24 04:16:06.984658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.986410 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35728) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:06.988763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:06.992256 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/networks/abf8162e-342f-48d3-8724-08bc35ee99ae HTTP/1.1" status: 204 len: 168 time: 0.7295108 Nov 24 04:16:06.992372 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7e308cfa-0137-4e23-b917-0559eeed8035', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:06.995669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35730) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:07.024944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.028849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4151dd9-1ef1-4d0d-b1ca-bd1507683e86 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Pushing event deleted for resources: {'Network': ['ID=abf8162e-342f-48d3-8724-08bc35ee99ae,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:07.034363 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f1fb0823-c4f6-4da4-b995-906161f67003 tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "GET /v2.0/ports?device_id=2e96b48b-df64-4537-8613-8a72b3074c26 HTTP/1.1" status: 200 len: 205 time: 0.0375850 Nov 24 04:16:07.036771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35732) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:07.041087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7ab0a9ec-d82f-4c8c-a7c3-f921e5678b34 None None] Port 2bc693d7-de18-4334-babc-0cdd54f76d8d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:07.095861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.100224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.119826 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44cf4ef1-1ad0-41f2-a641-93f0649f8900,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:07.120866 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.129266 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.130643 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-f8ff9880-6d08-40bc-becd-aaf8ee26ceb9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1431465 Nov 24 04:16:07.135759 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35734) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:07.143446 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7e308cfa-0137-4e23-b917-0559eeed8035', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:07.171060 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:16:07.178376 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.196997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e7c7ee52-3505-48f4-a5f6-afbb2cf14395 None None] Provisioning complete for port 2bc693d7-de18-4334-babc-0cdd54f76d8d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:07.197371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e7c7ee52-3505-48f4-a5f6-afbb2cf14395 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.240990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.246208 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e7c7ee52-3505-48f4-a5f6-afbb2cf14395 None None] Port 2bc693d7-de18-4334-babc-0cdd54f76d8d cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:07.248258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.250335 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.253476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.287340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63d99425-5ba6-4375-9619-bfc3be679c94,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:07.297801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.299147 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-020dce4c-d968-47b2-9d7f-ea4be383ffc4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1622772 Nov 24 04:16:07.301905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35736) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:07.308270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7e308cfa-0137-4e23-b917-0559eeed8035', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:07.311520 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f320f419-5dd6-425f-96cb-ce6d60849a8f None None] Pushing event updated for resources: {'Port': ['ID=2bc693d7-de18-4334-babc-0cdd54f76d8d,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:07.320053 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.327068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.346962 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:16:07.353338 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.379983 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d59f28e8-6a29-4fe0-acf9-da907f47c836 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:07.395144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.396253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Fanout notify agent at l3_agent the message router_deleted on router 2e96b48b-df64-4537-8613-8a72b3074c26 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:16:07.404554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.406359 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-63022e52-bf42-46af-8f23-b70c0a5a064e tempest-RoutersNegativeIpV6Test-1056460889 tempest-RoutersNegativeIpV6Test-1056460889-project] 10.222.0.48 "DELETE /v2.0/routers/2e96b48b-df64-4537-8613-8a72b3074c26 HTTP/1.1" status: 204 len: 168 time: 0.3679881 Nov 24 04:16:07.415276 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Attempting to bind port 2bc693d7-de18-4334-babc-0cdd54f76d8d on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:16:07.415657 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Attempting to bind port 2bc693d7-de18-4334-babc-0cdd54f76d8d by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:16:07.416037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Attempting to bind port 2bc693d7-de18-4334-babc-0cdd54f76d8d on network cc47f608-eaac-4acd-9462-96543f06a23d {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:07.426183 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:16:07.426590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Checking segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:07.426986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.427389 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Bound using segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:16:07.427874 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Bound port: 2bc693d7-de18-4334-babc-0cdd54f76d8d, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:16:07.428264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.452494 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.460164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.493827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7c734053-564d-4f1a-a2b6-972161eaf5f3,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:07.503797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.511628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port d59f28e8-6a29-4fe0-acf9-da907f47c836 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:07.511971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.515429 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1d6e0ac4-54a9-43dc-9317-817d351081eb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2116559 Nov 24 04:16:07.544784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] For port 2bc693d7-de18-4334-babc-0cdd54f76d8d, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:16:07.566494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] For port 2bc693d7-de18-4334-babc-0cdd54f76d8d, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=2bc693d7-de18-4334-babc-0cdd54f76d8d,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:16:07.575639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.618324 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0dfbaff5-f92d-4f38-8032-483447ac58b2 None None] Provisioning complete for port 2bc693d7-de18-4334-babc-0cdd54f76d8d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:07.618707 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0dfbaff5-f92d-4f38-8032-483447ac58b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:07.724597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35758) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:07.763962 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-9abc80d2-5b39-4489-b141-e494bf5a206a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1163844741&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.0653789 Nov 24 04:16:07.860814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f320f419-5dd6-425f-96cb-ce6d60849a8f None None] Pushing event updated for resources: {'Port': ['ID=2bc693d7-de18-4334-babc-0cdd54f76d8d,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:07.869677 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:07.870355 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:15:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:07.912918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-eb7ad9dd-9e39-4e9f-b0c2-8f4bea85192b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:07.914992 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-cce9e097-8adf-4977-8ed7-0dacb3bbaec7 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=a74af4a1bbbe4607bf2e9ca69c90e3fa&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1883788 Nov 24 04:16:07.916841 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35762) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:07.921147 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-eb7ad9dd-9e39-4e9f-b0c2-8f4bea85192b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 796 time: 0.1467071 Nov 24 04:16:07.938714 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-e44ceeb8-f5ed-422c-8b68-99445a80b1e1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0164211 Nov 24 04:16:07.981944 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7d01a2af-6ea1-4af2-9f16-44ed5252bb3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.007420 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7d01a2af-6ea1-4af2-9f16-44ed5252bb3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.011055 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-aaa10ce5-3086-45a9-b672-853e83dc099b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0707476 Nov 24 04:16:08.020027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 322c5e09-5e5e-42ff-929e-20d32a6e85c5 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:08.032718 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9ccfe05c-8eea-48c3-af7b-3d9cd55d2ac6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.062086 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7d01a2af-6ea1-4af2-9f16-44ed5252bb3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.062843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 322c5e09-5e5e-42ff-929e-20d32a6e85c5 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:08.063139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 322c5e09-5e5e-42ff-929e-20d32a6e85c5 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:08.067728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7d01a2af-6ea1-4af2-9f16-44ed5252bb3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.071276 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7d01a2af-6ea1-4af2-9f16-44ed5252bb3f admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/746eae88-5067-434f-a7f5-15a6f7be38a4 HTTP/1.1" status: 204 len: 168 time: 0.1510048 Nov 24 04:16:08.076274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:08.077941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0dfbaff5-f92d-4f38-8032-483447ac58b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.093010 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d01a2af-6ea1-4af2-9f16-44ed5252bb3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=746eae88-5067-434f-a7f5-15a6f7be38a4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:08.136787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-4d709681-c320-4280-beeb-56fa8a645aa6 service neutron] 10.222.0.48 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1101785 Nov 24 04:16:08.187159 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0dfbaff5-f92d-4f38-8032-483447ac58b2 None None] For port 2bc693d7-de18-4334-babc-0cdd54f76d8d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=2bc693d7-de18-4334-babc-0cdd54f76d8d,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:08.205130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0dfbaff5-f92d-4f38-8032-483447ac58b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.244876 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-51dc1bc1-03a5-49ea-ab97-c50cac4b5958 service neutron] 10.222.0.48 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0996130 Nov 24 04:16:08.305872 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfbaff5-f92d-4f38-8032-483447ac58b2 None None] Pushing event updated for resources: {'Port': ['ID=2bc693d7-de18-4334-babc-0cdd54f76d8d,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:08.371510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-96733cd2-fba3-4399-ace8-08d1b5a673d3 None None] Provisioning complete for port 2bc693d7-de18-4334-babc-0cdd54f76d8d triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:08.371914 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-96733cd2-fba3-4399-ace8-08d1b5a673d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:08.439169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:07Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:08.470683 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e02ebfbb-f074-4795-8184-6f0e412713f3 req-eb9c5bbf-c94d-4fa9-931b-829fb88c8436 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 210 time: 0.0300267 Nov 24 04:16:08.484380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9c04bd1-c640-427a-906a-dfee47f15230 None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:07Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:08.755685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:09.327826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 2bc693d7-de18-4334-babc-0cdd54f76d8d up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:09.386581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 2bc693d7-de18-4334-babc-0cdd54f76d8d triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:09.386952 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:09.480292 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-649d18af-12a7-420b-b152-0df7dd8504d6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:09.484475 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-649d18af-12a7-420b-b152-0df7dd8504d6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 796 time: 0.1356690 Nov 24 04:16:09.586603 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-c2fe4517-b196-4e56-9ffb-21b5249c1a7f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 380 time: 0.0802448 Nov 24 04:16:09.590524 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4a3dd43c-0b5d-4792-859c-f0c92b1c2992 req-41b0a3f6-7425-4a67-bf16-a5205e11d1a9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 210 time: 0.0283985 Nov 24 04:16:09.596550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': '77718a02-e4a6-465e-801a-bef233ad5108', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['7e308cfa-0137-4e23-b917-0559eeed8035']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:09.705460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:16:09.708895 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:09.828490 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.11 (cc47f608-eaac-4acd-9462-96543f06a23d/eb8cba97-6bd4-453b-a877-4a1ba469598b/7f0e92d3-157f-4257-ab9c-e07744f0f7c4) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:09.967251 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:09.999769 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.045322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network cc47f608-eaac-4acd-9462-96543f06a23d is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:10.048385 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:10.053019 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:10.056646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:10.088144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.108963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:10.109675 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.125935 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-3dfc4b36-44d0-4a38-af7e-5455e37cc4a4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5330791 Nov 24 04:16:10.140000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Request body: {'port': {'device_id': '77718a02-e4a6-465e-801a-bef233ad5108', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:10.217901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.332995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0eeb0594-6437-48b2-92b5-99805f8cb9ba None None] Provisioning complete for port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:10.333586 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0eeb0594-6437-48b2-92b5-99805f8cb9ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.368244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0eeb0594-6437-48b2-92b5-99805f8cb9ba None None] Port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:10.532062 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:16:10.539531 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.555865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Transition to ACTIVE for port object 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:16:10.561064 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.861125 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:10.911485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Pushing event updated for resources: {'Port': ['ID=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:10.997241 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138b2117-fc39-4c6c-8b39-ceb776e36a10 req-a9c5e76a-9311-4913-a0e9-2a12d0ac7c0c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:10.998775 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-138b2117-fc39-4c6c-8b39-ceb776e36a10 req-a9c5e76a-9311-4913-a0e9-2a12d0ac7c0c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 944 time: 0.0886323 Nov 24 04:16:11.001280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Attempting to bind port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:16:11.001609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Attempting to bind port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:16:11.001935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Attempting to bind port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 on network cc47f608-eaac-4acd-9462-96543f06a23d {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:11.012343 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 on network cc47f608-eaac-4acd-9462-96543f06a23d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:16:11.012654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Attempting to bind port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 on network cc47f608-eaac-4acd-9462-96543f06a23d {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:11.023979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 15, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:16:11.024325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Checking segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:11.024690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Bound using segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:16:11.025221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Bound port: 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:16:11.025574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:11.087720 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-138b2117-fc39-4c6c-8b39-ceb776e36a10 req-fb797191-7a15-45bd-a6d7-95cd9f87734c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0825284 Nov 24 04:16:11.115201 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] For port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:16:11.118263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] For port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:16:11.122746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:11.157486 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.158131 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:11.159545 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] 10.222.0.21 "PUT /v2.0/ports/7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 200 len: 1094 time: 1.0244503 Nov 24 04:16:11.159979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:16:11.162353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56808478-8e2d-433a-83f1-b27aeede4b12" -d '{"events": [{"name": "network-changed", "server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:16:11.186110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98538d89-1946-41af-b451-db93f4bce1ab service neutron] Pushing event updated for resources: {'Port': ['ID=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:11.208691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:16:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9663b877-70b1-4bba-a33e-0ecbd31c20a9 x-openstack-request-id: req-9663b877-70b1-4bba-a33e-0ecbd31c20a9 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:16:11.208994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:16:11.209309 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-9663b877-70b1-4bba-a33e-0ecbd31c20a9 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:16:11.209716 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'status': 'completed', 'code': 200} Nov 24 04:16:11.259074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-a2413922-3c35-47a8-b85d-4c73f21b1b6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.260654 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-a2413922-3c35-47a8-b85d-4c73f21b1b6a service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1097 time: 0.0443740 Nov 24 04:16:11.308732 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-382434e7-ae3a-4b52-b918-18d98b527e66 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 200 len: 217 time: 0.0384688 Nov 24 04:16:11.359081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-61d4dcd4-efb7-4c22-a5c0-e4926deb1c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.360452 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-61d4dcd4-efb7-4c22-a5c0-e4926deb1c0b service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0447102 Nov 24 04:16:11.406788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-4b96fe0f-486e-4d72-ae64-e1ed39f59906 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.408376 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-4b96fe0f-486e-4d72-ae64-e1ed39f59906 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0408430 Nov 24 04:16:11.499111 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-323bdeb4-fedb-4cea-a60b-5a30caad70f9 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834739 Nov 24 04:16:11.586451 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-0ac089c9-c298-43b8-9137-9d46e9a3c507 req-107ba58b-e2c2-4370-88f6-2650032a1243 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798540 Nov 24 04:16:11.674401 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-90d985d9-de7d-4885-b872-4c3c0e2abbf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.675772 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-90d985d9-de7d-4885-b872-4c3c0e2abbf3 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1097 time: 0.0448706 Nov 24 04:16:11.765833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-557f325c-80a8-4a22-bc4c-9ae4a0b636a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.767317 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-557f325c-80a8-4a22-bc4c-9ae4a0b636a7 service neutron] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 897 time: 0.0840609 Nov 24 04:16:11.811894 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-4ebef825-1697-4885-9722-8e75797bc7ff service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 200 len: 217 time: 0.0365045 Nov 24 04:16:11.861092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-c1d5ab5d-0f29-44cf-99af-2251f9fb0855 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.862563 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-c1d5ab5d-0f29-44cf-99af-2251f9fb0855 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0424771 Nov 24 04:16:11.909244 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-be5254e1-a51f-4b34-92be-f700cd33b3ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:11.910799 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-be5254e1-a51f-4b34-92be-f700cd33b3ee service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398731 Nov 24 04:16:12.005075 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-df0232cc-43a3-4987-9714-82d7234367f1 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865779 Nov 24 04:16:12.096359 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-56808478-8e2d-433a-83f1-b27aeede4b12 req-b2c200d3-bd0c-4b62-834b-da461c6a06f7 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820763 Nov 24 04:16:12.145115 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:12.201595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dbbb04-b844-4810-82b9-a997f12b2d81 req-a5e1cbdf-2618-4db2-adbe-6528ee93f6fa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:12.203099 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-16dbbb04-b844-4810-82b9-a997f12b2d81 req-a5e1cbdf-2618-4db2-adbe-6528ee93f6fa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 944 time: 0.0493910 Nov 24 04:16:12.256752 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-16dbbb04-b844-4810-82b9-a997f12b2d81 req-183bdc38-7a5f-452a-953b-23cca5b1419e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476930 Nov 24 04:16:13.374341 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70668a9d-ede4-43ce-acb7-a214af3def12 req-09095866-0ddd-4432-84ac-ff7d9884c52f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:13.375796 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-70668a9d-ede4-43ce-acb7-a214af3def12 req-09095866-0ddd-4432-84ac-ff7d9884c52f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 944 time: 0.0524096 Nov 24 04:16:13.423533 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-70668a9d-ede4-43ce-acb7-a214af3def12 req-473184f8-0523-402d-928e-b3693c977b59 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418527 Nov 24 04:16:14.225154 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:16:14.318517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:14.329374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'port_id': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'mac_address': 'fa:16:3e:94:7f:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:16:14.372006 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:14.389893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:16:14.415230 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:14.418988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:14.466221 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:14.538129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f452b7-ec39-4270-8e42-7a3af1b2392a req-b932732f-9e19-4a30-b291-02ca4f6b0763 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:14.539620 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-37f452b7-ec39-4270-8e42-7a3af1b2392a req-b932732f-9e19-4a30-b291-02ca4f6b0763 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 945 time: 0.0489912 Nov 24 04:16:14.588389 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-37f452b7-ec39-4270-8e42-7a3af1b2392a req-49321c55-bc9c-4a00-9908-63526cb8f56f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423498 Nov 24 04:16:14.637071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['7f0e92d3-157f-4257-ab9c-e07744f0f7c4'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:16:15.700388 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30fbe9c-8844-461f-8e09-b9742c9dc40d req-f163b1f5-c250-4965-8e7f-e2d0743fae0a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:15.701925 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e30fbe9c-8844-461f-8e09-b9742c9dc40d req-f163b1f5-c250-4965-8e7f-e2d0743fae0a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 945 time: 0.0489292 Nov 24 04:16:15.751054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e30fbe9c-8844-461f-8e09-b9742c9dc40d req-776d4673-1bdb-4081-ac92-338fc39034a7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432985 Nov 24 04:16:16.254767 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:16.305780 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:16:16.309464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:16.310376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:16.385155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:16.406956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:16:16.409175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e2949e4-c9a4-425a-b637-9b190dafe556" -d '{"events": [{"server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "name": "network-vif-plugged", "status": "completed", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:16:16.421595 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:16.425474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:16.452165 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:16:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce7a8cc9-8fc2-47ba-9f49-3566b660713a x-openstack-request-id: req-ce7a8cc9-8fc2-47ba-9f49-3566b660713a {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:16:16.452411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "name": "network-vif-plugged", "status": "completed", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:16:16.452635 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-ce7a8cc9-8fc2-47ba-9f49-3566b660713a {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:16:16.453021 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'code': 200} Nov 24 04:16:16.478396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:16.605606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75aa8b17-64cb-4e32-b151-1d59ae81b788 req-2f6458ad-b91c-4d1f-8e3a-d5a2c2529d20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:16.607662 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-75aa8b17-64cb-4e32-b151-1d59ae81b788 req-2f6458ad-b91c-4d1f-8e3a-d5a2c2529d20 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1099 time: 0.0387912 Nov 24 04:16:16.654362 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-75aa8b17-64cb-4e32-b151-1d59ae81b788 req-d8616a4c-7950-4d3e-a8fc-a5b8c00c07cc service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387630 Nov 24 04:16:16.867133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd795f3-b907-4844-a786-c1c73e4b59a0 req-0537d925-aa3a-42a0-88dd-459fed1ab93b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:16.868528 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-afd795f3-b907-4844-a786-c1c73e4b59a0 req-0537d925-aa3a-42a0-88dd-459fed1ab93b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 946 time: 0.0489576 Nov 24 04:16:16.921631 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-afd795f3-b907-4844-a786-c1c73e4b59a0 req-9e3e97f2-1bee-4799-9fad-cc1d944af385 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465446 Nov 24 04:16:18.048023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84af5644-5242-460d-961a-ff4340d29142 req-2dd101f2-8fe8-4782-b0b7-788a3cc82923 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:18.049490 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-84af5644-5242-460d-961a-ff4340d29142 req-2dd101f2-8fe8-4782-b0b7-788a3cc82923 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 946 time: 0.0603006 Nov 24 04:16:18.098136 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-84af5644-5242-460d-961a-ff4340d29142 req-3fc98121-a42c-4d05-8914-41266998df13 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426269 Nov 24 04:16:18.209369 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9452df46-ceac-437b-82ec-370f07b96e3f req-bfb9cb13-d7f9-44a4-9dee-5236c6b9b8c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:18.210770 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9452df46-ceac-437b-82ec-370f07b96e3f req-bfb9cb13-d7f9-44a4-9dee-5236c6b9b8c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 946 time: 0.0473609 Nov 24 04:16:18.258363 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9452df46-ceac-437b-82ec-370f07b96e3f req-8925ef38-b23c-4a94-938e-e000dc0c9546 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411811 Nov 24 04:16:18.280574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35802) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:18.318424 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a2a2cd8-7d53-4097-8d48-a1362aac9208 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:18.319958 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9a2a2cd8-7d53-4097-8d48-a1362aac9208 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1094 time: 0.0384359 Nov 24 04:16:18.322724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35804) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:18.327433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address': '172.20.0.11'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:18.350200 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:18.446340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:18.545711 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.252 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/9227138b-8f4c-4705-8ad3-ecd7c7c39de9) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:18.648963 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:18.681101 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:18.717070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:18.721738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:18.725156 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:18.749173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=9227138b-8f4c-4705-8ad3-ecd7c7c39de9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:18.762008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.762394 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.762744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.763118 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.763457 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.763794 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.764128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.764463 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.764797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.765126 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.765454 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:18.765780 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:19.088718 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:19.152468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:19.299449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:19.303916 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:19.374849 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=9227138b-8f4c-4705-8ad3-ecd7c7c39de9,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:19.382752 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:19.479913 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP f62be6fa-8957-476a-8243-ff2cddf883fd associated. External IP: 172.26.5.252, port: 7f0e92d3-157f-4257-ab9c-e07744f0f7c4. Nov 24 04:16:19.681991 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:19.783921 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:19.793292 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:19.801575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:19.802320 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:19.802930 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:19.831653 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-14555715-2c6b-48e8-9989-1ac11cbc6f70 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5079215 Nov 24 04:16:19.832258 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:16:19.834432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35806) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:19.834941 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1291ff7b-70b5-418b-9cf3-edb94743fd07" -d '{"events": [{"name": "network-changed", "server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:16:19.871108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:16:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0be4a39b-721d-44a3-bb1c-d4939a34fc57 x-openstack-request-id: req-0be4a39b-721d-44a3-bb1c-d4939a34fc57 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:16:19.871406 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:16:19.871661 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-0be4a39b-721d-44a3-bb1c-d4939a34fc57 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:16:19.872071 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'status': 'completed', 'code': 200} Nov 24 04:16:19.910648 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7ad166e0-327b-4c26-8301-f5d06e36aedf tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 992 time: 0.0740752 Nov 24 04:16:19.916063 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:19.944283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-4c5d5c44-36b4-4901-b9f3-21c74b1dfaa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:19.945781 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-4c5d5c44-36b4-4901-b9f3-21c74b1dfaa9 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1099 time: 0.0485663 Nov 24 04:16:20.035332 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-4aaa7de5-c423-4b7a-adf7-c2c116d21d24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:20.036937 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-4aaa7de5-c423-4b7a-adf7-c2c116d21d24 service neutron] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 897 time: 0.0844758 Nov 24 04:16:20.134396 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f62be6fa-8957-476a-8243-ff2cddf883fd', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.252', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'port_id': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1350, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'mac_address': 'fa:16:3e:94:7f:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77718a02-e4a6-465e-801a-bef233ad5108', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:16:18Z', 'updated_at': '2021-11-24T04:16:18Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:20.136524 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-6bc1e6b9-bacb-4a3b-bd5d-328d1c9bd393 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 200 len: 1000 time: 0.0923779 Nov 24 04:16:20.163986 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:20.172425 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:20.173035 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:20.186024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-7003b0c7-44d7-4511-8d32-5123ae1f63e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:20.187513 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-7003b0c7-44d7-4511-8d32-5123ae1f63e1 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0435860 Nov 24 04:16:20.233287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-f988d530-c249-4efa-90cf-73b17080b99a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:20.234799 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-f988d530-c249-4efa-90cf-73b17080b99a service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0400145 Nov 24 04:16:20.275940 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:20.330065 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-26d45d84-fb8f-4518-ae0d-98bb436e314f service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879834 Nov 24 04:16:20.424522 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1291ff7b-70b5-418b-9cf3-edb94743fd07 req-0c5350ea-57a6-4120-ac42-ee1a70080a9f service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866237 Nov 24 04:16:20.494817 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f62be6fa-8957-476a-8243-ff2cddf883fd', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.252', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'port_id': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1350, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'mac_address': 'fa:16:3e:94:7f:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77718a02-e4a6-465e-801a-bef233ad5108', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:16:18Z', 'updated_at': '2021-11-24T04:16:18Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:20.520529 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0bddf98-566b-45aa-b927-81a4a6cfd5d8 None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f62be6fa-8957-476a-8243-ff2cddf883fd', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.252', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'port_id': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1350, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'mac_address': 'fa:16:3e:94:7f:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77718a02-e4a6-465e-801a-bef233ad5108', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:16:18Z', 'updated_at': '2021-11-24T04:16:18Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:20.708990 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09fbf124-e8a6-4b9d-aa7b-4512bbd83396 None None] New status for floating IP f62be6fa-8957-476a-8243-ff2cddf883fd: ACTIVE {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:16:20.914387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35810) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:20.983421 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e17fbbc6-7615-4816-bd91-a1903fa14f5d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 994 time: 0.0674992 Nov 24 04:16:31.384325 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:16:34.959058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-524f590b-f80d-4b41-9d8a-a43a337d2384 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:37.953649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cd0fc781-0723-4f9a-833e-edd0dff76907 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:38.756699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:40.079644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:40.863320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:42.158413 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.162766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35818) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:45.316684 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Deleting port cc889587-0362-4296-85ec-4d51003bcc7f {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:45.317027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.392698 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.392999 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.404912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Calling delete_port for cc889587-0362-4296-85ec-4d51003bcc7f owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:45.575753 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.598287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'Port': ['ID=cc889587-0362-4296-85ec-4d51003bcc7f,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:45.608812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.609166 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.609512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.609850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.610204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.610542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.611376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.611376 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.611564 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.611814 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.612136 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.612458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:45.669398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.669732 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Floating IP 06a6cce1-4f72-4389-a050-43d496e8504b disassociated (deleted). External IP: 172.26.5.41, port: c286a8f2-ac43-4387-b29d-abf0de1cbc16. Nov 24 04:16:45.872357 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:45.982665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:45.987921 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:45.992232 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] Sync routers for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:46.001967 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:46.002625 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:46.016511 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bfd872c7-5035-458a-b7d1-a30510fb4e6b tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "DELETE /v2.0/floatingips/06a6cce1-4f72-4389-a050-43d496e8504b HTTP/1.1" status: 204 len: 168 time: 0.8526483 Nov 24 04:16:46.017197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:16:46.019566 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8690400-13ee-4862-a55c-6e8db09faa31" -d '{"events": [{"name": "network-changed", "server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:16:46.059547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:16:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b202f49c-9536-45cb-967a-0f4634982f34 x-openstack-request-id: req-b202f49c-9536-45cb-967a-0f4634982f34 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:16:46.061232 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:16:46.061525 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-b202f49c-9536-45cb-967a-0f4634982f34 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:16:46.061970 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'status': 'completed', 'code': 200} Nov 24 04:16:46.133377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-f1db616b-2d8f-4c87-8e72-b1f8b21ce2f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:46.134843 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-f1db616b-2d8f-4c87-8e72-b1f8b21ce2f4 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=aef2575f68e0468dbefaa9800a1007e9&device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 1099 time: 0.0492134 Nov 24 04:16:46.213538 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:46.270068 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-259fa36e-9c72-4e45-b479-7dc58345f9be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:46.271577 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-259fa36e-9c72-4e45-b479-7dc58345f9be service neutron] 10.222.0.21 "GET /v2.0/networks?id=5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 200 len: 898 time: 0.1198990 Nov 24 04:16:46.286296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42d5eef-2208-418c-9286-a4225f993d59 req-81ccb6f3-f3a0-4a38-96e6-aa1bea122e1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:46.287707 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e42d5eef-2208-418c-9286-a4225f993d59 req-81ccb6f3-f3a0-4a38-96e6-aa1bea122e1c tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0693786 Nov 24 04:16:46.335235 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-cbb25b00-3968-4cfa-9f2c-32b267d76211 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 200 len: 217 time: 0.0465634 Nov 24 04:16:46.402178 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e42d5eef-2208-418c-9286-a4225f993d59 req-ebd81096-1bdf-4b8a-b03f-6e34f85bda68 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076751 Nov 24 04:16:46.409301 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:46.409656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-d55bd056-951f-4829-bd9a-76f60edd97e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:46.411110 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-d55bd056-951f-4829-bd9a-76f60edd97e5 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 200 len: 834 time: 0.0639837 Nov 24 04:16:46.442388 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] Checking router: b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:46.450715 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:46.451897 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:46.464159 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-53fede5f-f8e5-4ba5-81c7-2b76c8524d0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:46.465703 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-53fede5f-f8e5-4ba5-81c7-2b76c8524d0f service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=5056a387-4f26-43bd-ad60-c8135c9a7757&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0468383 Nov 24 04:16:46.555950 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:46.556652 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-938a17cc-bb42-465a-9adc-7a803c86f8c4 service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808368 Nov 24 04:16:46.651184 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c8690400-13ee-4862-a55c-6e8db09faa31 req-264ffe98-a245-4928-8ba9-530a3cc3174a service neutron] 10.222.0.21 "GET /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862286 Nov 24 04:16:46.749759 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:46.774279 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9736dd78-c13e-4635-8425-c09c099fd296 None None] The sync data for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv is: [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:13:21Z', 'revision_number': 4, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '75d0fa55-1147-44a1-ad13-e876f755d833', 'name': '', 'network_id': '5056a387-4f26-43bd-ad60-c8135c9a7757', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'mac_address': 'fa:16:3e:8d:73:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_interface', 'standard_attr_id': 999, 'fixed_ips': [{'subnet_id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:19Z', 'updated_at': '2021-11-24T04:13:25Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'subnets': [{'id': '33f81594-0144-42a4-83a7-399a3f0ca39f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:46.979280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1557d52a-f03a-4b21-9524-7df63913415e None None] New status for floating IP 06a6cce1-4f72-4389-a050-43d496e8504b: DOWN {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:16:47.521262 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9641611-7736-4426-8280-4b4bcdaf8159 req-c362fb1b-da05-4638-8e4b-1ecaef1d0dad tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:47.522778 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a9641611-7736-4426-8280-4b4bcdaf8159 req-c362fb1b-da05-4638-8e4b-1ecaef1d0dad tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0496657 Nov 24 04:16:47.571256 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a9641611-7736-4426-8280-4b4bcdaf8159 req-3f80e7d4-83a7-4991-8cda-87f75bd627c4 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/security-groups?id=e24375a3-c4f9-4455-8a33-cc4587a3c8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425572 Nov 24 04:16:47.627043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-ec2470af-bc90-45ad-9006-9cb4853b9559 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:47.628476 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-ec2470af-bc90-45ad-9006-9cb4853b9559 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.21 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 946 time: 0.0478804 Nov 24 04:16:47.717920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Deleting port c286a8f2-ac43-4387-b29d-abf0de1cbc16 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:47.718186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:47.806391 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] For port c286a8f2-ac43-4387-b29d-abf0de1cbc16, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c286a8f2-ac43-4387-b29d-abf0de1cbc16,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:47.806745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:47.818906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Calling delete_port for c286a8f2-ac43-4387-b29d-abf0de1cbc16 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:47.948081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:47.977398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'Port': ['ID=c286a8f2-ac43-4387-b29d-abf0de1cbc16,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:48.017792 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] No DVR routers for this DVR port c286a8f2-ac43-4387-b29d-abf0de1cbc16 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:48.020386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:48.023831 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b160a66a-3aa0-4796-b7bb-a1309301895b req-4a19ec71-bc54-49c6-aa8f-b9b066bd31b3 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.21 "DELETE /v2.0/ports/c286a8f2-ac43-4387-b29d-abf0de1cbc16 HTTP/1.1" status: 204 len: 173 time: 0.3887639 Nov 24 04:16:48.062849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'name': 'network-vif-deleted', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:16:48.065839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69350339-7ffd-45ff-aac5-aae3c65fefb2" -d '{"events": [{"server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "name": "network-vif-deleted", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:16:48.104218 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:16:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ed14af6-ac70-469d-9c01-4f5c88abd8a9 x-openstack-request-id: req-2ed14af6-ac70-469d-9c01-4f5c88abd8a9 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:16:48.104539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84d10ea2-5230-4ecb-a886-c77b739b2fd4", "name": "network-vif-deleted", "tag": "c286a8f2-ac43-4387-b29d-abf0de1cbc16", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:16:48.104919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-2ed14af6-ac70-469d-9c01-4f5c88abd8a9 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:16:48.105467 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84d10ea2-5230-4ecb-a886-c77b739b2fd4', 'name': 'network-vif-deleted', 'tag': 'c286a8f2-ac43-4387-b29d-abf0de1cbc16', 'status': 'completed', 'code': 200} Nov 24 04:16:48.672988 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-65346009-41ac-4f77-b498-e115591d7298 req-f6451659-c9a0-4dbf-80d8-64810fe8d754 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "GET /v2.0/ports?device_id=84d10ea2-5230-4ecb-a886-c77b739b2fd4 HTTP/1.1" status: 200 len: 210 time: 0.0264919 Nov 24 04:16:49.483053 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35838) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:49.559861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec9a6b55-5077-455c-aa4a-fe3566cec9fb tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:49.560897 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec9a6b55-5077-455c-aa4a-fe3566cec9fb tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:49.561573 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec9a6b55-5077-455c-aa4a-fe3566cec9fb tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:49.572183 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ec9a6b55-5077-455c-aa4a-fe3566cec9fb tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?project_id=b951944bf1f44ed1b10939b3ae3d3197&network_id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 3000 time: 0.0790131 Nov 24 04:16:49.727893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35846) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:50.075014 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:50.380363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c286a8f2-ac43-4387-b29d-abf0de1cbc16 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:50.401137 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: c286a8f2-ac43-4387-b29d-abf0de1cbc16 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:50.401493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c286a8f2-ac43-4387-b29d-abf0de1cbc16 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:50.614583 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Deleting port 75d0fa55-1147-44a1-ad13-e876f755d833 {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:50.614914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:50.703009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] For port 75d0fa55-1147-44a1-ad13-e876f755d833, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=75d0fa55-1147-44a1-ad13-e876f755d833,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:50.703292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:50.714591 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Calling delete_port for 75d0fa55-1147-44a1-ad13-e876f755d833 owned by network:router_interface {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:50.897736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:50.925334 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'Port': ['ID=75d0fa55-1147-44a1-ad13-e876f755d833,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:51.100960 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.309621 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:51.413785 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:51.418732 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b0fb9fc3-12bb-4065-8b9b-f767bf2c0561 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "PUT /v2.0/routers/b8a445b6-5fdb-42f6-b52f-7fd6b64b4707/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6898322 Nov 24 04:16:51.422006 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35848) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:51.424492 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] Sync routers for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:51.433839 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:51.434470 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:51.471616 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Deleting subnet 33f81594-0144-42a4-83a7-399a3f0ca39f {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:16:51.474734 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.518556 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.543924 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:51.605713 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.663688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.697172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.700463 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "DELETE /v2.0/subnets/33f81594-0144-42a4-83a7-399a3f0ca39f HTTP/1.1" status: 204 len: 168 time: 0.2773821 Nov 24 04:16:51.701992 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81789ed0-fdd2-489f-aa86-71ecf5241efb tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'Subnet': ['ID=33f81594-0144-42a4-83a7-399a3f0ca39f,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:51.704900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35850) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:51.706937 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-991d9989-f197-4da9-8606-f6b845152e77 None None] Network 5056a387-4f26-43bd-ad60-c8135c9a7757 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:51.725941 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:16:50Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:51.753245 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] Checking router: b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:51.761451 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] Routers {'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:51.762056 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:51.810650 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.869105 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] Set router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:51.890465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] DHCP port deletion for 5056a387-4f26-43bd-ad60-c8135c9a7757 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:51.932761 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.938065 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Deleting port b5628e02-3570-45bd-a28e-4382d747296c {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:51.938478 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:51.993192 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Deleting port 97a6381f-c7b3-411e-ac55-c7aa669ccbae {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:16:51.993612 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.054611 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:16:50Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:52.079500 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] For port 97a6381f-c7b3-411e-ac55-c7aa669ccbae, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=97a6381f-c7b3-411e-ac55-c7aa669ccbae,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:52.079893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.086178 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77f6da63-3264-408a-be82-61f3b4ea0f71 None None] The sync data for ids ['b8a445b6-5fdb-42f6-b52f-7fd6b64b4707'] in dv-neutron-819049-1-hyperv is: [{'id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'name': 'tempest-TestNetworkAdvancedServerOps-router-588907275', 'tenant_id': 'aef2575f68e0468dbefaa9800a1007e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250'}], 'enable_snat': True}, 'gw_port_id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:13:10Z', 'updated_at': '2021-11-24T04:16:50Z', 'revision_number': 5, 'project_id': 'aef2575f68e0468dbefaa9800a1007e9', 'gw_port': {'id': '97a6381f-c7b3-411e-ac55-c7aa669ccbae', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1a:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8a445b6-5fdb-42f6-b52f-7fd6b64b4707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 986, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:13:11Z', 'updated_at': '2021-11-24T04:13:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:52.092888 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Calling delete_port for 97a6381f-c7b3-411e-ac55-c7aa669ccbae owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:52.156185 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] For port b5628e02-3570-45bd-a28e-4382d747296c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=b5628e02-3570-45bd-a28e-4382d747296c,segment=NetworkSegment(406a0578-0cd2-4d3f-a92a-c22ae9bd3b75),segment_id=406a0578-0cd2-4d3f-a92a-c22ae9bd3b75)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:52.156585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.168470 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Calling delete_port for b5628e02-3570-45bd-a28e-4382d747296c owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:16:52.245293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.262207 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.272771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Pushing event deleted for resources: {'Port': ['ID=b5628e02-3570-45bd-a28e-4382d747296c,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:52.277418 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] No DVR routers for this DVR port b5628e02-3570-45bd-a28e-4382d747296c on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:16:52.286321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.286321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.286321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.286321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.286321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.286321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.287498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.287498 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.288102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.288102 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.288523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.289038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a296c2df-3b30-4257-84bc-3bb6eae8b990 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:16:52.295868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'Port': ['ID=97a6381f-c7b3-411e-ac55-c7aa669ccbae,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:52.304323 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e97520ba-9afa-445d-8d38-b7089fd17036 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:52.358856 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.451462 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.453689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.497295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.498475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Fanout notify agent at l3_agent the message router_deleted on router b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:16:52.513362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.517052 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8154038b-0e56-40ab-aa90-0368c5c24163 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "DELETE /v2.0/routers/b8a445b6-5fdb-42f6-b52f-7fd6b64b4707 HTTP/1.1" status: 204 len: 168 time: 0.8085697 Nov 24 04:16:52.517399 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35854) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:52.594332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.686169 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.706609 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5056a387-4f26-43bd-ad60-c8135c9a7757']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:52.716022 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:52.716356 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '406a0578-0cd2-4d3f-a92a-c22ae9bd3b75') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:52.726913 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.746804 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.753911 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Releasing vlan 191 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:16:52.754419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:16:52.757404 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:16:52.817488 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.824329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.827431 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "DELETE /v2.0/networks/5056a387-4f26-43bd-ad60-c8135c9a7757 HTTP/1.1" status: 204 len: 168 time: 0.3090894 Nov 24 04:16:52.830304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35856) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:52.838544 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-298736f1-731e-402d-8994-b281e043fbfd tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'Network': ['ID=5056a387-4f26-43bd-ad60-c8135c9a7757,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:52.892846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f30149fb-54ab-4dff-9159-7115b8246b96 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.917950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f30149fb-54ab-4dff-9159-7115b8246b96 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.976617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f30149fb-54ab-4dff-9159-7115b8246b96 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.979946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f30149fb-54ab-4dff-9159-7115b8246b96 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:52.981096 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f30149fb-54ab-4dff-9159-7115b8246b96 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] 10.222.0.48 "DELETE /v2.0/security-groups/e24375a3-c4f9-4455-8a33-cc4587a3c8fa HTTP/1.1" status: 204 len: 168 time: 0.1498196 Nov 24 04:16:52.990929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f30149fb-54ab-4dff-9159-7115b8246b96 tempest-TestNetworkAdvancedServerOps-1376907435 tempest-TestNetworkAdvancedServerOps-1376907435-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e24375a3-c4f9-4455-8a33-cc4587a3c8fa,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:53.269894 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35864) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:53.319888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5628e02-3570-45bd-a28e-4382d747296c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:53.343577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: b5628e02-3570-45bd-a28e-4382d747296c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:53.343910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device b5628e02-3570-45bd-a28e-4382d747296c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:53.344428 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 97a6381f-c7b3-411e-ac55-c7aa669ccbae no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:53.364145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 97a6381f-c7b3-411e-ac55-c7aa669ccbae {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:53.364493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 97a6381f-c7b3-411e-ac55-c7aa669ccbae not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:53.364907 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 75d0fa55-1147-44a1-ad13-e876f755d833 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:16:53.384098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 75d0fa55-1147-44a1-ad13-e876f755d833 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:16:53.384440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 75d0fa55-1147-44a1-ad13-e876f755d833 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:16:53.402353 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9040f174-9e1b-4e39-b9b6-8b36a4b3dd25 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=aef2575f68e0468dbefaa9800a1007e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1311495 Nov 24 04:16:53.405410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35870) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:53.450235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ab50e6c-aa22-4810-8109-45360e86edf2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.472237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ab50e6c-aa22-4810-8109-45360e86edf2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.517733 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ab50e6c-aa22-4810-8109-45360e86edf2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.520260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ab50e6c-aa22-4810-8109-45360e86edf2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.521380 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8ab50e6c-aa22-4810-8109-45360e86edf2 admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/ab5a44f3-7d32-48f2-9fee-89a71fafd065 HTTP/1.1" status: 204 len: 168 time: 0.1151457 Nov 24 04:16:53.529495 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab50e6c-aa22-4810-8109-45360e86edf2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab5a44f3-7d32-48f2-9fee-89a71fafd065,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:53.775392 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35876) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:53.788324 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14b89208-0c30-4d05-911e-811d30e66d74 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.864351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14b89208-0c30-4d05-911e-811d30e66d74 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.867982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-14b89208-0c30-4d05-911e-811d30e66d74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.906069 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-14b89208-0c30-4d05-911e-811d30e66d74 admin admin] 10.222.0.48 "GET /v2.0/security-groups?tenant_id=9da6addcfd3b41b69d531cdeb57a0c41&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1295826 Nov 24 04:16:53.907248 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b89208-0c30-4d05-911e-811d30e66d74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a797269-dd91-4325-9635-c2002f9099c5,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:53.908801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35878) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:53.960423 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74a0071-a402-471d-b137-e3338224e2cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:53.980605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74a0071-a402-471d-b137-e3338224e2cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.025763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74a0071-a402-471d-b137-e3338224e2cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.028331 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e74a0071-a402-471d-b137-e3338224e2cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.029510 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e74a0071-a402-471d-b137-e3338224e2cf admin admin] 10.222.0.48 "DELETE /v2.0/security-groups/1a797269-dd91-4325-9635-c2002f9099c5 HTTP/1.1" status: 204 len: 168 time: 0.1190634 Nov 24 04:16:54.037800 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74a0071-a402-471d-b137-e3338224e2cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a797269-dd91-4325-9635-c2002f9099c5,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:54.395870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35892) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:54.451905 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19582f20-365e-4a0e-9e58-e5bc41df53af tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:54.454622 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-19582f20-365e-4a0e-9e58-e5bc41df53af tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9 HTTP/1.1" status: 200 len: 814 time: 0.0573874 Nov 24 04:16:54.678628 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35906) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:54.772387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-760561520-network', 'tenant_id': 'a953770267d4499382d1c4d95a04322e'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:54.792923 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Made reservation on behalf of a953770267d4499382d1c4d95a04322e for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:16:54.795524 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.804119 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.877468 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.881959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.908760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] vlan segment allocate from pool success with {'vlan_id': 176, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:16:54.915133 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86c97142-681a-4045-aeae-842c8348b008,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:54.921197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.921531 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Added segment 19c8da9b-b324-412b-a4ed-2230d609e8ef of type vlan for network 4db6f33c-c141-4219-ad0f-97dfea0992c0 Nov 24 04:16:54.967113 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.990223 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:54.991172 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:54.991750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.020958 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3411136 Nov 24 04:16:55.023941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35910) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:55.029689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Request body: {'subnet': {'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-760561520-subnet', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'ip_version': 4}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:55.050089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Made reservation on behalf of a953770267d4499382d1c4d95a04322e for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:16:55.052394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.057943 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e784e879-9bcc-4139-b4e7-fba9312ccf01 admin admin] Pushing event updated for resources: {'Network': ['ID=4db6f33c-c141-4219-ad0f-97dfea0992c0,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:55.068036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:16:55.220181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.276323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ba4b836b-28d1-471d-a461-f54951a2cf23,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:55.285459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Checking segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:55.285818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Network hostable DHCP agents. Network: 4db6f33c-c141-4219-ad0f-97dfea0992c0, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:16:55.301910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:16:55.311414 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 4db6f33c-c141-4219-ad0f-97dfea0992c0) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:55.316036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:55.316672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.321305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46f05f2b-de87-4327-b974-9749bd1a1e42 None None] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:55.335543 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-546949fe-8e08-4541-8e76-570e2d596466 admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3104043 Nov 24 04:16:55.338199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35912) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:55.342345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:55.363037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.364115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.417671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.465563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-4db6f33c-c141-4219-ad0f-97dfea0992c0', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:16:55.466509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.603906 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Allocated IP 172.20.0.2 (4db6f33c-c141-4219-ad0f-97dfea0992c0/ba4b836b-28d1-471d-a461-f54951a2cf23/465884ca-0717-46c1-972d-2389c9406cb2) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:55.622270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35914) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:55.627570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:55.686254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.751624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.757672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.804046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:55.811672 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:55.814087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:55.816171 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Pushing event updated for resources: {'Port': ['ID=465884ca-0717-46c1-972d-2389c9406cb2,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:55.840702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.844864 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.845205 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP f62be6fa-8957-476a-8243-ff2cddf883fd disassociated. External IP: 172.26.5.252, port: 7f0e92d3-157f-4257-ab9c-e07744f0f7c4. Nov 24 04:16:55.845567 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.872494 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Attempting to bind port 465884ca-0717-46c1-972d-2389c9406cb2 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:16:55.872985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Attempting to bind port 465884ca-0717-46c1-972d-2389c9406cb2 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:16:55.873445 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Attempting to bind port 465884ca-0717-46c1-972d-2389c9406cb2 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:55.878565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:16:55.879058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Checking segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:55.879566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.880068 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Bound using segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:16:55.880629 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Bound port: 465884ca-0717-46c1-972d-2389c9406cb2, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:16:55.881110 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:55.945867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] For port 465884ca-0717-46c1-972d-2389c9406cb2, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:16:55.948988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] For port 465884ca-0717-46c1-972d-2389c9406cb2, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=465884ca-0717-46c1-972d-2389c9406cb2,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:16:55.954916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.016116 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a018f1ab-1c53-4157-90c7-fe8e7fc7bebf None None] Pushing event updated for resources: {'Port': ['ID=465884ca-0717-46c1-972d-2389c9406cb2,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:56.073673 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:56.093886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.114372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.200121 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:56.210120 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.218443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:56.234190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:56.234989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:56.243468 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-752259d4-e18b-4766-858d-4177c67460b2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 690 time: 0.6195042 Nov 24 04:16:56.245130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35916) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:56.245130 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:16:56.246965 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8cf190fa-062a-47c6-ae66-ff225b0f0831" -d '{"events": [{"name": "network-changed", "server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:16:56.282912 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Allocated IP 172.26.5.61 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/26ae2d98-1602-4ac7-959b-a544eed04539) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:56.305486 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4e983cab-e504-412e-9f8b-0bb42e812204 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 690 time: 0.0541847 Nov 24 04:16:56.315853 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:16:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84a8ccf4-b3b9-47c7-81fa-bab6ff9c6694 x-openstack-request-id: req-84a8ccf4-b3b9-47c7-81fa-bab6ff9c6694 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:16:56.316153 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:16:56.316412 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-84a8ccf4-b3b9-47c7-81fa-bab6ff9c6694 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:16:56.316832 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'status': 'completed', 'code': 200} Nov 24 04:16:56.389548 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:56.434712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-16afe1ce-3e23-4c83-b115-a9b4c6243831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:56.436997 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-16afe1ce-3e23-4c83-b115-a9b4c6243831 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1099 time: 0.0971558 Nov 24 04:16:56.446052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.550564 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.580687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-0b33f56a-7b80-4548-91f7-b83dd8d1906e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:56.582135 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-0b33f56a-7b80-4548-91f7-b83dd8d1906e service neutron] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 897 time: 0.1344540 Nov 24 04:16:56.595787 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:56.606263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:56.622741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:56.631917 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:56.632530 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:56.636875 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:56.642492 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-554deb73-254f-46b0-81fb-31be4b8f7cc6 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 200 len: 217 time: 0.0502989 Nov 24 04:16:56.643546 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:56.645449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Pushing event updated for resources: {'Port': ['ID=26ae2d98-1602-4ac7-959b-a544eed04539,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:56.670644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddd71534-b0e9-401f-9fbf-55f2fca265d7 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:56.745209 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f9629d54-ce74-40ca-9f4a-8e9e072f500c None None] Provisioning complete for port 26ae2d98-1602-4ac7-959b-a544eed04539 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:56.745663 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f9629d54-ce74-40ca-9f4a-8e9e072f500c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:56.779620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:56.781036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-d064c4cb-87d2-404e-ab65-62d88213cf1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:56.782540 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-d064c4cb-87d2-404e-ab65-62d88213cf1a service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.1334715 Nov 24 04:16:56.822754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f9629d54-ce74-40ca-9f4a-8e9e072f500c None None] Port 26ae2d98-1602-4ac7-959b-a544eed04539 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:56.869739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-d16c8c2f-d799-4355-9028-6001302b5251 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:16:56.871808 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-d16c8c2f-d799-4355-9028-6001302b5251 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0807240 Nov 24 04:16:57.005795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:57.035040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81a32f78-de3f-4353-829f-c608a81c4490 None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:57.043725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.068496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9da478b0-baa5-49b4-9a60-e1353f42af43 None None] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:16:57.087375 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-1fbf961b-307c-4892-81bb-776ba1f7ef16 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1806266 Nov 24 04:16:57.168611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-76c322f5-29af-450a-8a2e-746e2a2b7cf5 None None] Provisioning complete for port 465884ca-0717-46c1-972d-2389c9406cb2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:57.169820 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-76c322f5-29af-450a-8a2e-746e2a2b7cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.263309 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8cf190fa-062a-47c6-ae66-ff225b0f0831 req-b3864615-d260-4d03-9feb-df51fceda9b1 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1673298 Nov 24 04:16:57.306751 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35920) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:57.340049 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.361837 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a77d992e-2f4d-4b81-ac6a-cae202e75e21 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 690 time: 0.0539179 Nov 24 04:16:57.366955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-76c322f5-29af-450a-8a2e-746e2a2b7cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.377437 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe93b0d-c658-4c34-9707-8913853c1572 None None] New status for floating IP f62be6fa-8957-476a-8243-ff2cddf883fd: DOWN {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:16:57.391550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 465884ca-0717-46c1-972d-2389c9406cb2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:57.426457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-76c322f5-29af-450a-8a2e-746e2a2b7cf5 None None] For port 465884ca-0717-46c1-972d-2389c9406cb2, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=465884ca-0717-46c1-972d-2389c9406cb2,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:57.438675 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-76c322f5-29af-450a-8a2e-746e2a2b7cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.504377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c322f5-29af-450a-8a2e-746e2a2b7cf5 None None] Pushing event updated for resources: {'Port': ['ID=465884ca-0717-46c1-972d-2389c9406cb2,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:57.508044 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 465884ca-0717-46c1-972d-2389c9406cb2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:57.508705 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.518982 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Router b3b4882e-8f09-451f-9384-42d336c1f444 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:16:57.648320 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:57.661582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Sync routers for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:16:57.667325 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.667667 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4367c213-27ef-4654-a1a7-e11068336b23 None None] Provisioning complete for port 465884ca-0717-46c1-972d-2389c9406cb2 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:57.668049 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4367c213-27ef-4654-a1a7-e11068336b23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:57.670197 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b06482a3-9a46-4c01-b2d7-6b1a6986bb0a admin admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.3294437 Nov 24 04:16:57.672037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35922) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:57.696610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:57.696610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:57.986023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:58.086658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.160333 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:56Z', 'revision_number': 3, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:58.189807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Checking router: b3b4882e-8f09-451f-9384-42d336c1f444 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:16:58.190186 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Updating router b3b4882e-8f09-451f-9384-42d336c1f444 port 26ae2d98-1602-4ac7-959b-a544eed04539 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:16:58.214566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.279143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Allocated IP 172.20.0.1 (4db6f33c-c141-4219-ad0f-97dfea0992c0/ba4b836b-28d1-471d-a461-f54951a2cf23/ea347121-5e2a-4526-aeef-23275e92ec96) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:16:58.365415 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35924) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:58.429225 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b2ceccc3-a77d-4ac9-bf96-abde934e5b1d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 688 time: 0.0626922 Nov 24 04:16:58.432085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.462194 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.466004 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.467746 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.507244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:58.514860 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:58.515142 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e69d06f-e96d-412b-9086-c3956952f1eb None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:58.518501 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:16:58.535321 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52c1453-3e59-4ebe-ad32-574c3bb64a81 None None] Pushing event updated for resources: {'Port': ['ID=26ae2d98-1602-4ac7-959b-a544eed04539,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:58.538200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Attempting to bind port 26ae2d98-1602-4ac7-959b-a544eed04539 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:16:58.538588 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Attempting to bind port 26ae2d98-1602-4ac7-959b-a544eed04539 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:16:58.538963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Attempting to bind port 26ae2d98-1602-4ac7-959b-a544eed04539 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:16:58.543683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Pushing event updated for resources: {'Port': ['ID=ea347121-5e2a-4526-aeef-23275e92ec96,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:58.545614 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:16:58.546161 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:16:58.547075 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.547471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:16:58.548156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Bound port: 26ae2d98-1602-4ac7-959b-a544eed04539, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:16:58.548526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.567852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.607606 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] For port 26ae2d98-1602-4ac7-959b-a544eed04539, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:16:58.623222 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] For port 26ae2d98-1602-4ac7-959b-a544eed04539, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=26ae2d98-1602-4ac7-959b-a544eed04539,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:16:58.629668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.636681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ecc883fe-5b78-48bb-9d4f-3f27f82170b1 None None] Provisioning complete for port 26ae2d98-1602-4ac7-959b-a544eed04539 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:58.637329 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ecc883fe-5b78-48bb-9d4f-3f27f82170b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.712069 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4798c9ac-2784-41d6-ba28-1ee9ab2d5de6 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:16:58.748668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:16:58.749309 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:58.752934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52c1453-3e59-4ebe-ad32-574c3bb64a81 None None] Pushing event updated for resources: {'Port': ['ID=26ae2d98-1602-4ac7-959b-a544eed04539,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:58.873778 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ecc883fe-5b78-48bb-9d4f-3f27f82170b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:58.904567 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:16:58.911163 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-ecc883fe-5b78-48bb-9d4f-3f27f82170b1 None None] For port 26ae2d98-1602-4ac7-959b-a544eed04539, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=26ae2d98-1602-4ac7-959b-a544eed04539,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:16:58.940791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ecc883fe-5b78-48bb-9d4f-3f27f82170b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.011404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.076457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecc883fe-5b78-48bb-9d4f-3f27f82170b1 None None] Pushing event updated for resources: {'Port': ['ID=26ae2d98-1602-4ac7-959b-a544eed04539,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:59.093338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4d33afb5-6393-4dd4-b97f-0867b95819c8 None None] Provisioning complete for port ea347121-5e2a-4526-aeef-23275e92ec96 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:59.093704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4d33afb5-6393-4dd4-b97f-0867b95819c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.157892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-4d33afb5-6393-4dd4-b97f-0867b95819c8 None None] Port ea347121-5e2a-4526-aeef-23275e92ec96 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:59.171478 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.176620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.176810 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4d33afb5-6393-4dd4-b97f-0867b95819c8 None None] Provisioning complete for port 26ae2d98-1602-4ac7-959b-a544eed04539 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:59.177311 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4d33afb5-6393-4dd4-b97f-0867b95819c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.218403 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:56Z', 'revision_number': 3, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:16:59.250035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30f7f238-47f3-4d05-8b15-b1f4642d5980 None None] The sync data for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv is: [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:56Z', 'revision_number': 3, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:16:59.252275 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.260566 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Pushing event updated for resources: {'Port': ['ID=ea347121-5e2a-4526-aeef-23275e92ec96,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:59.345775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 465884ca-0717-46c1-972d-2389c9406cb2 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:16:59.361525 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:16:59.363629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:16:59.396085 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 465884ca-0717-46c1-972d-2389c9406cb2 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:59.396589 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.498848 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Router b3b4882e-8f09-451f-9384-42d336c1f444 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:16:59.665059 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:16:59.670417 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6922606c-4560-49d2-b946-9724a1d3c37c admin admin] 10.222.0.48 "PUT /v2.0/routers/b3b4882e-8f09-451f-9384-42d336c1f444/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9971704 Nov 24 04:16:59.689563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35930) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:59.695866 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1658858863', 'description': 'tempest-secgroup-smoke-1658858863 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:59.722971 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-eaea4873-adec-486f-8ee7-ba19bfb88780 None None] Provisioning complete for port ea347121-5e2a-4526-aeef-23275e92ec96 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:16:59.723528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eaea4873-adec-486f-8ee7-ba19bfb88780 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.739085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.763554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-eaea4873-adec-486f-8ee7-ba19bfb88780 None None] Port ea347121-5e2a-4526-aeef-23275e92ec96 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:16:59.824849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.829572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.859741 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.861013 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1698217 Nov 24 04:16:59.864092 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35936) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:16:59.868688 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '5ff7db10-db54-49ee-aa7e-96078e13864c', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:16:59.877293 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7ddef9-b5a8-4753-848c-2cc508bae02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5ff7db10-db54-49ee-aa7e-96078e13864c,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:16:59.902518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.975756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:16:59.982796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.001859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=27d2b77e-94e5-461f-9363-33a5f15564e2,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.013256 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.017293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-063cfe24-b707-48a9-b5ce-9184964e2256 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1492455 Nov 24 04:17:00.017473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35940) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.022061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '5ff7db10-db54-49ee-aa7e-96078e13864c', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.052183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.119700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.125794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.146492 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3bfa0c91-f78d-459c-9d6d-54aca434946c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.154390 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.156089 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4d8e0cd4-9d6d-4c45-b74e-4bfac6234611 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1375268 Nov 24 04:17:00.158755 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35946) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.162989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '5ff7db10-db54-49ee-aa7e-96078e13864c', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.197945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.239541 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35950) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.245255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1613689398-network', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.266839 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.267409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Made reservation on behalf of 8ef3ace0a0984a27b51cbd7ccda3d0c0 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:17:00.269969 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.271459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.279418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.288760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ec1223d-e90e-4e9d-9a5e-85154ad25bc2,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.296988 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.301001 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-493dd9b3-648c-4393-9dd2-2cced9264d45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1385961 Nov 24 04:17:00.301827 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35952) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.307103 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '5ff7db10-db54-49ee-aa7e-96078e13864c', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.335763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.365481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.370646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.391325 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] vlan segment allocate from pool success with {'vlan_id': 171, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:17:00.397155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.401095 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.406719 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=390c9f55-d11e-4a65-86ee-655c70f1b929,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.409628 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.409980 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Added segment 8cc793f1-10aa-4292-9767-d11d8ccd6e28 of type vlan for network de84bbd9-fc4c-4911-85ab-165a0bc94fef Nov 24 04:17:00.417396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=163fa17f-ecae-4184-a7e8-14aaf37f74ee,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.429550 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.430871 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8721ee61-0dd9-493a-be4a-8cdcac85e5c7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1279905 Nov 24 04:17:00.433671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35954) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.439220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '5ff7db10-db54-49ee-aa7e-96078e13864c', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.451985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.465770 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:17:00.472455 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.493683 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.494797 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:00.495925 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.526861 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.2859299 Nov 24 04:17:00.530196 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35956) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.539268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Request body: {'subnet': {'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1613689398-subnet', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'ip_version': 4}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.552762 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.557961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.563736 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30dee9b2-f92a-40cd-a448-d9e5be40c9f9 admin admin] Pushing event updated for resources: {'Network': ['ID=de84bbd9-fc4c-4911-85ab-165a0bc94fef,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.577150 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:17:00.586981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Made reservation on behalf of 8ef3ace0a0984a27b51cbd7ccda3d0c0 for: {'subnet': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:17:00.589249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3980021'] for subnet, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.592427 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df06c93d-4f18-4ab9-82e2-bf81a28935ff,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.617806 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.621825 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-053de713-17bc-41e0-9abe-adc91271f397 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1869948 Nov 24 04:17:00.622384 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35958) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.630194 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '5ff7db10-db54-49ee-aa7e-96078e13864c', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:00.680725 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:17:00.687255 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.772259 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.776419 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.798723 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=23985db5-d201-4564-b881-958548a842f2,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.805962 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.818208 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a8d606f3-6df2-44e7-a607-6957bdbcffff tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1841049 Nov 24 04:17:00.827304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3285031', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3979975'] for subnet, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.885584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7bc99615-38d2-48a4-b0d2-2fb2d1709b3c,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:00.914387 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Checking segment: {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:00.914841 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Network hostable DHCP agents. Network: de84bbd9-fc4c-4911-85ab-165a0bc94fef, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103381) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:17:00.934677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103381) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:17:00.946283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, de84bbd9-fc4c-4911-85ab-165a0bc94fef) {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:00.951723 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:00.953035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:00.959212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99744d68-ed94-4b35-b691-1895a3c93079 None None] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:17:00.978497 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 35968) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:00.978752 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f463db68-d7a1-4f5f-95c0-2a81c60ef246 admin admin] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4472480 Nov 24 04:17:00.984058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:01.012295 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.014770 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.085731 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.118326 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-86a18b80-ac34-4ae4-b65a-be71fc38a226 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1658858863&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.0891087 Nov 24 04:17:01.164563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-de84bbd9-fc4c-4911-85ab-165a0bc94fef', 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'fixed_ips': [{'subnet_id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:17:01.165279 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.214263 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Sync routers for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:01.229470 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:01.233125 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:01.278336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.341446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-e234f8a4-ef68-4af6-80b1-1518a071c064 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:01.351015 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-e234f8a4-ef68-4af6-80b1-1518a071c064 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 796 time: 0.2236507 Nov 24 04:17:01.367659 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-27f3401f-df7a-49bf-9517-74d090c8fce3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0156753 Nov 24 04:17:01.427239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 26ae2d98-1602-4ac7-959b-a544eed04539 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:01.430485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Allocated IP 172.20.0.2 (de84bbd9-fc4c-4911-85ab-165a0bc94fef/7bc99615-38d2-48a4-b0d2-2fb2d1709b3c/f9de9b7e-1a67-40a9-94b0-d90ac5951cbd) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:01.441603 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:01.451623 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-1e3e6fd3-b3e2-4e27-9094-b31e4ef4a542 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0831146 Nov 24 04:17:01.559633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.585573 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.619112 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-26f313cc-070f-4e11-b667-f0f845922f85 service neutron] 10.222.0.48 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1559486 Nov 24 04:17:01.648772 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 26ae2d98-1602-4ac7-959b-a544eed04539 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:01.649421 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.736660 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:16:59Z', 'revision_number': 2, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:01.759596 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Allocated IP 172.26.5.149 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/ecd16224-ec00-4fe3-a4a6-b8bcaa853069) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:01.766775 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-ca3d36ac-cd82-4ed5-961b-b8ba53b108a4 service neutron] 10.222.0.48 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1401486 Nov 24 04:17:01.811811 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.812027 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Checking router: b3b4882e-8f09-451f-9384-42d336c1f444 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:01.812161 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Updating router b3b4882e-8f09-451f-9384-42d336c1f444 port ea347121-5e2a-4526-aeef-23275e92ec96 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:17:01.825248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.872334 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.877145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:01.885392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:01.890724 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Pushing event updated for resources: {'Port': ['ID=f9de9b7e-1a67-40a9-94b0-d90ac5951cbd,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:01.893457 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:01.907914 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.956628 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.963057 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Attempting to bind port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:01.964038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Attempting to bind port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:01.964573 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Attempting to bind port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd on network de84bbd9-fc4c-4911-85ab-165a0bc94fef {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:01.971144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:01.971795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Checking segment: {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:01.972402 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:01.972967 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Bound using segment: {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:01.973650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Bound port: f9de9b7e-1a67-40a9-94b0-d90ac5951cbd, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:01.974241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.018168 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Pushing event updated for resources: {'Port': ['ID=ecd16224-ec00-4fe3-a4a6-b8bcaa853069,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:02.038658 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:02.043034 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:02.048420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:02.087334 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bc3f4d09-8bf9-446e-ac72-1f77f1138563 req-03143cae-a21d-4bb6-8c43-8c77c8dfc60e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 210 time: 0.0464404 Nov 24 04:17:02.238352 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.247554 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.250689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-304a91eb-fa13-4b9f-8f35-71d4f2c66ea4 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:02.277373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4f047447-984a-485e-b10e-e4724069e51b None None] For port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:02.281546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-4f047447-984a-485e-b10e-e4724069e51b None None] For port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f9de9b7e-1a67-40a9-94b0-d90ac5951cbd,segment=NetworkSegment(8cc793f1-10aa-4292-9767-d11d8ccd6e28),segment_id=8cc793f1-10aa-4292-9767-d11d8ccd6e28)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:02.290358 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.321652 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Pushing event updated for resources: {'Port': ['ID=ea347121-5e2a-4526-aeef-23275e92ec96,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:02.352956 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.353562 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.354338 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.354854 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.355362 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.356139 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.356958 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.357375 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.357692 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.358498 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.358822 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.360087 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:02.379236 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Attempting to bind port ea347121-5e2a-4526-aeef-23275e92ec96 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:02.379951 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Attempting to bind port ea347121-5e2a-4526-aeef-23275e92ec96 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:02.380550 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Attempting to bind port ea347121-5e2a-4526-aeef-23275e92ec96 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:02.387357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-ba9455b1-c2c1-4342-b766-d23069cab096 None None] Provisioning complete for port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:02.388838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ba9455b1-c2c1-4342-b766-d23069cab096 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.389812 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:02.390558 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Checking segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:02.391189 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.391932 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Bound using segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:02.392633 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Bound port: ea347121-5e2a-4526-aeef-23275e92ec96, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:02.393265 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.398771 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f047447-984a-485e-b10e-e4724069e51b None None] Pushing event updated for resources: {'Port': ['ID=f9de9b7e-1a67-40a9-94b0-d90ac5951cbd,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:02.460252 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-ba9455b1-c2c1-4342-b766-d23069cab096 None None] Port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:17:02.493814 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] For port ea347121-5e2a-4526-aeef-23275e92ec96, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:02.497822 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] For port ea347121-5e2a-4526-aeef-23275e92ec96, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ea347121-5e2a-4526-aeef-23275e92ec96,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:02.505476 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.540477 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.557924 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:02.559074 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:02.679354 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6847965b-02c4-4eb2-b09d-9d6ca4243cae None None] Pushing event updated for resources: {'Port': ['ID=ea347121-5e2a-4526-aeef-23275e92ec96,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:02.731233 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:02.803472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-cb527eef-4899-4118-bfe0-1b8e45e0e099 None None] Provisioning complete for port ea347121-5e2a-4526-aeef-23275e92ec96 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:02.812067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cb527eef-4899-4118-bfe0-1b8e45e0e099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.881830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:02.989425 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cb527eef-4899-4118-bfe0-1b8e45e0e099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:03.052128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-cb527eef-4899-4118-bfe0-1b8e45e0e099 None None] For port ea347121-5e2a-4526-aeef-23275e92ec96, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ea347121-5e2a-4526-aeef-23275e92ec96,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:03.056861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cb527eef-4899-4118-bfe0-1b8e45e0e099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:03.088852 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Router e513968f-dd23-4889-8fe9-1670c2724712 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:17:03.096859 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:02Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:03.108924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb527eef-4899-4118-bfe0-1b8e45e0e099 None None] Pushing event updated for resources: {'Port': ['ID=ea347121-5e2a-4526-aeef-23275e92ec96,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:03.127792 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ab1c81d-5995-4e5c-b18d-ca1d3bf99342 None None] The sync data for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv is: [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:02Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:03.205951 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-58f61ecc-6422-4181-880d-a1cbdf2a707d None None] Provisioning complete for port ea347121-5e2a-4526-aeef-23275e92ec96 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:03.206871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-58f61ecc-6422-4181-880d-a1cbdf2a707d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:03.223657 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8a0d99b1-0355-403d-8a6b-67e29af67c53 req-ddc9ac6c-5ef4-4d4f-b324-7557c1e5e119 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 210 time: 0.0329862 Nov 24 04:17:03.241381 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:03.262607 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Sync routers for ids ['e513968f-dd23-4889-8fe9-1670c2724712'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:03.263567 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:03.264998 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-438b6a31-9190-41b1-89c5-f0a9ceb8ef40 admin admin] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.2850232 Nov 24 04:17:03.267906 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 35986) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:03.296165 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Routers {'e513968f-dd23-4889-8fe9-1670c2724712'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:03.296871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e513968f-dd23-4889-8fe9-1670c2724712'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:03.499157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ea347121-5e2a-4526-aeef-23275e92ec96 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:03.583930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Set router e513968f-dd23-4889-8fe9-1670c2724712 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:03.667619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-2a59be12-3550-4aa9-a6bc-502d7858ad58 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:03.669825 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-2a59be12-3550-4aa9-a6bc-502d7858ad58 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 796 time: 0.1108806 Nov 24 04:17:03.697546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ea347121-5e2a-4526-aeef-23275e92ec96 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:03.698363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:03.873583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ba12748-e185-46ed-a8d5-ad2f495d1e28 None None] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:17:03.909376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f9de9b7e-1a67-40a9-94b0-d90ac5951cbd up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:04.029414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-54cc4af4-4bf2-49a3-9f44-6611568b1ac6 None None] Provisioning complete for port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:04.030099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-54cc4af4-4bf2-49a3-9f44-6611568b1ac6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.103878 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149'}], 'enable_snat': True}, 'gw_port_id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:02Z', 'revision_number': 3, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'gw_port': {'id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:53:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1387, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:04.137360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:04.137789 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.159563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Checking router: e513968f-dd23-4889-8fe9-1670c2724712 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:04.159916 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Updating router e513968f-dd23-4889-8fe9-1670c2724712 port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:17:04.180155 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-f44fdf92-6907-4b4a-894e-83dff4f14772 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 473 time: 0.4984314 Nov 24 04:17:04.191901 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['5ff7db10-db54-49ee-aa7e-96078e13864c']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:04.232663 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.322122 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-54cc4af4-4bf2-49a3-9f44-6611568b1ac6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.366460 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-a274ec3e-86d9-4cfe-ae78-8bcbb111f819 req-e0fcd746-0739-4bd1-84cf-31f29691e6c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 210 time: 0.0633245 Nov 24 04:17:04.421884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:17:04.425505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.467809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.480957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-54cc4af4-4bf2-49a3-9f44-6611568b1ac6 None None] For port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=f9de9b7e-1a67-40a9-94b0-d90ac5951cbd,segment=NetworkSegment(8cc793f1-10aa-4292-9767-d11d8ccd6e28),segment_id=8cc793f1-10aa-4292-9767-d11d8ccd6e28)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:04.498001 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-54cc4af4-4bf2-49a3-9f44-6611568b1ac6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.553754 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.652516 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103382) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 04:17:04.652881 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG oslo_db.api [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 04:17:04.659583 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54cc4af4-4bf2-49a3-9f44-6611568b1ac6 None None] Pushing event updated for resources: {'Port': ['ID=f9de9b7e-1a67-40a9-94b0-d90ac5951cbd,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:04.699125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.8 (cc47f608-eaac-4acd-9462-96543f06a23d/eb8cba97-6bd4-453b-a877-4a1ba469598b/b0560dd0-2531-400c-87fd-0b0f87d4ad93) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:04.733328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.739644 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-88dcda45-40d3-4088-9524-4361f2f8bcac None None] Provisioning complete for port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:04.740043 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-88dcda45-40d3-4088-9524-4361f2f8bcac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.742977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.821997 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59e13412-df93-4e0a-9104-b4ee00cee14e None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:04.836234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Attempting to bind port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:04.836615 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Attempting to bind port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:04.836987 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Attempting to bind port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:04.838900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c0bb70-011b-4fac-9d05-489afe6cbc66 None None] Pushing event updated for resources: {'Port': ['ID=ecd16224-ec00-4fe3-a4a6-b8bcaa853069,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:04.849432 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:04.849809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:04.850704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.850704 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:04.851093 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Bound port: ecd16224-ec00-4fe3-a4a6-b8bcaa853069, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:04.851476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.893108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Allocated IP 172.20.0.1 (de84bbd9-fc4c-4911-85ab-165a0bc94fef/7bc99615-38d2-48a4-b0d2-2fb2d1709b3c/7a34dfa0-3094-4ae5-87f0-b2d8c7be6607) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:04.946546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] For port ecd16224-ec00-4fe3-a4a6-b8bcaa853069, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:04.952944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] For port ecd16224-ec00-4fe3-a4a6-b8bcaa853069, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ecd16224-ec00-4fe3-a4a6-b8bcaa853069,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:04.965767 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.995372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-03d44963-3c89-4715-8591-1eb32ebdf59f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:04.998031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.015353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc83c7b2-96ab-44b1-8d04-926c0111adf5 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:05.040701 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c0bb70-011b-4fac-9d05-489afe6cbc66 None None] Pushing event updated for resources: {'Port': ['ID=ecd16224-ec00-4fe3-a4a6-b8bcaa853069,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:05.044636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Routers {'e513968f-dd23-4889-8fe9-1670c2724712'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:05.045254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e513968f-dd23-4889-8fe9-1670c2724712'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:05.056508 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.070782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.109988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-735bf6b4-12d5-4ce9-a8ab-97ed1c62a53c None None] Provisioning complete for port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:05.110398 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-735bf6b4-12d5-4ce9-a8ab-97ed1c62a53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.134280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network cc47f608-eaac-4acd-9462-96543f06a23d is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:05.141627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:05.146992 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:05.150182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.153859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=b0560dd0-2531-400c-87fd-0b0f87d4ad93,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:05.227411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:05.241962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:05.242657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.245405 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:05.250995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:05.284439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Pushing event updated for resources: {'Port': ['ID=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:05.298351 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fd2a73a2-d775-4a8c-879d-9549017891c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1102798 Nov 24 04:17:05.314903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Request body: {'port': {'device_id': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:05.323191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.402315 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] Set router e513968f-dd23-4889-8fe9-1670c2724712 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:05.440441 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.541711 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device f9de9b7e-1a67-40a9-94b0-d90ac5951cbd up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:05.581434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-735bf6b4-12d5-4ce9-a8ab-97ed1c62a53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.603578 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617e5fe8-6188-42a6-8d47-9d242ad0d9a8 req-1e1990a9-bbd0-402d-b617-4a5a56464201 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:05.605060 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-617e5fe8-6188-42a6-8d47-9d242ad0d9a8 req-1e1990a9-bbd0-402d-b617-4a5a56464201 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 931 time: 0.1434033 Nov 24 04:17:05.649147 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-735bf6b4-12d5-4ce9-a8ab-97ed1c62a53c None None] For port ecd16224-ec00-4fe3-a4a6-b8bcaa853069, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=ecd16224-ec00-4fe3-a4a6-b8bcaa853069,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:05.659501 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-735bf6b4-12d5-4ce9-a8ab-97ed1c62a53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.718369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.732646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port f9de9b7e-1a67-40a9-94b0-d90ac5951cbd triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:05.732924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.765096 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-735bf6b4-12d5-4ce9-a8ab-97ed1c62a53c None None] Pushing event updated for resources: {'Port': ['ID=ecd16224-ec00-4fe3-a4a6-b8bcaa853069,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:05.767005 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-617e5fe8-6188-42a6-8d47-9d242ad0d9a8 req-8527d99a-e503-4866-aac6-d51f1c3ddd45 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1188395 Nov 24 04:17:05.803018 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0342d0c2-5073-4d65-b265-cad27c2c5031 None None] Provisioning complete for port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:05.803399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0342d0c2-5073-4d65-b265-cad27c2c5031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.868740 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149'}], 'enable_snat': True}, 'gw_port_id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:02Z', 'revision_number': 3, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'gw_port': {'id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:53:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1387, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:05.873308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0342d0c2-5073-4d65-b265-cad27c2c5031 None None] Port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:17:05.906733 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4710de8-661d-4d0f-8ede-c9d04c311726 None None] The sync data for ids ['e513968f-dd23-4889-8fe9-1670c2724712'] in dv-neutron-819049-1-hyperv is: [{'id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149'}], 'enable_snat': True}, 'gw_port_id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:02Z', 'revision_number': 3, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'gw_port': {'id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:53:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1387, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:05.922404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0342d0c2-5073-4d65-b265-cad27c2c5031 None None] Provisioning complete for port b0560dd0-2531-400c-87fd-0b0f87d4ad93 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:05.922876 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0342d0c2-5073-4d65-b265-cad27c2c5031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:05.961988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-0342d0c2-5073-4d65-b265-cad27c2c5031 None None] Port b0560dd0-2531-400c-87fd-0b0f87d4ad93 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:17:05.996632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b0560dd0-2531-400c-87fd-0b0f87d4ad93 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:17:06.006284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.033281 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Transition to ACTIVE for port object b0560dd0-2531-400c-87fd-0b0f87d4ad93 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:17:06.035378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.037558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.045946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.126238 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Pushing event updated for resources: {'Port': ['ID=b0560dd0-2531-400c-87fd-0b0f87d4ad93,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:06.142051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.252340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Pushing event updated for resources: {'Port': ['ID=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:06.305126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Attempting to bind port b0560dd0-2531-400c-87fd-0b0f87d4ad93 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:06.305126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Attempting to bind port b0560dd0-2531-400c-87fd-0b0f87d4ad93 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:06.305448 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Attempting to bind port b0560dd0-2531-400c-87fd-0b0f87d4ad93 on network cc47f608-eaac-4acd-9462-96543f06a23d {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:06.314708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Port b0560dd0-2531-400c-87fd-0b0f87d4ad93 on network cc47f608-eaac-4acd-9462-96543f06a23d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:17:06.315030 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Attempting to bind port b0560dd0-2531-400c-87fd-0b0f87d4ad93 on network cc47f608-eaac-4acd-9462-96543f06a23d {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:06.324411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:06.324739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Checking segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:06.325871 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Bound using segment: {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:06.326307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Bound port: b0560dd0-2531-400c-87fd-0b0f87d4ad93, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd012a997-a23a-493b-b4eb-600dd03b33a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:06.326658 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.377813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Network de84bbd9-fc4c-4911-85ab-165a0bc94fef is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:06.380667 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:06.462109 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] For port b0560dd0-2531-400c-87fd-0b0f87d4ad93, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:06.510922 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] For port b0560dd0-2531-400c-87fd-0b0f87d4ad93, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:06.520513 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.568861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:06.569407 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.571236 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] 10.222.0.21 "PUT /v2.0/ports/b0560dd0-2531-400c-87fd-0b0f87d4ad93 HTTP/1.1" status: 200 len: 1093 time: 1.2605798 Nov 24 04:17:06.576627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:06.579395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8072397-5ca2-41d9-9af1-289f4e86d887" -d '{"events": [{"name": "network-changed", "server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:06.618473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Router e513968f-dd23-4889-8fe9-1670c2724712 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:17:06.624087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77dda96d-8696-487f-ad48-a6f487e5cb90 service neutron] Pushing event updated for resources: {'Port': ['ID=b0560dd0-2531-400c-87fd-0b0f87d4ad93,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:06.678505 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8314afec-ab64-4ecc-b59c-b2851b61f150 x-openstack-request-id: req-8314afec-ab64-4ecc-b59c-b2851b61f150 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:06.678665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:06.678897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-8314afec-ab64-4ecc-b59c-b2851b61f150 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:06.679313 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'status': 'completed', 'code': 200} Nov 24 04:17:06.741879 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e075d6be-e0ba-443a-b0cd-ff2cac430727 None None] Provisioning complete for port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:06.742393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e075d6be-e0ba-443a-b0cd-ff2cac430727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:06.764627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-21c5440b-902a-4555-b470-75ab6ad2dd36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:06.766350 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-21c5440b-902a-4555-b470-75ab6ad2dd36 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 1096 time: 0.0862443 Nov 24 04:17:06.791213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e075d6be-e0ba-443a-b0cd-ff2cac430727 None None] Port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:17:06.819424 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-de4d1a64-afb6-4452-a99a-5c5b1ee13916 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93 HTTP/1.1" status: 200 len: 217 time: 0.0441899 Nov 24 04:17:06.824081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:06.844430 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-4f0de868-406d-48b5-b620-e9ba8c8c5189 admin admin] 10.222.0.48 "PUT /v2.0/routers/e513968f-dd23-4889-8fe9-1670c2724712/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5674655 Nov 24 04:17:06.910031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-ac46c0fc-fb2b-4e6a-a03b-95b0c6c7ae9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:06.911507 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-ac46c0fc-fb2b-4e6a-a03b-95b0c6c7ae9d service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0853407 Nov 24 04:17:06.928119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6316ef-94cd-4c87-a531-fa0a44720fef req-3cead575-1b3c-400f-9c4b-e284aa242844 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:06.929636 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5e6316ef-94cd-4c87-a531-fa0a44720fef req-3cead575-1b3c-400f-9c4b-e284aa242844 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 943 time: 0.0673907 Nov 24 04:17:07.002883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fa027482-93c6-475b-9680-2381c75886ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:07.004362 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-fa027482-93c6-475b-9680-2381c75886ae service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0844319 Nov 24 04:17:07.008530 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5e6316ef-94cd-4c87-a531-fa0a44720fef req-772e43cb-367b-4e8b-b366-83ad5d25943d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0683985 Nov 24 04:17:07.100052 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-6c497133-284a-40ae-ae93-f192855dcc46 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882258 Nov 24 04:17:07.201254 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-08e0ae89-1ecb-431e-bf23-804f77ea2536 req-eaf280ae-84d8-4f57-b4eb-75dcde34723b service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0937090 Nov 24 04:17:07.288430 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-bcd625ed-3746-4942-a3d5-cada91108385 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:07.289806 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-bcd625ed-3746-4942-a3d5-cada91108385 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 1096 time: 0.0409358 Nov 24 04:17:07.384885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-ebf4d48f-9279-4c47-91b8-c8fb163c34bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:07.387040 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-ebf4d48f-9279-4c47-91b8-c8fb163c34bb service neutron] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 897 time: 0.0877376 Nov 24 04:17:07.392291 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36006) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:07.396600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-627946103', 'description': 'tempest-secgroup-smoke-627946103 description', 'project_id': 'a953770267d4499382d1c4d95a04322e'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:07.441639 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-d4aa34a1-4b33-44c8-9710-443a061f1c81 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93 HTTP/1.1" status: 200 len: 217 time: 0.0409114 Nov 24 04:17:07.477140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device ecd16224-ec00-4fe3-a4a6-b8bcaa853069 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:07.481258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.513862 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-f3ad3d62-aebf-438f-b42b-357b2294e7a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:07.515366 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-f3ad3d62-aebf-438f-b42b-357b2294e7a9 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0654693 Nov 24 04:17:07.530433 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port ecd16224-ec00-4fe3-a4a6-b8bcaa853069 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:07.530809 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.590478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-82075675-6f15-4793-9d23-be9874c280f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:07.592547 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-82075675-6f15-4793-9d23-be9874c280f0 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0671678 Nov 24 04:17:07.598716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.608632 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.660310 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Sync routers for ids ['e513968f-dd23-4889-8fe9-1670c2724712'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:07.670457 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Routers {'e513968f-dd23-4889-8fe9-1670c2724712'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:07.671069 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:16:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e513968f-dd23-4889-8fe9-1670c2724712'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:07.693586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.694964 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3017626 Nov 24 04:17:07.697186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aae4d4c2-7180-4b91-8c80-602930a04d64 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6a16d4b2-5d18-452b-9b60-5cd39326b89c,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:07.698257 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36008) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:07.704089 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group_rule': {'security_group_id': '6a16d4b2-5d18-452b-9b60-5cd39326b89c', 'project_id': 'a953770267d4499382d1c4d95a04322e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:07.721284 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-01ea6816-0229-4eb2-a26d-4c9afdf42a50 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1209290 Nov 24 04:17:07.741245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.802710 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.807867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.824722 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1ad5f803-19ca-4a8f-a18e-8aa21040bd3b,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:07.827357 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b8072397-5ca2-41d9-9af1-289f4e86d887 req-72ceb583-a1b8-451d-a6c1-3aaecb8b80c3 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0962923 Nov 24 04:17:07.839594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.842187 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-89417e76-11f6-4996-91f6-16f5ec3d3759 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1413641 Nov 24 04:17:07.843692 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36010) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:07.848332 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group_rule': {'security_group_id': '6a16d4b2-5d18-452b-9b60-5cd39326b89c', 'project_id': 'a953770267d4499382d1c4d95a04322e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:07.871800 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Set router e513968f-dd23-4889-8fe9-1670c2724712 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:07.875592 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.945404 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.952128 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.955297 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0177c358-dc5b-4036-a9b6-5b95d2e24c7b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.975593 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b4cdb592-1982-45fc-9830-d7339c85b44f,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:07.982274 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:07.983321 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-2d6186e3-d2b4-4782-afb1-b11784ffc4b9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1386819 Nov 24 04:17:07.986086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36012) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:07.990511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group_rule': {'security_group_id': '6a16d4b2-5d18-452b-9b60-5cd39326b89c', 'project_id': 'a953770267d4499382d1c4d95a04322e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:08.017371 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.078015 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.082024 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.090376 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149'}], 'enable_snat': True}, 'gw_port_id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 4, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'gw_port': {'id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:53:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1387, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '7a34dfa0-3094-4ae5-87f0-b2d8c7be6607', 'name': '', 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'mac_address': 'fa:16:3e:15:41:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_interface', 'standard_attr_id': 1389, 'fixed_ips': [{'subnet_id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:04Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 2, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'subnets': [{'id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:08.098443 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f480fef6-756f-4790-9e95-26dbb7a287f7,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.112081 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.116044 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-e78cf2f2-b14c-4ef5-9536-70f611cb3078 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1262631 Nov 24 04:17:08.116211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36016) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:08.117831 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Checking router: e513968f-dd23-4889-8fe9-1670c2724712 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:08.118832 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Updating router e513968f-dd23-4889-8fe9-1670c2724712 port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:17:08.120515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group_rule': {'security_group_id': '6a16d4b2-5d18-452b-9b60-5cd39326b89c', 'project_id': 'a953770267d4499382d1c4d95a04322e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:08.132016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b85c76-674f-45a6-ab91-47f40efcabd5 req-3b31be53-9187-4c15-b954-2afd42f3254d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:08.133543 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a9b85c76-674f-45a6-ab91-47f40efcabd5 req-3b31be53-9187-4c15-b954-2afd42f3254d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 943 time: 0.0544655 Nov 24 04:17:08.148698 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.152487 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.187710 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a9b85c76-674f-45a6-ab91-47f40efcabd5 req-880bf412-4464-4738-bb06-96eb7b6e2ed8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453353 Nov 24 04:17:08.216374 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.221107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.238439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8dd312a8-6b02-45b4-8e82-80b8e1d67c0c,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.247944 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.249164 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-583da4df-a027-4bbe-a292-dd8111925485 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1320622 Nov 24 04:17:08.251899 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36018) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:08.256224 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group_rule': {'security_group_id': '6a16d4b2-5d18-452b-9b60-5cd39326b89c', 'project_id': 'a953770267d4499382d1c4d95a04322e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:08.278175 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Project a953770267d4499382d1c4d95a04322e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:17:08.283000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.340977 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.344507 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.361040 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1b8642f-de37-4e42-ae5a-bfab01e38f84,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.375510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.376733 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7089b55e-ad5f-48ba-9063-5f1bda4a8fdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1238847 Nov 24 04:17:08.379577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36020) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:08.384410 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'security_group_rule': {'security_group_id': '6a16d4b2-5d18-452b-9b60-5cd39326b89c', 'project_id': 'a953770267d4499382d1c4d95a04322e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:08.399646 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:17:08.404818 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Project a953770267d4499382d1c4d95a04322e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:17:08.409765 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.421800 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.426724 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.470415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.477838 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.494383 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e10676fd-7927-4ee3-a405-edf22a8f0eee,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.498065 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b836f4-efe2-4783-8bec-0a9acc2f3d56 None None] Pushing event updated for resources: {'Port': ['ID=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.501838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device b0560dd0-2531-400c-87fd-0b0f87d4ad93 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:17:08.518927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.520222 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-11ccc0ba-8b5f-4eaa-9931-779e86520919 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1392500 Nov 24 04:17:08.539628 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Attempting to bind port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:08.540073 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Attempting to bind port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:08.540510 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Attempting to bind port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 on network de84bbd9-fc4c-4911-85ab-165a0bc94fef {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:08.549754 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:08.550239 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Checking segment: {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:08.550713 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.551187 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Bound using segment: {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:08.551735 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Bound port: 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8cc793f1-10aa-4292-9767-d11d8ccd6e28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 171, 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:08.552182 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.620429 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] For port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:08.624497 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] For port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,segment=NetworkSegment(8cc793f1-10aa-4292-9767-d11d8ccd6e28),segment_id=8cc793f1-10aa-4292-9767-d11d8ccd6e28)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:08.626466 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port b0560dd0-2531-400c-87fd-0b0f87d4ad93, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:08.630391 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.639260 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'port_id': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'mac_address': 'fa:16:3e:be:ca:08', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:17:08.689089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.691404 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b836f4-efe2-4783-8bec-0a9acc2f3d56 None None] Pushing event updated for resources: {'Port': ['ID=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.703823 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Routers {'e513968f-dd23-4889-8fe9-1670c2724712'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:08.704498 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['e513968f-dd23-4889-8fe9-1670c2724712'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:08.706383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b0560dd0-2531-400c-87fd-0b0f87d4ad93 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:17:08.728690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port b0560dd0-2531-400c-87fd-0b0f87d4ad93, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:08.734325 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.805024 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.814738 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] Set router e513968f-dd23-4889-8fe9-1670c2724712 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:08.815473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1a042b79-8bca-421a-ae15-f540ceaf4eca None None] Provisioning complete for port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:08.815851 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1a042b79-8bca-421a-ae15-f540ceaf4eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:08.817581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=b0560dd0-2531-400c-87fd-0b0f87d4ad93,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:08.942492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['b0560dd0-2531-400c-87fd-0b0f87d4ad93'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:17:08.994258 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1a042b79-8bca-421a-ae15-f540ceaf4eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:09.046390 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1a042b79-8bca-421a-ae15-f540ceaf4eca None None] For port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,segment=NetworkSegment(8cc793f1-10aa-4292-9767-d11d8ccd6e28),segment_id=8cc793f1-10aa-4292-9767-d11d8ccd6e28)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:09.059572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1a042b79-8bca-421a-ae15-f540ceaf4eca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:09.073530 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149'}], 'enable_snat': True}, 'gw_port_id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 4, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'gw_port': {'id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:53:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1387, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '7a34dfa0-3094-4ae5-87f0-b2d8c7be6607', 'name': '', 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'mac_address': 'fa:16:3e:15:41:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_interface', 'standard_attr_id': 1389, 'fixed_ips': [{'subnet_id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:04Z', 'updated_at': '2021-11-24T04:17:08Z', 'revision_number': 4, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'subnets': [{'id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:09.104180 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35bc7b99-4c45-4483-aca7-7c2d33be1d9e None None] The sync data for ids ['e513968f-dd23-4889-8fe9-1670c2724712'] in dv-neutron-819049-1-hyperv is: [{'id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'name': 'tempest-TestVolumeBootPattern-1613689398-router', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149'}], 'enable_snat': True}, 'gw_port_id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 4, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'gw_port': {'id': 'ecd16224-ec00-4fe3-a4a6-b8bcaa853069', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:53:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1387, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:01Z', 'updated_at': '2021-11-24T04:17:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '7a34dfa0-3094-4ae5-87f0-b2d8c7be6607', 'name': '', 'network_id': 'de84bbd9-fc4c-4911-85ab-165a0bc94fef', 'tenant_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'mac_address': 'fa:16:3e:15:41:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e513968f-dd23-4889-8fe9-1670c2724712', 'device_owner': 'network:router_interface', 'standard_attr_id': 1389, 'fixed_ips': [{'subnet_id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:04Z', 'updated_at': '2021-11-24T04:17:08Z', 'revision_number': 4, 'project_id': '8ef3ace0a0984a27b51cbd7ccda3d0c0', 'subnets': [{'id': '7bc99615-38d2-48a4-b0d2-2fb2d1709b3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:09.128639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a042b79-8bca-421a-ae15-f540ceaf4eca None None] Pushing event updated for resources: {'Port': ['ID=7a34dfa0-3094-4ae5-87f0-b2d8c7be6607,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:09.216392 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-32d8355f-41d9-4a7b-ab6d-1962270df4a9 None None] Provisioning complete for port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:09.216766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-32d8355f-41d9-4a7b-ab6d-1962270df4a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:09.327937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0058da4c-87b0-4a15-8ab1-7f78bb5b450c req-458b950d-d51e-4921-90ef-bd93f0df3b9e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:09.330250 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0058da4c-87b0-4a15-8ab1-7f78bb5b450c req-458b950d-d51e-4921-90ef-bd93f0df3b9e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 944 time: 0.0577245 Nov 24 04:17:09.410474 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0058da4c-87b0-4a15-8ab1-7f78bb5b450c req-7ff63739-5584-4818-8f7b-0b8271b832ee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0683036 Nov 24 04:17:09.539298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:09.591970 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 7a34dfa0-3094-4ae5-87f0-b2d8c7be6607 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:09.592434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:10.088535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:10.502076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device b0560dd0-2531-400c-87fd-0b0f87d4ad93 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:10.529299 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7663629a-2281-4707-92c1-c9653a4a712e req-42c51377-2d08-449e-88f9-828aac850542 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:10.531514 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7663629a-2281-4707-92c1-c9653a4a712e req-42c51377-2d08-449e-88f9-828aac850542 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 944 time: 0.0573182 Nov 24 04:17:10.595507 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7663629a-2281-4707-92c1-c9653a4a712e req-1b864571-4d3c-4100-8736-2b5377808bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536849 Nov 24 04:17:10.611847 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port b0560dd0-2531-400c-87fd-0b0f87d4ad93 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:17:10.616237 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port b0560dd0-2531-400c-87fd-0b0f87d4ad93 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:10.616617 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:10.702585 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:10.726298 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:10.728550 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5bcca216-7d21-4bad-bf1e-dccb49f7594e" -d '{"events": [{"server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "name": "network-vif-plugged", "status": "completed", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:10.746141 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port b0560dd0-2531-400c-87fd-0b0f87d4ad93, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:10.751506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:10.778941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d6e53fe-056d-40a1-934a-1a89d5bdde2c x-openstack-request-id: req-1d6e53fe-056d-40a1-934a-1a89d5bdde2c {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:10.779264 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "name": "network-vif-plugged", "status": "completed", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:10.779492 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-1d6e53fe-056d-40a1-934a-1a89d5bdde2c {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:10.779905 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'code': 200} Nov 24 04:17:10.807590 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=b0560dd0-2531-400c-87fd-0b0f87d4ad93,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:10.870601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:10.955802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5911504f-9629-486b-9772-7c28aa8bdaa7 req-22b66c79-3fde-4e99-aab1-53d36e7598bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:10.957252 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5911504f-9629-486b-9772-7c28aa8bdaa7 req-22b66c79-3fde-4e99-aab1-53d36e7598bc service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 1098 time: 0.0445108 Nov 24 04:17:11.012607 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5911504f-9629-486b-9772-7c28aa8bdaa7 req-f89d5537-09ed-4ea8-889f-ad30a3f7836a service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485384 Nov 24 04:17:11.720164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4dd50f-9e2b-4747-85b1-1da7ee7927cb req-48617108-bdb4-48a5-ae88-65218abc51c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:11.721830 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc4dd50f-9e2b-4747-85b1-1da7ee7927cb req-48617108-bdb4-48a5-ae88-65218abc51c5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 945 time: 0.0493910 Nov 24 04:17:11.779112 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc4dd50f-9e2b-4747-85b1-1da7ee7927cb req-bea0e5e4-98bc-4a4e-aff2-8d5b4170fe72 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513902 Nov 24 04:17:12.164280 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:12.956953 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888ac64f-ba01-4b52-8c8d-c7950d76ac44 req-a3f8d667-d590-4e17-b204-93a8f3988285 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:12.958583 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-888ac64f-ba01-4b52-8c8d-c7950d76ac44 req-a3f8d667-d590-4e17-b204-93a8f3988285 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 945 time: 0.0540566 Nov 24 04:17:13.013309 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-888ac64f-ba01-4b52-8c8d-c7950d76ac44 req-675f0cfd-8fed-4662-8495-d5319c3be5e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480456 Nov 24 04:17:13.130945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69785716-54e0-4973-b623-79860eb8c22d req-2e93aebf-aa27-4bb6-ade9-15ad09ccf75c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:13.132335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-69785716-54e0-4973-b623-79860eb8c22d req-2e93aebf-aa27-4bb6-ade9-15ad09ccf75c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 945 time: 0.0498221 Nov 24 04:17:13.182601 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-69785716-54e0-4973-b623-79860eb8c22d req-0ce02a68-242c-4bbf-8a42-9eae79cd860b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438337 Nov 24 04:17:13.204131 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36128) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:13.244468 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15c492c1-7b77-422a-b73b-816909704cef tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:13.248920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36130) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:13.249117 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-15c492c1-7b77-422a-b73b-816909704cef tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 1093 time: 0.0437796 Nov 24 04:17:13.253461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'port_id': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:13.291981 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:13.743323 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:13.748526 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:13.855214 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP f62be6fa-8957-476a-8243-ff2cddf883fd associated. External IP: 172.26.5.252, port: b0560dd0-2531-400c-87fd-0b0f87d4ad93. Nov 24 04:17:14.426171 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:17:14.544340 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:14.549933 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:14.556282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:14.573484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:14.574458 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:14.584619 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5bb516d8-5017-4c10-aeb2-a69f014b891a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 991 time: 1.3322074 Nov 24 04:17:14.584619 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:14.584967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36134) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:14.591160 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4c4305b-8f47-46da-a016-b2d1778aa83f" -d '{"events": [{"name": "network-changed", "server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:14.631801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73024e5c-7f0c-4b6f-9932-433861da10ed x-openstack-request-id: req-73024e5c-7f0c-4b6f-9932-433861da10ed {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:14.632104 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:14.632378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-73024e5c-7f0c-4b6f-9932-433861da10ed {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:14.632796 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'status': 'completed', 'code': 200} Nov 24 04:17:14.691898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:14.958622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f62be6fa-8957-476a-8243-ff2cddf883fd', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.252', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'port_id': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1350, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'mac_address': 'fa:16:3e:be:ca:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:16:18Z', 'updated_at': '2021-11-24T04:17:13Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:14.986528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:14.995509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:14.996119 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:15.023771 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d4dcb8a4-0b1f-434e-be55-d286c453234f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 991 time: 0.4376144 Nov 24 04:17:15.029674 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-0e40a502-e94a-4df6-861d-eeb3e6b7004c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:15.031200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-0e40a502-e94a-4df6-861d-eeb3e6b7004c service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 1098 time: 0.0625529 Nov 24 04:17:15.143186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-d84184bf-1eff-4f1c-b9e8-c04debd4133e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:15.144963 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-d84184bf-1eff-4f1c-b9e8-c04debd4133e service neutron] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 897 time: 0.1050680 Nov 24 04:17:15.212889 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-785672b3-ad96-4af2-b2d1-c3fe8dc74b01 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93 HTTP/1.1" status: 200 len: 999 time: 0.0610499 Nov 24 04:17:15.267967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-17860b45-b891-4e3a-86c1-83ec077ac11a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:15.270246 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-17860b45-b891-4e3a-86c1-83ec077ac11a service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0511789 Nov 24 04:17:15.278129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:15.322537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-581f1766-e941-4d3e-8b03-1403cd5ef041 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:15.324191 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-581f1766-e941-4d3e-8b03-1403cd5ef041 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0474100 Nov 24 04:17:15.420330 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-d80d3869-02a0-4d4e-8b85-b5b9cdd951e8 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887640 Nov 24 04:17:15.520611 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-d4c4305b-8f47-46da-a016-b2d1778aa83f req-8be49a8e-4e81-4ef7-a97f-147a83455bb2 service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918009 Nov 24 04:17:15.525996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f62be6fa-8957-476a-8243-ff2cddf883fd', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.252', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'port_id': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1350, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'mac_address': 'fa:16:3e:be:ca:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:16:18Z', 'updated_at': '2021-11-24T04:17:13Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:15.554441 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f2c3ee1-e8c8-44b2-b8e8-66e02ae9eef7 None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f62be6fa-8957-476a-8243-ff2cddf883fd', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.252', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'port_id': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1350, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'mac_address': 'fa:16:3e:be:ca:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:16:18Z', 'updated_at': '2021-11-24T04:17:13Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:15.760254 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f39d3c5-4709-4e2d-a2c8-8318a1e0e140 None None] New status for floating IP f62be6fa-8957-476a-8243-ff2cddf883fd: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:17:16.027500 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36142) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:16.089800 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3f635a49-332e-4d2b-848f-e8ea80b84672 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 200 len: 993 time: 0.0611084 Nov 24 04:17:25.537287 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-2dc85e91-d223-4157-a4e2-8a6946336ed0 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-627946103&fields=id&tenant_id=a953770267d4499382d1c4d95a04322e HTTP/1.1" status: 200 len: 267 time: 0.0433211 Nov 24 04:17:25.644660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-31d75f48-678a-4692-8248-b392fab663ca tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:25.646195 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-31d75f48-678a-4692-8248-b392fab663ca tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 811 time: 0.1020622 Nov 24 04:17:25.661574 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-1c126412-5baf-45ef-b501-7634160824e7 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/quotas/a953770267d4499382d1c4d95a04322e HTTP/1.1" status: 200 len: 375 time: 0.0097024 Nov 24 04:17:25.717269 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-9a62ddad-eba6-4335-bf27-387db4c26f28 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0500746 Nov 24 04:17:25.812540 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-14f06da5-8c83-4a65-88a3-77c4c83e606c service neutron] 10.222.0.48 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842533 Nov 24 04:17:25.899198 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-6068e6fb-46ec-4789-82a0-c539bb308989 service neutron] 10.222.0.48 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805995 Nov 24 04:17:26.198536 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d7b9c4d7-66af-4d6f-8171-02eb4cb83e14 req-1914b61a-273e-443a-b81a-9ba6ac061154 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0258429 Nov 24 04:17:27.138440 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-9459b6cf-b6a7-4135-a115-d666bf6bfcef tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:27.140052 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-9459b6cf-b6a7-4135-a115-d666bf6bfcef tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 811 time: 0.1079550 Nov 24 04:17:27.226982 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-a8ce374b-8a5a-437b-9b39-543e83ccf9fb tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a953770267d4499382d1c4d95a04322e HTTP/1.1" status: 200 len: 379 time: 0.0536423 Nov 24 04:17:27.291530 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-751d4927-2dc6-49dc-9368-a8189adf26bb req-647a35dc-3bc8-4573-8523-5279bb7a3b82 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0274522 Nov 24 04:17:27.295716 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'port': {'device_id': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'admin_state_up': True, 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'security_groups': ['6a16d4b2-5d18-452b-9b60-5cd39326b89c']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:27.409417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Made reservation on behalf of a953770267d4499382d1c4d95a04322e for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:17:27.412705 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:27.540458 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Allocated IP 172.20.0.13 (4db6f33c-c141-4219-ad0f-97dfea0992c0/ba4b836b-28d1-471d-a461-f54951a2cf23/a9a81a70-97cc-44e7-9f3c-c55a11f32f22) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:27.678369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:27.710861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:27.755360 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:27.758516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:27.761088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:27.799195 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'Port': ['ID=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:27.822657 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:27.823287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:27.840586 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-ecf54ae5-62b1-4d0e-87dc-f78f55f19a19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5516567 Nov 24 04:17:27.853586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Request body: {'port': {'device_id': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:27.916764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:27.973582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-75ae5163-1beb-438c-bd9b-d8f35bd348c9 None None] Provisioning complete for port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:27.974215 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-75ae5163-1beb-438c-bd9b-d8f35bd348c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:28.007352 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-75ae5163-1beb-438c-bd9b-d8f35bd348c9 None None] Port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:17:28.189825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a9a81a70-97cc-44e7-9f3c-c55a11f32f22 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:17:28.197397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:28.210375 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Transition to ACTIVE for port object a9a81a70-97cc-44e7-9f3c-c55a11f32f22 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:17:28.213941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:28.264158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Pushing event updated for resources: {'Port': ['ID=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:28.356287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Attempting to bind port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:28.360246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Attempting to bind port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:28.361413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Attempting to bind port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:28.370260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:17:28.370945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Attempting to bind port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:28.378119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 17, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:28.378772 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Checking segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:28.379398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Bound using segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:28.380184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Bound port: a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:28.380724 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:28.424884 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2366342-9aa7-46c1-b4c0-125c767ef072 req-6ff5330a-f6fb-47e3-9412-5a34773e8165 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:28.433211 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c2366342-9aa7-46c1-b4c0-125c767ef072 req-6ff5330a-f6fb-47e3-9412-5a34773e8165 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0631986 Nov 24 04:17:28.470691 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] For port a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:28.474885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] For port a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:28.479671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:28.486602 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c2366342-9aa7-46c1-b4c0-125c767ef072 req-e3e8a9a5-cc60-4470-a663-ec3f8ba38cdd tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0524743 Nov 24 04:17:28.514052 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:28.514771 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:28.516876 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] 10.222.0.21 "PUT /v2.0/ports/a9a81a70-97cc-44e7-9f3c-c55a11f32f22 HTTP/1.1" status: 200 len: 1094 time: 0.6675355 Nov 24 04:17:28.517452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:28.519820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19fe9732-8ecc-4c21-a16b-7584c35873c5" -d '{"events": [{"name": "network-changed", "server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:28.582542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-547b7091-76ec-42b1-9775-d472ae8a707c service neutron] Pushing event updated for resources: {'Port': ['ID=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:28.614706 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27c94203-1bf3-4b2d-904c-ea2b2f16cd11 x-openstack-request-id: req-27c94203-1bf3-4b2d-904c-ea2b2f16cd11 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:28.615102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:28.615423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-27c94203-1bf3-4b2d-904c-ea2b2f16cd11 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:28.615892 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'status': 'completed', 'code': 200} Nov 24 04:17:28.633151 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-90d04513-7c9a-4a5a-a012-37cd14422d9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:28.634713 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-90d04513-7c9a-4a5a-a012-37cd14422d9f service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 1097 time: 0.0634203 Nov 24 04:17:28.685200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-e4c6c3e9-2414-43e8-98b4-6e9d0001f9b8 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22 HTTP/1.1" status: 200 len: 217 time: 0.0399587 Nov 24 04:17:28.738126 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-54908970-b8c9-4ec9-8baa-06d056513c94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:28.739604 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-54908970-b8c9-4ec9-8baa-06d056513c94 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0454681 Nov 24 04:17:28.786850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-d84604c1-2cb0-444c-a7e6-b94f6e94df24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:28.788358 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-d84604c1-2cb0-444c-a7e6-b94f6e94df24 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0412452 Nov 24 04:17:28.884465 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-cebbf815-ec58-4b6e-99d4-4a6fab49e0d4 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868669 Nov 24 04:17:28.979452 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57a7aee0-ffa8-49c2-b2c5-5cadd54013ad req-3ba88df9-1c67-4b5d-8cf4-475ef7438092 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864770 Nov 24 04:17:29.072962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-26fe56c9-70f9-4995-bb55-a079f5808617 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:29.074459 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-26fe56c9-70f9-4995-bb55-a079f5808617 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 1097 time: 0.0507188 Nov 24 04:17:29.168203 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-9dded803-c515-4e96-955c-7f1c5420e9a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:29.170253 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-9dded803-c515-4e96-955c-7f1c5420e9a5 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0874641 Nov 24 04:17:29.215502 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-8657e2da-d751-4d48-b0e6-a6a60675d6d0 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22 HTTP/1.1" status: 200 len: 217 time: 0.0382142 Nov 24 04:17:29.265002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-15034433-6f85-4bd0-97dc-a4e6ba8a8bdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:29.266507 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-15034433-6f85-4bd0-97dc-a4e6ba8a8bdc service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0436985 Nov 24 04:17:29.313171 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-083f2f7b-176f-4d74-83e1-9ba16259b2a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:29.314694 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-083f2f7b-176f-4d74-83e1-9ba16259b2a1 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0406709 Nov 24 04:17:29.410757 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-d3a03e86-36bd-4177-a287-db1df4826181 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882893 Nov 24 04:17:29.501152 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19fe9732-8ecc-4c21-a16b-7584c35873c5 req-985b2114-54be-4663-82ad-452fbc11730a service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820875 Nov 24 04:17:29.613264 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a79832-2d41-443b-94a4-670ca1b929b4 req-d2212b0a-4125-4083-a212-f53722cbcbd6 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:29.614792 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-13a79832-2d41-443b-94a4-670ca1b929b4 req-d2212b0a-4125-4083-a212-f53722cbcbd6 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0524356 Nov 24 04:17:29.664189 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-13a79832-2d41-443b-94a4-670ca1b929b4 req-60e1767d-e286-4b92-ab02-ae6cfa9b93e4 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431957 Nov 24 04:17:30.783367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68242004-34ac-4084-89e2-61fecc24a7ef req-bf99c835-809a-40a7-94af-002b1427b83a tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:30.784841 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-68242004-34ac-4084-89e2-61fecc24a7ef req-bf99c835-809a-40a7-94af-002b1427b83a tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0495086 Nov 24 04:17:30.838637 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-68242004-34ac-4084-89e2-61fecc24a7ef req-344d6f81-8023-4e6b-b690-56a5d472bfe5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477655 Nov 24 04:17:31.953506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2eadb38-9724-4449-93fb-d7039ed193cf req-c4f144a9-293c-4c38-b64c-e2c2ca95f88e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:31.955018 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b2eadb38-9724-4449-93fb-d7039ed193cf req-c4f144a9-293c-4c38-b64c-e2c2ca95f88e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0487752 Nov 24 04:17:32.004794 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b2eadb38-9724-4449-93fb-d7039ed193cf req-21a46393-7bd0-4b68-b1fc-ce544010c89c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436380 Nov 24 04:17:33.119352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753ee5fb-c3e5-471f-b44d-eb62631f49dc req-4209ddf9-5580-4b00-81c9-eb183a68da5c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:33.120815 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-753ee5fb-c3e5-471f-b44d-eb62631f49dc req-4209ddf9-5580-4b00-81c9-eb183a68da5c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0500984 Nov 24 04:17:33.168767 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-753ee5fb-c3e5-471f-b44d-eb62631f49dc req-244347e4-8193-45b4-9dac-836c700fc28c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421274 Nov 24 04:17:34.285995 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-021f44e2-e07b-40d0-a0f2-92b304f8e5b0 req-5448ccae-9489-46a7-9c6d-52ee8decaee6 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:34.287567 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-021f44e2-e07b-40d0-a0f2-92b304f8e5b0 req-5448ccae-9489-46a7-9c6d-52ee8decaee6 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0512977 Nov 24 04:17:34.334929 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-021f44e2-e07b-40d0-a0f2-92b304f8e5b0 req-ab931555-330f-497d-95aa-884da76efa22 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415292 Nov 24 04:17:34.957190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-861a7284-69af-4999-8dac-229cb456b223 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:35.447074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf28e8a-1fcc-421e-a5ae-d5dc95db3c8f req-b3cc8c9b-b131-42ae-8620-fe59d37cdd47 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:35.448544 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-baf28e8a-1fcc-421e-a5ae-d5dc95db3c8f req-b3cc8c9b-b131-42ae-8620-fe59d37cdd47 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0489023 Nov 24 04:17:35.497120 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-baf28e8a-1fcc-421e-a5ae-d5dc95db3c8f req-3448e110-c309-4940-b780-5e6e4271ba75 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427225 Nov 24 04:17:36.612930 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90fbb799-f658-4324-9e0c-3fd20f5a4c12 req-b0656948-923f-41a8-b8ba-d4a3223b2651 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:36.614409 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-90fbb799-f658-4324-9e0c-3fd20f5a4c12 req-b0656948-923f-41a8-b8ba-d4a3223b2651 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0524914 Nov 24 04:17:36.667233 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-90fbb799-f658-4324-9e0c-3fd20f5a4c12 req-f2b48f55-2731-45dd-bb5d-c88206d4f9b8 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469494 Nov 24 04:17:37.785173 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b59f47-e902-4830-bb63-88b8662ecaf0 req-cbd47d09-810b-4ed7-9f41-e3111650f20c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:37.786671 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-15b59f47-e902-4830-bb63-88b8662ecaf0 req-cbd47d09-810b-4ed7-9f41-e3111650f20c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0482166 Nov 24 04:17:37.834438 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-15b59f47-e902-4830-bb63-88b8662ecaf0 req-252af2ce-89d0-466f-9f84-5b155d071590 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420337 Nov 24 04:17:37.956486 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-02f332ec-27ee-4058-9af3-971481f52ec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:38.760282 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:38.947510 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f396458-cee7-4546-9185-cbcc84819d22 req-7a78af75-ac25-4c90-89bb-847731bdc5b5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:38.948969 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8f396458-cee7-4546-9185-cbcc84819d22 req-7a78af75-ac25-4c90-89bb-847731bdc5b5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0490649 Nov 24 04:17:38.997211 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8f396458-cee7-4546-9185-cbcc84819d22 req-bd845a5f-798f-45a6-824a-5b6b94ec3d6b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416741 Nov 24 04:17:40.083536 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:40.113760 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb54eaea-2d2f-4831-9af4-2a4c54d3d49e req-3f470ec9-0402-4d15-a327-48380f7b9ff1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:40.115332 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fb54eaea-2d2f-4831-9af4-2a4c54d3d49e req-3f470ec9-0402-4d15-a327-48380f7b9ff1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 944 time: 0.0515692 Nov 24 04:17:40.167423 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fb54eaea-2d2f-4831-9af4-2a4c54d3d49e req-f967cb8f-4116-459a-9ebe-a380ee85d577 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462840 Nov 24 04:17:40.626284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9a81a70-97cc-44e7-9f3c-c55a11f32f22 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:17:40.720989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:40.732200 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'port_id': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'mac_address': 'fa:16:3e:1e:cd:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:17:40.767146 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:40.779650 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a9a81a70-97cc-44e7-9f3c-c55a11f32f22 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:17:40.797537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:40.802549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:40.861234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:40.869986 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:41.083439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['a9a81a70-97cc-44e7-9f3c-c55a11f32f22'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:17:41.284631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a528e1b1-4fe1-410c-871a-f1510f9142be req-dd2878bb-169f-4c46-be2d-71431fc3c95d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:41.286108 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a528e1b1-4fe1-410c-871a-f1510f9142be req-dd2878bb-169f-4c46-be2d-71431fc3c95d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 945 time: 0.0533817 Nov 24 04:17:41.334958 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a528e1b1-4fe1-410c-871a-f1510f9142be req-ad448834-de3b-405f-b2bd-09abcb654006 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429616 Nov 24 04:17:42.169886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:42.446052 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c568207-a60c-4714-ad8d-a2f871218bb1 req-0003a323-2cbe-421f-bb85-cdeee3bbf128 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:42.447530 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8c568207-a60c-4714-ad8d-a2f871218bb1 req-0003a323-2cbe-421f-bb85-cdeee3bbf128 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 945 time: 0.0472186 Nov 24 04:17:42.495427 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-8c568207-a60c-4714-ad8d-a2f871218bb1 req-914abfce-4a6d-4cc9-ac9d-90d77d5aae8f tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414534 Nov 24 04:17:42.625224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9a81a70-97cc-44e7-9f3c-c55a11f32f22 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:17:42.673256 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:17:42.677003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:42.677377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:42.754571 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:42.775580 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:42.777890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb149c68-362e-4945-b4cd-ee158668e386" -d '{"events": [{"server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:42.790203 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:42.794599 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:42.819380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71a50b00-af16-4bf6-91b6-23e879170036 x-openstack-request-id: req-71a50b00-af16-4bf6-91b6-23e879170036 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:42.819676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:42.819928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-71a50b00-af16-4bf6-91b6-23e879170036 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:42.820336 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'code': 200} Nov 24 04:17:42.847192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:43.011617 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e79417-d94b-47db-82fd-de3a07462eed req-9dd9f426-cabe-4b66-8469-13044c679966 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:43.013312 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-86e79417-d94b-47db-82fd-de3a07462eed req-9dd9f426-cabe-4b66-8469-13044c679966 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 1099 time: 0.0398183 Nov 24 04:17:43.061112 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-86e79417-d94b-47db-82fd-de3a07462eed req-bf2cbb65-0522-430b-a3f1-7759a22db7e5 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398641 Nov 24 04:17:43.608365 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b326a92e-a9c4-4b07-ad86-6a8b328ec820 req-dc38c491-25de-4b3d-b415-52e924aa3b44 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:43.609848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b326a92e-a9c4-4b07-ad86-6a8b328ec820 req-dc38c491-25de-4b3d-b415-52e924aa3b44 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 946 time: 0.0486917 Nov 24 04:17:43.657798 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b326a92e-a9c4-4b07-ad86-6a8b328ec820 req-46413528-6b51-4930-9ce5-b04623173f1e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420995 Nov 24 04:17:44.770464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7404b65-56bf-4cf5-82ce-b8f394f6d3d9 req-4a4b7732-1251-43a9-98b0-e487ee3d7814 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:44.771903 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a7404b65-56bf-4cf5-82ce-b8f394f6d3d9 req-4a4b7732-1251-43a9-98b0-e487ee3d7814 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 946 time: 0.0478280 Nov 24 04:17:44.823247 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a7404b65-56bf-4cf5-82ce-b8f394f6d3d9 req-2b41b999-e917-403b-9ffd-2bd14d4071e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456176 Nov 24 04:17:44.938735 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc41567b-0e43-45a6-9042-626a3746fde5 req-4e043037-f0fd-4b96-b57d-b634101b95c5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:44.940233 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-dc41567b-0e43-45a6-9042-626a3746fde5 req-4e043037-f0fd-4b96-b57d-b634101b95c5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 946 time: 0.0525544 Nov 24 04:17:44.993978 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-dc41567b-0e43-45a6-9042-626a3746fde5 req-e2cbc2dd-bd6f-4d88-a2ce-a412a3ec076e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439870 Nov 24 04:17:45.016348 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36260) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:45.143106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-008b0ce6-c8cc-43cf-a819-ab1b011264f8 tempest-TestVolumeBootPattern-1619669075 tempest-TestVolumeBootPattern-1619669075-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:45.144592 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-008b0ce6-c8cc-43cf-a819-ab1b011264f8 tempest-TestVolumeBootPattern-1619669075 tempest-TestVolumeBootPattern-1619669075-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 1094 time: 0.1272774 Nov 24 04:17:45.147582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36264) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:45.151768 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:45.176490 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:45.269796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:45.377697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Allocated IP 172.26.5.121 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/040a5810-6f60-4079-b974-3854ab30e6fd) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:45.388869 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:17:45.475865 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:45.512787 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:45.552746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:45.555512 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:45.558923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:45.579892 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'Port': ['ID=040a5810-6f60-4079-b974-3854ab30e6fd,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:46.032584 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:46.130533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:46.273273 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:46.277672 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:46.343192 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'Port': ['ID=040a5810-6f60-4079-b974-3854ab30e6fd,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:46.354108 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.354487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.354834 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.355175 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.355776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.356141 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.356475 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.356821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.357139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.357467 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.357799 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.358122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:46.363454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:46.764979 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Floating IP cb261de6-eaa9-4c84-b25d-90b15d8d4691 associated. External IP: 172.26.5.121, port: a9a81a70-97cc-44e7-9f3c-c55a11f32f22. Nov 24 04:17:46.969511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Router b3b4882e-8f09-451f-9384-42d336c1f444 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:17:47.077071 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:47.086683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] Sync routers for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:47.094400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:47.097356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:47.097974 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:47.122810 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-dbab764f-1440-446e-b23c-3a37d2aec0c1 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.9741974 Nov 24 04:17:47.123502 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:47.125767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80089d7d-839b-49f4-aa62-1e9ec15f8f26" -d '{"events": [{"name": "network-changed", "server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:47.162000 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5639c668-7a7e-4ff4-8526-89fbf9028168 x-openstack-request-id: req-5639c668-7a7e-4ff4-8526-89fbf9028168 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:47.162334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:47.162597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-5639c668-7a7e-4ff4-8526-89fbf9028168 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:47.163287 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'status': 'completed', 'code': 200} Nov 24 04:17:47.224798 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:47.228524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-8be20aab-2516-4c3d-9344-0032b6a48fe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:47.230024 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-8be20aab-2516-4c3d-9344-0032b6a48fe4 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 1099 time: 0.0429671 Nov 24 04:17:47.351459 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-29c4f0cb-a8e8-4738-a9ee-d89c8b5e05fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:47.353048 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-29c4f0cb-a8e8-4738-a9ee-d89c8b5e05fd service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.1139576 Nov 24 04:17:47.441253 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b9d6294-f226-43b5-bb43-f7b20fbd2228 req-6c429885-62c8-4e34-b950-8478845f9293 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:47.442754 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4b9d6294-f226-43b5-bb43-f7b20fbd2228 req-6c429885-62c8-4e34-b950-8478845f9293 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 945 time: 0.1033361 Nov 24 04:17:47.446731 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-507806b0-d54e-404c-84c2-68724dc32398 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22 HTTP/1.1" status: 200 len: 1000 time: 0.0791831 Nov 24 04:17:47.459968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'cb261de6-eaa9-4c84-b25d-90b15d8d4691', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'floating_ip_address': '172.26.5.121', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'port_id': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1401, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'mac_address': 'fa:16:3e:1e:cd:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:17:45Z', 'updated_at': '2021-11-24T04:17:45Z', 'revision_number': 0, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:47.486449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] Checking router: b3b4882e-8f09-451f-9384-42d336c1f444 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:47.494659 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:47.495307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:47.526777 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4b9d6294-f226-43b5-bb43-f7b20fbd2228 req-ac077cfb-6e77-4732-8d42-9bc8eb004dea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0781686 Nov 24 04:17:47.529155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-662b07c4-0454-4b8f-81a1-5178cc631c46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:47.530533 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-662b07c4-0454-4b8f-81a1-5178cc631c46 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0695469 Nov 24 04:17:47.585998 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-f9db4079-0205-4645-9873-dc31d4463061 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:47.587420 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-f9db4079-0205-4645-9873-dc31d4463061 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0457790 Nov 24 04:17:47.601341 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:47.680739 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-dc050df3-aa70-4384-ac02-d9fdf186f6fe service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838201 Nov 24 04:17:47.776235 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-80089d7d-839b-49f4-aa62-1e9ec15f8f26 req-68215a73-087c-4b31-acb7-fbea10294063 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863233 Nov 24 04:17:47.822592 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'cb261de6-eaa9-4c84-b25d-90b15d8d4691', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'floating_ip_address': '172.26.5.121', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'port_id': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1401, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'mac_address': 'fa:16:3e:1e:cd:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:17:45Z', 'updated_at': '2021-11-24T04:17:45Z', 'revision_number': 0, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:47.847998 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e80e163-ca04-4258-a983-cc7113137c6a None None] The sync data for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv is: [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'cb261de6-eaa9-4c84-b25d-90b15d8d4691', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'floating_ip_address': '172.26.5.121', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'port_id': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1401, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'mac_address': 'fa:16:3e:1e:cd:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:17:45Z', 'updated_at': '2021-11-24T04:17:45Z', 'revision_number': 0, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:48.038344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bccf5e57-7fe3-491a-a666-1c459c0e0780 None None] New status for floating IP cb261de6-eaa9-4c84-b25d-90b15d8d4691: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:17:48.644635 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4669c8-a979-46f1-ba98-46ddd6ddfa6a req-b346009a-0360-4b81-9f67-cce98f03fdec tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:48.646115 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6b4669c8-a979-46f1-ba98-46ddd6ddfa6a req-b346009a-0360-4b81-9f67-cce98f03fdec tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 945 time: 0.0501461 Nov 24 04:17:48.694633 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6b4669c8-a979-46f1-ba98-46ddd6ddfa6a req-6305a83b-8b1f-4751-8ea1-a33027c7d063 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=5ff7db10-db54-49ee-aa7e-96078e13864c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425453 Nov 24 04:17:48.798886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-9f865d45-b169-477c-bad5-ca7d22610833 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:48.800300 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-9f865d45-b169-477c-bad5-ca7d22610833 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 945 time: 0.0477843 Nov 24 04:17:48.887786 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port b0560dd0-2531-400c-87fd-0b0f87d4ad93 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:17:48.888038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:48.977423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port b0560dd0-2531-400c-87fd-0b0f87d4ad93, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=b0560dd0-2531-400c-87fd-0b0f87d4ad93,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:48.977781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:49.200908 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:49.201269 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:49.201466 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP f62be6fa-8957-476a-8243-ff2cddf883fd disassociated. External IP: 172.26.5.252, port: b0560dd0-2531-400c-87fd-0b0f87d4ad93. Nov 24 04:17:49.201800 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for b0560dd0-2531-400c-87fd-0b0f87d4ad93 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:17:49.326296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:49.354125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=b0560dd0-2531-400c-87fd-0b0f87d4ad93,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:49.469380 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:17:49.572511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:49.583420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:49.597694 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:49.598734 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:49.616431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port b0560dd0-2531-400c-87fd-0b0f87d4ad93 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:17:49.618971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:49.622850 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e22d9272-d158-4ac5-b2cf-8d16f42d98a6 req-270e95b5-7c75-4125-9d6d-ac915e4428e4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "DELETE /v2.0/ports/b0560dd0-2531-400c-87fd-0b0f87d4ad93 HTTP/1.1" status: 204 len: 173 time: 0.8158000 Nov 24 04:17:49.623285 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'name': 'network-vif-deleted', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:49.626111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7ede5ce-264f-4ca7-a361-807fc960d20f" -d '{"events": [{"server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "name": "network-vif-deleted", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:49.679843 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7822218b-e875-48df-9d04-ab4a11e16d73 x-openstack-request-id: req-7822218b-e875-48df-9d04-ab4a11e16d73 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:49.680138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a834825b-2424-492f-99c6-7ab4c2df5b7b", "name": "network-vif-deleted", "tag": "b0560dd0-2531-400c-87fd-0b0f87d4ad93", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:49.680394 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-7822218b-e875-48df-9d04-ab4a11e16d73 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:49.680798 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a834825b-2424-492f-99c6-7ab4c2df5b7b', 'name': 'network-vif-deleted', 'tag': 'b0560dd0-2531-400c-87fd-0b0f87d4ad93', 'status': 'completed', 'code': 200} Nov 24 04:17:49.725156 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:49.831094 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9d9e72ed-a8e0-4050-affa-1d7d79ae4634 req-b75ca274-a1fe-48eb-9f4a-10998a5ea73f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=a834825b-2424-492f-99c6-7ab4c2df5b7b HTTP/1.1" status: 200 len: 210 time: 0.0367341 Nov 24 04:17:49.946611 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:50.118313 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:50.126673 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:50.127275 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:50.237168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:50.315454 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-059f82d9-ae35-4b53-a068-7ff02ca42576 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0394409 Nov 24 04:17:50.397640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-84130c9d-b55e-47f7-b10e-0bd32b97046d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:50.399145 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-84130c9d-b55e-47f7-b10e-0bd32b97046d service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 1099 time: 0.0411558 Nov 24 04:17:50.432689 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:50.462918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10109b2-b341-4e33-ae18-091de4d703cf None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:16:04Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '2bc693d7-de18-4334-babc-0cdd54f76d8d', 'name': '', 'network_id': 'cc47f608-eaac-4acd-9462-96543f06a23d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:03:48:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1338, 'fixed_ips': [{'subnet_id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:03Z', 'updated_at': '2021-11-24T04:16:08Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': 'eb8cba97-6bd4-453b-a877-4a1ba469598b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:50.512032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-d44bebfc-ccbf-494a-95f6-b853874e0c0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:50.513519 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-d44bebfc-ccbf-494a-95f6-b853874e0c0c service neutron] 10.222.0.21 "GET /v2.0/networks?id=cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 200 len: 897 time: 0.0929978 Nov 24 04:17:50.556549 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-47f50ce8-8561-43f5-9949-16e212655a96 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 200 len: 217 time: 0.0349569 Nov 24 04:17:50.610968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-6140e17c-3dc7-4f0f-bf04-e8337f64fa93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:50.612647 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-6140e17c-3dc7-4f0f-bf04-e8337f64fa93 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 200 len: 834 time: 0.0492585 Nov 24 04:17:50.661539 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-156ac424-6042-4b6b-92d5-36f6c60fbba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:50.663100 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-156ac424-6042-4b6b-92d5-36f6c60fbba8 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=cc47f608-eaac-4acd-9462-96543f06a23d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0435522 Nov 24 04:17:50.701531 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a4757df-aa02-4f24-bc9f-8a4c0e4f9189 None None] New status for floating IP f62be6fa-8957-476a-8243-ff2cddf883fd: DOWN {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:17:50.762107 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-7f790d0a-c6e5-4923-828c-5bb680e531da service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908377 Nov 24 04:17:50.853124 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7eec6608-667a-44ad-8ff5-6c98f5a643c5 req-f3f92ece-80f0-4e25-9838-700f5e57c30d service neutron] 10.222.0.21 "GET /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830169 Nov 24 04:17:50.890520 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36284) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:50.947297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5048dd30-1538-47ad-8ed8-193b417e9ac5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:50.982173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5048dd30-1538-47ad-8ed8-193b417e9ac5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.045937 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5048dd30-1538-47ad-8ed8-193b417e9ac5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.048535 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5048dd30-1538-47ad-8ed8-193b417e9ac5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.049672 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5048dd30-1538-47ad-8ed8-193b417e9ac5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/5ff7db10-db54-49ee-aa7e-96078e13864c HTTP/1.1" status: 204 len: 168 time: 0.1581540 Nov 24 04:17:51.058473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5048dd30-1538-47ad-8ed8-193b417e9ac5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ff7db10-db54-49ee-aa7e-96078e13864c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:51.081130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36288) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:51.206618 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 9227138b-8f4c-4705-8ad3-ecd7c7c39de9 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:17:51.206962 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.283592 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.283914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.295262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 9227138b-8f4c-4705-8ad3-ecd7c7c39de9 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:17:51.423519 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.449365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=9227138b-8f4c-4705-8ad3-ecd7c7c39de9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:51.510869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.514085 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:51.515246 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1fddf096-6cf3-402c-91bc-cc83b572c58f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/floatingips/f62be6fa-8957-476a-8243-ff2cddf883fd HTTP/1.1" status: 204 len: 168 time: 0.4327395 Nov 24 04:17:51.735834 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82e29f-b366-4dee-ba75-8666e01d10b4 req-cc1f4717-5fdd-44cd-a1b9-138d4d150072 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:51.737218 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ac82e29f-b366-4dee-ba75-8666e01d10b4 req-cc1f4717-5fdd-44cd-a1b9-138d4d150072 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 946 time: 0.0519910 Nov 24 04:17:51.784597 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ac82e29f-b366-4dee-ba75-8666e01d10b4 req-5753a9a5-757f-46c3-acdf-e7475b5cf450 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414035 Nov 24 04:17:52.659739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device b0560dd0-2531-400c-87fd-0b0f87d4ad93 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:17:52.679195 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: b0560dd0-2531-400c-87fd-0b0f87d4ad93 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:17:52.679539 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device b0560dd0-2531-400c-87fd-0b0f87d4ad93 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:17:52.902280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478bb0a4-e027-4ad7-bb66-528b1c402ee2 req-c4380044-680b-4fea-9d4f-97b19e5943df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:52.904426 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-478bb0a4-e027-4ad7-bb66-528b1c402ee2 req-c4380044-680b-4fea-9d4f-97b19e5943df tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 946 time: 0.0505769 Nov 24 04:17:52.984764 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-478bb0a4-e027-4ad7-bb66-528b1c402ee2 req-bf69be85-0964-4cfc-8b9c-257d80d3021f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=7e308cfa-0137-4e23-b917-0559eeed8035&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0743234 Nov 24 04:17:53.003810 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-5f2cbc8c-aab9-4cdb-b6cb-954f3bf52a7e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:53.005214 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-5f2cbc8c-aab9-4cdb-b6cb-954f3bf52a7e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=77718a02-e4a6-465e-801a-bef233ad5108 HTTP/1.1" status: 200 len: 946 time: 0.0594063 Nov 24 04:17:53.096367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:17:53.096702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:53.183067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:53.183346 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:53.195670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:17:53.320954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:53.349574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=7f0e92d3-157f-4257-ab9c-e07744f0f7c4,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:53.393563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:17:53.395904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:53.399173 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e5b611a8-84a6-462a-94cf-806e938fbeae req-3974cbf1-9cb4-4388-85e9-ce0d93f7e8ce tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "DELETE /v2.0/ports/7f0e92d3-157f-4257-ab9c-e07744f0f7c4 HTTP/1.1" status: 204 len: 173 time: 0.3878629 Nov 24 04:17:53.399605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'name': 'network-vif-deleted', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:17:53.401825 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11afaa23-8aba-4531-9c43-2c11077ce443" -d '{"events": [{"server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "name": "network-vif-deleted", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:17:53.439027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:17:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-660878d6-0c60-404f-b12e-930ffb059ca8 x-openstack-request-id: req-660878d6-0c60-404f-b12e-930ffb059ca8 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:17:53.439268 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77718a02-e4a6-465e-801a-bef233ad5108", "name": "network-vif-deleted", "tag": "7f0e92d3-157f-4257-ab9c-e07744f0f7c4", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:17:53.439528 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-660878d6-0c60-404f-b12e-930ffb059ca8 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:17:53.439927 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77718a02-e4a6-465e-801a-bef233ad5108', 'name': 'network-vif-deleted', 'tag': '7f0e92d3-157f-4257-ab9c-e07744f0f7c4', 'status': 'completed', 'code': 200} Nov 24 04:17:54.040988 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36302) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:54.098687 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.123579 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.186422 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.189009 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.190195 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/7e308cfa-0137-4e23-b917-0559eeed8035 HTTP/1.1" status: 204 len: 168 time: 0.1481221 Nov 24 04:17:54.200209 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e308cfa-0137-4e23-b917-0559eeed8035,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:54.207652 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.208007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.208354 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.208696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.209036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.209371 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.209706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.210035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.210390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.210717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.211072 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.211396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d05137b7-d350-4937-9c3d-4b6f984bc12a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:54.225823 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36306) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:54.570553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.816890 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 2bc693d7-de18-4334-babc-0cdd54f76d8d {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:17:54.817231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.905230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port 2bc693d7-de18-4334-babc-0cdd54f76d8d, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=2bc693d7-de18-4334-babc-0cdd54f76d8d,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:54.905509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:54.917383 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 2bc693d7-de18-4334-babc-0cdd54f76d8d owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:17:55.094932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:55.120680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=2bc693d7-de18-4334-babc-0cdd54f76d8d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:55.288247 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:55.841354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router a4275832-60be-4568-aa83-97963f2ab8c7 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:17:55.948504 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:55.954504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e17f368c-e8ee-4d02-ab06-6042e105fb79 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/a4275832-60be-4568-aa83-97963f2ab8c7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7272127 Nov 24 04:17:55.956886 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36308) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:55.959801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] Sync routers for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:55.970506 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:55.971378 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:56.009601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting subnet eb8cba97-6bd4-453b-a877-4a1ba469598b {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:17:56.013501 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.060669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.091634 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:56.145003 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.206919 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.241849 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Subnet': ['ID=eb8cba97-6bd4-453b-a877-4a1ba469598b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:56.244107 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.248005 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d7a680e5-79da-4c66-89cf-af5720f41bac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/subnets/eb8cba97-6bd4-453b-a877-4a1ba469598b HTTP/1.1" status: 204 len: 168 time: 0.2901261 Nov 24 04:17:56.250609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36310) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:56.269732 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78175293-4f05-4b16-9459-a314b521a0c9 None None] Network cc47f608-eaac-4acd-9462-96543f06a23d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:17:56.364396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.392036 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:17:55Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:56.424440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] Checking router: a4275832-60be-4568-aa83-97963f2ab8c7 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:56.438783 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] Routers {'a4275832-60be-4568-aa83-97963f2ab8c7'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:56.439449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['a4275832-60be-4568-aa83-97963f2ab8c7'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:56.476935 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.522039 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] DHCP port deletion for cc47f608-eaac-4acd-9462-96543f06a23d request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:56.543069 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port a2998e69-c857-42ba-997c-e6b38755303c {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:17:56.544050 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.574353 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] Set router a4275832-60be-4568-aa83-97963f2ab8c7 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:56.627528 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port a2998e69-c857-42ba-997c-e6b38755303c, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a2998e69-c857-42ba-997c-e6b38755303c,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:56.627965 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.641631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for a2998e69-c857-42ba-997c-e6b38755303c owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:17:56.692371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Deleting port d59f28e8-6a29-4fe0-acf9-da907f47c836 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:17:56.692739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.805756 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] For port d59f28e8-6a29-4fe0-acf9-da907f47c836, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d59f28e8-6a29-4fe0-acf9-da907f47c836,segment=NetworkSegment(d012a997-a23a-493b-b4eb-600dd03b33a3),segment_id=d012a997-a23a-493b-b4eb-600dd03b33a3)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:17:56.806201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.819665 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.824216 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Calling delete_port for d59f28e8-6a29-4fe0-acf9-da907f47c836 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:17:56.846981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=a2998e69-c857-42ba-997c-e6b38755303c,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:56.870236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-148d7d2c-add0-4b63-bf7b-f9e42a6ad23f None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:56.886810 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:17:55Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:56.910859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.928767 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1adb98a-d77d-4f30-8025-02e1d7060a4f None None] The sync data for ids ['a4275832-60be-4568-aa83-97963f2ab8c7'] in dv-neutron-819049-1-hyperv is: [{'id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'name': 'tempest-TestNetworkBasicOps-router-1327367041', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62'}], 'enable_snat': True}, 'gw_port_id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:15:59Z', 'updated_at': '2021-11-24T04:17:55Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'a2998e69-c857-42ba-997c-e6b38755303c', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:79:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4275832-60be-4568-aa83-97963f2ab8c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1335, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.62', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:00Z', 'updated_at': '2021-11-24T04:16:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:17:56.956053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:56.983860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Pushing event deleted for resources: {'Port': ['ID=d59f28e8-6a29-4fe0-acf9-da907f47c836,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:56.988084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] No DVR routers for this DVR port d59f28e8-6a29-4fe0-acf9-da907f47c836 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:17:56.994773 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.995133 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.995482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.995822 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.996160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.996541 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.996877 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.997212 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.997962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.997962 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.999278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:56.999278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-087f9f8c-8b96-4ed1-a218-85734652c9d4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:17:57.014987 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.017243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.059481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.060111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Fanout notify agent at l3_agent the message router_deleted on router a4275832-60be-4568-aa83-97963f2ab8c7 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:17:57.067058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.068150 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9ba2efb1-4ffa-4870-bf0b-254ba867743b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/routers/a4275832-60be-4568-aa83-97963f2ab8c7 HTTP/1.1" status: 204 len: 168 time: 0.8166392 Nov 24 04:17:57.070812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36312) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:57.145111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.234369 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.253711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cc47f608-eaac-4acd-9462-96543f06a23d']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:57.263352 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd012a997-a23a-493b-b4eb-600dd03b33a3') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:57.263656 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd012a997-a23a-493b-b4eb-600dd03b33a3') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:57.273363 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.287611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.293588 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Releasing vlan 167 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:17:57.293985 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:17:57.296989 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:17:57.360573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.368278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.374413 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/networks/cc47f608-eaac-4acd-9462-96543f06a23d HTTP/1.1" status: 204 len: 168 time: 0.2993636 Nov 24 04:17:57.385855 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e42e03-ffce-480e-bb79-a3b710dc8cd6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Network': ['ID=cc47f608-eaac-4acd-9462-96543f06a23d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:57.392361 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36314) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:57.401219 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--1742706386', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:57.422931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:17:57.426506 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.451894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 190, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:17:57.460924 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.461300 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment 44d04a49-eacd-4810-b87f-c2849fcb7f59 of type vlan for network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 Nov 24 04:17:57.508532 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.541106 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.547445 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:57.548123 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.561322 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d59f28e8-6a29-4fe0-acf9-da907f47c836 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:17:57.579650 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1855681 Nov 24 04:17:57.582542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36316) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:57.588696 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: d59f28e8-6a29-4fe0-acf9-da907f47c836 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:17:57.589048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d59f28e8-6a29-4fe0-acf9-da907f47c836 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:17:57.589287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-218229346', 'admin_state_up': True, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:57.589472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 2bc693d7-de18-4334-babc-0cdd54f76d8d no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:17:57.610511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 2bc693d7-de18-4334-babc-0cdd54f76d8d {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:17:57.611160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 2bc693d7-de18-4334-babc-0cdd54f76d8d not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:17:57.622311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.626274 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.634605 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557810d6-f15c-4f09-a66d-a73b485fc5ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:57.658859 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:17:57.680027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:57.820829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.015979 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.034877 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.137411 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.211 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:17:58.241533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.274061 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.308431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:17:58.311259 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:58.316671 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:17:58.323444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adaf259a-8d51-4e74-ab78-5e29e9d5db70 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:58.343389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:58.382579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-17f8c4f5-f00e-419f-bb7e-ce441f7b6e3d None None] Provisioning complete for port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:58.383471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-17f8c4f5-f00e-419f-bb7e-ce441f7b6e3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.416531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-17f8c4f5-f00e-419f-bb7e-ce441f7b6e3d None None] Port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:17:58.563276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.678669 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:17:58.702076 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:17:58.702472 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 7f0e92d3-157f-4257-ab9c-e07744f0f7c4 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:17:58.759128 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:58.890559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 5cdfb00c-d228-4acd-9888-c065a2445ea9 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:17:58.995880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:17:59.006861 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Sync routers for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:17:59.016579 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.016903 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:59.017548 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:59.017830 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2971318b-14e6-4ac7-aad5-aa5f4d549f62 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.4328887 Nov 24 04:17:59.021314 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36318) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:59.118687 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:59.148448 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d264c6b2-861e-4b8b-8282-a7f2e5295a2c tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1252174 Nov 24 04:17:59.150877 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36322) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:59.239696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1bd7622-baf7-46c8-adce-b9686974174a tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:59.241217 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b1bd7622-baf7-46c8-adce-b9686974174a tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0894167 Nov 24 04:17:59.244027 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36324) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:59.271592 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9352b7cc-9aa9-4994-8173-8fabfb406911 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0265048 Nov 24 04:17:59.273869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36326) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:59.278624 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-114526259', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:17:59.292703 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:17:58Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:17:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:59.322162 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Checking router: 5cdfb00c-d228-4acd-9888-c065a2445ea9 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:17:59.322526 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Updating router 5cdfb00c-d228-4acd-9888-c065a2445ea9 port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:17:59.346304 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.368245 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:17:59.372330 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.451387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a2998e69-c857-42ba-997c-e6b38755303c no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:17:59.472645 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: a2998e69-c857-42ba-997c-e6b38755303c {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:17:59.472988 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a2998e69-c857-42ba-997c-e6b38755303c not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:17:59.553702 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.593654 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.600798 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.615601 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=03997b69-bd98-402b-ba2d-a1ab5c21d048,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:59.625425 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:59.625791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:17:59.642828 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e90eb4b9-a53c-46b4-9fb7-ec2b40170501 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:59.644431 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:17:59.655850 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b35851e-2ffd-49e2-8078-8ec0e21c164e None None] Pushing event updated for resources: {'Port': ['ID=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,revision_number=2']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:59.655983 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:17:59.658593 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Attempting to bind port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:17:59.658993 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Attempting to bind port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:17:59.659476 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Attempting to bind port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:17:59.662077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:17:59.662870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.665492 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 17, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:17:59.666593 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:17:59.667006 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.672128 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:17:59.672128 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Bound port: c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:17:59.672128 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.672546 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25eefe6e-35fe-4246-a51c-49b370952b3d None None] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:17:59.684026 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a5ff8010-43f8-4f7c-bd4d-9cbbc838b2f2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.4089336 Nov 24 04:17:59.687115 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36328) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:17:59.747454 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] For port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:17:59.752441 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] For port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:17:59.757815 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:17:59.799801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbfca515-26b6-4bd0-be8a-6a00c3c4d717 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:17:59.818768 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:17:59.819421 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:17:59.870704 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b35851e-2ffd-49e2-8078-8ec0e21c164e None None] Pushing event updated for resources: {'Port': ['ID=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:17:59.949071 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:17:59.950561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d5f91846-eefa-44d6-83b6-bbed90c5a8fb None None] Provisioning complete for port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:17:59.951034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d5f91846-eefa-44d6-83b6-bbed90c5a8fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.075371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:18:00.079575 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.104956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d5f91846-eefa-44d6-83b6-bbed90c5a8fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.145121 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-626582f1-f954-4909-aa44-d1563c164796 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:17:58Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:17:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:00.152261 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.176180 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-626582f1-f954-4909-aa44-d1563c164796 None None] The sync data for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv is: [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:17:58Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:17:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:00.179140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d5f91846-eefa-44d6-83b6-bbed90c5a8fb None None] For port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:00.186446 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d5f91846-eefa-44d6-83b6-bbed90c5a8fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.276948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f91846-eefa-44d6-83b6-bbed90c5a8fb None None] Pushing event updated for resources: {'Port': ['ID=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:00.291795 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Allocated IP 172.20.0.2 (57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6/03997b69-bd98-402b-ba2d-a1ab5c21d048/84f09a58-1101-41cf-815f-6d08e1eebe74) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:00.331360 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-4736ed0c-5b49-4924-b69f-f5ea6076ef0a None None] Provisioning complete for port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:00.331725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4736ed0c-5b49-4924-b69f-f5ea6076ef0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.554450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.562244 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.611051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:00.618091 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:00.624955 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:00.627379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.1 (57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6/03997b69-bd98-402b-ba2d-a1ab5c21d048/a4effa5f-93d7-41f5-aace-509354e3fc8e) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:00.671861 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Pushing event updated for resources: {'Port': ['ID=84f09a58-1101-41cf-815f-6d08e1eebe74,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:00.710118 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Attempting to bind port 84f09a58-1101-41cf-815f-6d08e1eebe74 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:00.710522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Attempting to bind port 84f09a58-1101-41cf-815f-6d08e1eebe74 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:00.710948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Attempting to bind port 84f09a58-1101-41cf-815f-6d08e1eebe74 on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:00.716883 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 17, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:00.717256 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Checking segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:00.717651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.718037 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Bound using segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:00.719009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Bound port: 84f09a58-1101-41cf-815f-6d08e1eebe74, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:00.719396 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.780044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.795170 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] For port 84f09a58-1101-41cf-815f-6d08e1eebe74, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:00.799343 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] For port 84f09a58-1101-41cf-815f-6d08e1eebe74, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84f09a58-1101-41cf-815f-6d08e1eebe74,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:00.804409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.821311 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:00.869029 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:00.872738 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:00.877776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:00.882271 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=a4effa5f-93d7-41f5-aace-509354e3fc8e,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:00.891371 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f7aeae-c59f-4c6e-a657-16f36f7a2dad None None] Pushing event updated for resources: {'Port': ['ID=84f09a58-1101-41cf-815f-6d08e1eebe74,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:00.964688 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.111577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.437777 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.443301 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.489363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.553863 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=a4effa5f-93d7-41f5-aace-509354e3fc8e,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:01.577430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:01.620827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:01.625166 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:01.638287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:01.638745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.717058 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84f09a58-1101-41cf-815f-6d08e1eebe74 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:01.752515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 5cdfb00c-d228-4acd-9888-c065a2445ea9 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:18:01.768744 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 84f09a58-1101-41cf-815f-6d08e1eebe74 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:01.769444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.858178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.876238 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:01.881620 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6e388bd8-de0b-478e-83ff-8821cd94aa16 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/5cdfb00c-d228-4acd-9888-c065a2445ea9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1934221 Nov 24 04:18:01.884200 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36332) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:01.900401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 84f09a58-1101-41cf-815f-6d08e1eebe74, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84f09a58-1101-41cf-815f-6d08e1eebe74,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:01.909522 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:01.959206 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=84f09a58-1101-41cf-815f-6d08e1eebe74,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:01.982670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:01.983074 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:01.983538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:01.983996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:01.984452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:01.984910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:01.986697 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-221b1a36-d817-462e-b8d6-3d566db1ff3e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.1015086 Nov 24 04:18:01.989341 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36334) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:02.049898 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.050398 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.050852 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.051298 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.051744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.052182 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.053961 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ae73186d-5c7a-4870-b40c-bdfb0e684da3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4004 time: 0.0637167 Nov 24 04:18:02.056785 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36336) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:02.201279 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a22cb0de-0ad3-46b2-b313-9d03dcb89fc3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.1433730 Nov 24 04:18:02.204294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36338) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:02.209610 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'name': 'tempest-TestNetworkBasicOps-1256877068', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:02.331896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:18:02.335816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:02.346430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Sync routers for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:02.356192 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6e1c902-a10e-4d49-ad8a-1ed3af3d7ed7 None None] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:18:02.362291 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] device_id is not set on port da9b6365-da25-4ffa-a9aa-f4010d95a86b yet. {{(pid=103380) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:18:02.399084 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:02.399834 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:02.483668 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.5 (57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6/03997b69-bd98-402b-ba2d-a1ab5c21d048/da9b6365-da25-4ffa-a9aa-f4010d95a86b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:02.491094 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-77011567-8f06-4e85-9622-bdcc2288cb15 None None] Provisioning complete for port 84f09a58-1101-41cf-815f-6d08e1eebe74 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:02.491786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-77011567-8f06-4e85-9622-bdcc2288cb15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:02.652197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:02.660838 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:02.704640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:02.751363 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:02.754989 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:02.758833 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:02.765667 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:02.817144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:02.817931 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:02.836728 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4d2a9a9c-11f8-41c4-aed9-50d2defbe8d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 0.6312389 Nov 24 04:18:02.944739 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:02.973488 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Checking router: 5cdfb00c-d228-4acd-9888-c065a2445ea9 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:02.973853 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Updating router 5cdfb00c-d228-4acd-9888-c065a2445ea9 port a4effa5f-93d7-41f5-aace-509354e3fc8e binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:18:03.004009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.129260 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36342) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:03.134955 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1225258722', 'description': 'tempest-secgroup-smoke-1225258722 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:03.163869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.241514 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.247379 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.279387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.284968 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.285144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-38915680-f9a7-4217-961c-07b061022977 None None] Provisioning complete for port a4effa5f-93d7-41f5-aace-509354e3fc8e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:03.285434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38915680-f9a7-4217-961c-07b061022977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.286639 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d6fe21bf-c9b6-46ad-ac4b-e3d5a413fdfd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1559000 Nov 24 04:18:03.290113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36344) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:03.300365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:03.331790 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.366888 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-38915680-f9a7-4217-961c-07b061022977 None None] Port a4effa5f-93d7-41f5-aace-509354e3fc8e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:03.391391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-38915680-f9a7-4217-961c-07b061022977 None None] Provisioning complete for port 84f09a58-1101-41cf-815f-6d08e1eebe74 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:03.391766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-38915680-f9a7-4217-961c-07b061022977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.397660 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.403955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.423677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8fe0e28-0acb-4720-97ea-7242267c2f6b,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.438125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.443058 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-2aadbc50-2a6b-4dbc-a6a9-afa086c71df8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1483352 Nov 24 04:18:03.443570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36346) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:03.449055 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:03.492390 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.535807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84f09a58-1101-41cf-815f-6d08e1eebe74 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:03.542120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.565121 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.576967 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.581854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.603538 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eed6f11e-a345-48a4-92d9-9ad6480535bd,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.617254 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.618682 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5f9d2050-a1e1-4d91-b343-4fdd5dd0696e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1737015 Nov 24 04:18:03.621689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36348) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:03.626677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:03.629111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9a1a79-9670-49b1-bbd4-6512ceb46b31 None None] Pushing event updated for resources: {'Port': ['ID=a4effa5f-93d7-41f5-aace-509354e3fc8e,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.660452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.708884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 84f09a58-1101-41cf-815f-6d08e1eebe74 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:03.709601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.731296 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.737512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Attempting to bind port a4effa5f-93d7-41f5-aace-509354e3fc8e on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:03.737686 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.737919 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Attempting to bind port a4effa5f-93d7-41f5-aace-509354e3fc8e by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:03.738291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Attempting to bind port a4effa5f-93d7-41f5-aace-509354e3fc8e on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:03.748175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-d6d1254b-2901-44a4-8731-5a43845fc1fe None None] Provisioning complete for port a4effa5f-93d7-41f5-aace-509354e3fc8e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:03.748549 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d6d1254b-2901-44a4-8731-5a43845fc1fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.756870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 17, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:03.757250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Checking segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:03.757656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.758056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Bound using segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:03.758775 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Bound port: a4effa5f-93d7-41f5-aace-509354e3fc8e, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:03.759018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=77e0af8f-cdb2-426c-b06d-a7261ebb2e47,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.759714 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.774600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.779227 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-21f55772-b5f4-4529-b812-a93ac3f0e76c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1531875 Nov 24 04:18:03.779728 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36350) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:03.785744 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:03.816880 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.830618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-d6d1254b-2901-44a4-8731-5a43845fc1fe None None] Port a4effa5f-93d7-41f5-aace-509354e3fc8e cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:03.887530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.892575 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.895542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] For port a4effa5f-93d7-41f5-aace-509354e3fc8e, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:03.900152 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] For port a4effa5f-93d7-41f5-aace-509354e3fc8e, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a4effa5f-93d7-41f5-aace-509354e3fc8e,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:03.909893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.920033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55a03f8b-7b39-4531-a7af-b5118a7a25e6,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.927887 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.929476 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ae5056bd-76de-4a70-af0e-15a901dc99c0 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1477995 Nov 24 04:18:03.932147 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36352) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:03.937190 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:03.963951 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:18:03.969439 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:03.993377 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9a1a79-9670-49b1-bbd4-6512ceb46b31 None None] Pushing event updated for resources: {'Port': ['ID=a4effa5f-93d7-41f5-aace-509354e3fc8e,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:03.995870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-6a25f12b-f46c-4a75-92bf-f7109992de67 None None] Provisioning complete for port da9b6365-da25-4ffa-a9aa-f4010d95a86b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:03.996303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6a25f12b-f46c-4a75-92bf-f7109992de67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.020003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:04.020682 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:17:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:04.040182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.046070 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.067700 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=53444806-4e1a-49a4-8b51-796fbdf209b9,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:04.078891 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.081196 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c83110ce-09e1-49f1-a8b9-5ce99f4dda78 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1480243 Nov 24 04:18:04.084168 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36354) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:04.089284 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-6a25f12b-f46c-4a75-92bf-f7109992de67 None None] Port da9b6365-da25-4ffa-a9aa-f4010d95a86b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:04.090461 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:04.122197 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:18:04.128008 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.159387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:04.196000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.200038 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.215292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=420cc373-91f9-496f-baf2-2b0fa5c6cd1b,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:04.225671 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.226909 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-78d3f929-f47f-49a3-9aa6-77eb4ebed740 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1416957 Nov 24 04:18:04.254802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-851e0248-be5b-4b93-988d-ef6e77bd430d None None] Provisioning complete for port a4effa5f-93d7-41f5-aace-509354e3fc8e triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:04.255175 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-851e0248-be5b-4b93-988d-ef6e77bd430d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.379778 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-2bfd7de2-11f4-4c68-95bb-770a12fbdbdd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1225258722&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.0472541 Nov 24 04:18:04.417504 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-851e0248-be5b-4b93-988d-ef6e77bd430d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.432085 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-4d2d8631-ac6b-4911-a2d9-200aeacab03a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:04.433787 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-4d2d8631-ac6b-4911-a2d9-200aeacab03a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 930 time: 0.0466402 Nov 24 04:18:04.463374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-851e0248-be5b-4b93-988d-ef6e77bd430d None None] For port a4effa5f-93d7-41f5-aace-509354e3fc8e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a4effa5f-93d7-41f5-aace-509354e3fc8e,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:04.469081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-851e0248-be5b-4b93-988d-ef6e77bd430d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:04.477289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:03Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:04.478977 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-0caa24bd-cb60-4cb4-a178-5671a45d643f service neutron] 10.222.0.48 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0332406 Nov 24 04:18:04.521438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8de70b79-f0f1-4074-95b5-0354ed71f42e None None] The sync data for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv is: [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:03Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:04.549113 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851e0248-be5b-4b93-988d-ef6e77bd430d None None] Pushing event updated for resources: {'Port': ['ID=a4effa5f-93d7-41f5-aace-509354e3fc8e,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:04.579368 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-6779e054-48a6-43ec-b129-83206a1783ee service neutron] 10.222.0.48 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0940671 Nov 24 04:18:04.683054 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-96572723-2b1b-44b0-b06c-e9130b414c87 service neutron] 10.222.0.48 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0975537 Nov 24 04:18:04.866250 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f91bbdc8-b949-45ef-9c67-bc4819a86865 req-165f7c4b-9d5d-4852-9f6b-fc401f7a0c39 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 210 time: 0.0300934 Nov 24 04:18:04.960363 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4ccfa627-d149-4fb4-bb82-beca1ee52966 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:05.516936 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a4effa5f-93d7-41f5-aace-509354e3fc8e up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:05.571046 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port a4effa5f-93d7-41f5-aace-509354e3fc8e triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:05.571440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:05.795668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-05814cfe-d316-41fe-bcfe-b4e9fee6a367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:05.797094 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-05814cfe-d316-41fe-bcfe-b4e9fee6a367 service neutron] 10.222.0.21 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1026 time: 0.0363400 Nov 24 04:18:05.912138 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-718cb67c-0ff4-411d-bec0-a791a1335da6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:05.913779 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-718cb67c-0ff4-411d-bec0-a791a1335da6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 797 time: 0.1099291 Nov 24 04:18:05.976479 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f114b697-924c-4556-a621-603c4c6f233a req-29c6c671-9ee1-4e40-a796-31542d58f0c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 210 time: 0.0317926 Nov 24 04:18:05.988868 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-6e6e39f4-7936-4184-8a82-18fdd429318f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 380 time: 0.0625477 Nov 24 04:18:06.007176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Request body: {'port': {'device_id': '6804d702-7556-4e04-bacd-7eff0fe37922', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:06.066416 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:06.322184 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da9b6365-da25-4ffa-a9aa-f4010d95a86b {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:18:06.329582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:06.342359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Transition to ACTIVE for port object da9b6365-da25-4ffa-a9aa-f4010d95a86b will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:18:06.346438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:06.398726 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:06.471690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:06.472020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:06.472345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:06.476945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:18:06.477262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:06.483734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 17, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:06.484070 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Checking segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:06.484457 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Bound using segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:06.485036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Bound port: da9b6365-da25-4ffa-a9aa-f4010d95a86b, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:06.485395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:06.554338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:06.557627 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:06.562279 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:06.603529 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:06.604155 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:06.606666 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] 10.222.0.21 "PUT /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1131 time: 0.6033802 Nov 24 04:18:06.607110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6804d702-7556-4e04-bacd-7eff0fe37922', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:06.609474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9178f115-f6dd-49b3-896a-4c51c4c698b3" -d '{"events": [{"name": "network-changed", "server_uuid": "6804d702-7556-4e04-bacd-7eff0fe37922", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:06.632280 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8640da3b-d431-4aab-8a9f-d1f2df97c352 service neutron] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:06.658699 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19a78e67-f259-46b2-b48c-ebab94359e3e x-openstack-request-id: req-19a78e67-f259-46b2-b48c-ebab94359e3e {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:06.658993 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6804d702-7556-4e04-bacd-7eff0fe37922", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:06.659254 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-19a78e67-f259-46b2-b48c-ebab94359e3e {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:06.659657 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6804d702-7556-4e04-bacd-7eff0fe37922', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'status': 'completed', 'code': 200} Nov 24 04:18:06.694598 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-0cf0b55c-89d7-4ceb-a1bc-4987d86c78b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:06.696786 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-0cf0b55c-89d7-4ceb-a1bc-4987d86c78b7 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 1134 time: 0.0482423 Nov 24 04:18:06.741777 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-ca4f47b3-531d-4bfe-85e5-d618d2b0e48b service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 217 time: 0.0347495 Nov 24 04:18:06.798682 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-e374e743-a42a-4d93-bc0f-07478dcf2969 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:06.800150 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-e374e743-a42a-4d93-bc0f-07478dcf2969 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=03997b69-bd98-402b-ba2d-a1ab5c21d048 HTTP/1.1" status: 200 len: 834 time: 0.0504432 Nov 24 04:18:06.850622 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-38d0f50a-98bf-4e07-95e4-195cd70f8a56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:06.852167 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-38d0f50a-98bf-4e07-95e4-195cd70f8a56 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0413055 Nov 24 04:18:06.941235 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-980f0a5b-50c9-4734-b13d-66627a6c87e7 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812123 Nov 24 04:18:07.045369 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-584dadbb-23d3-4a35-a10e-735e71700a50 req-76532824-afb6-4409-a77a-f01fd0d916c8 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879087 Nov 24 04:18:07.098510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae73647-9c46-4b13-b8d7-45ec41f076b3 req-c757fe18-5a59-45bf-ab6f-9925a3802727 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:07.100127 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-dae73647-9c46-4b13-b8d7-45ec41f076b3 req-c757fe18-5a59-45bf-ab6f-9925a3802727 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 981 time: 0.0512164 Nov 24 04:18:07.142337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-e1734ef6-63e8-4592-9c9b-43f956d80fba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:07.145435 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-e1734ef6-63e8-4592-9c9b-43f956d80fba service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 1134 time: 0.0515373 Nov 24 04:18:07.150607 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-dae73647-9c46-4b13-b8d7-45ec41f076b3 req-09b5767d-6c15-4399-99b6-00e2eee208c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437589 Nov 24 04:18:07.251058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-da9cfb1b-4324-413f-b14d-9ee1350d9bb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:07.252747 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-da9cfb1b-4324-413f-b14d-9ee1350d9bb3 service neutron] 10.222.0.21 "GET /v2.0/networks?id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 898 time: 0.0992525 Nov 24 04:18:07.300382 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-6416f557-4e09-4338-aeaf-1be335740e2e service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 217 time: 0.0393972 Nov 24 04:18:07.359204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-13274e05-d59d-4068-b4ef-2ea9add64c6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:07.360885 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-13274e05-d59d-4068-b4ef-2ea9add64c6f service neutron] 10.222.0.21 "GET /v2.0/subnets?id=03997b69-bd98-402b-ba2d-a1ab5c21d048 HTTP/1.1" status: 200 len: 834 time: 0.0530415 Nov 24 04:18:07.773222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-f942b13c-27fe-4ae7-b0d5-88f3691a53a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:07.774739 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-f942b13c-27fe-4ae7-b0d5-88f3691a53a1 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4058342 Nov 24 04:18:07.867087 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-4088e584-1c88-490b-b1ab-7ad66ec23b4e service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821326 Nov 24 04:18:07.958989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b8e89e7c-a64e-40e7-99a1-54fe8262d497 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:07.974401 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9178f115-f6dd-49b3-896a-4c51c4c698b3 req-a049ee6d-3096-41f6-beb2-f60821eebfd6 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0981984 Nov 24 04:18:08.268377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521434f3-ddde-41ae-8db5-453f8922b173 req-fe5858a5-0cfc-47aa-89f8-578f7b1d1c07 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:08.269907 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-521434f3-ddde-41ae-8db5-453f8922b173 req-fe5858a5-0cfc-47aa-89f8-578f7b1d1c07 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 981 time: 0.0508199 Nov 24 04:18:08.320016 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-521434f3-ddde-41ae-8db5-453f8922b173 req-5957e007-7562-4329-a344-fee1f5b8238c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430474 Nov 24 04:18:08.739002 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:18:08.771449 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:08.845928 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:08.856984 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'port_id': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'mac_address': 'fa:16:3e:a8:a7:e2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:18:08.893656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:08.909651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da9b6365-da25-4ffa-a9aa-f4010d95a86b {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:18:08.929815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:08.933932 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:08.977963 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:09.147111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['da9b6365-da25-4ffa-a9aa-f4010d95a86b'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:18:09.434141 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b27c037-9406-46d4-9505-b72a5914e981 req-6eba9e0c-56a0-492f-a97b-b51f2cbbdb3e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:09.435575 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4b27c037-9406-46d4-9505-b72a5914e981 req-6eba9e0c-56a0-492f-a97b-b51f2cbbdb3e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 982 time: 0.0494633 Nov 24 04:18:09.482352 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-4b27c037-9406-46d4-9505-b72a5914e981 req-9217396a-3747-4270-ada7-48de6b245af5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409148 Nov 24 04:18:10.087594 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:10.597242 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c0cf90-1a1d-4603-9ad2-8abf037afcfd req-7df0108c-0009-4980-99cd-347fe9b5f1f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:10.598741 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-99c0cf90-1a1d-4603-9ad2-8abf037afcfd req-7df0108c-0009-4980-99cd-347fe9b5f1f6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 982 time: 0.0519276 Nov 24 04:18:10.646273 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-99c0cf90-1a1d-4603-9ad2-8abf037afcfd req-fe30206b-dab3-4a6a-a1b1-8493e7f3f010 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416639 Nov 24 04:18:10.749940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:10.799722 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port da9b6365-da25-4ffa-a9aa-f4010d95a86b completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:18:10.803835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port da9b6365-da25-4ffa-a9aa-f4010d95a86b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:10.804205 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:10.889800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:10.891493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:10.916386 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6804d702-7556-4e04-bacd-7eff0fe37922', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:10.919306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b50316c3-a001-4492-8e0c-d00a0ed025cf" -d '{"events": [{"server_uuid": "6804d702-7556-4e04-bacd-7eff0fe37922", "name": "network-vif-plugged", "status": "completed", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:10.932618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:10.937365 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:10.960131 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b373200-26be-4b9c-beef-b0d33bd58500 x-openstack-request-id: req-2b373200-26be-4b9c-beef-b0d33bd58500 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:10.960431 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6804d702-7556-4e04-bacd-7eff0fe37922", "name": "network-vif-plugged", "status": "completed", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:10.960692 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-2b373200-26be-4b9c-beef-b0d33bd58500 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:10.961087 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6804d702-7556-4e04-bacd-7eff0fe37922', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'code': 200} Nov 24 04:18:10.987871 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:11.162111 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a227745-a432-46ad-bb03-a44bb142609c req-ad46b4e3-0e8c-4666-97ad-0f3306f2ea65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:11.163857 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6a227745-a432-46ad-bb03-a44bb142609c req-ad46b4e3-0e8c-4666-97ad-0f3306f2ea65 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 1136 time: 0.0431747 Nov 24 04:18:11.212477 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6a227745-a432-46ad-bb03-a44bb142609c req-379c1973-d098-4a79-9ce6-af79e6be03f6 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417671 Nov 24 04:18:11.771343 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19569a5a-c6b9-4013-b1c7-0ce99830fdc8 req-57dc5add-c41d-4bfb-8280-e300d9809735 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:11.772813 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19569a5a-c6b9-4013-b1c7-0ce99830fdc8 req-57dc5add-c41d-4bfb-8280-e300d9809735 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 983 time: 0.0523801 Nov 24 04:18:11.824729 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-19569a5a-c6b9-4013-b1c7-0ce99830fdc8 req-2ff2c9ac-168c-4bd3-8847-dee9e0086f7b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446088 Nov 24 04:18:12.185668 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:12.957855 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100cd763-fa00-4281-bd29-1e8a1e099d04 req-bfb7aabe-a20f-4767-9a03-3bd25d62a922 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:12.959410 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-100cd763-fa00-4281-bd29-1e8a1e099d04 req-bfb7aabe-a20f-4767-9a03-3bd25d62a922 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 983 time: 0.0580049 Nov 24 04:18:13.010614 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-100cd763-fa00-4281-bd29-1e8a1e099d04 req-49518b09-08bc-4943-a33a-85508fe7b067 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435631 Nov 24 04:18:13.128586 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a0da47-3410-4758-8094-28720b987d64 req-83d2342d-cfae-4c5b-85a2-1a2bfc49f5c2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:13.130010 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-27a0da47-3410-4758-8094-28720b987d64 req-83d2342d-cfae-4c5b-85a2-1a2bfc49f5c2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 983 time: 0.0489407 Nov 24 04:18:13.184016 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-27a0da47-3410-4758-8094-28720b987d64 req-f4a61def-d494-4b54-92aa-018d550b50f8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473077 Nov 24 04:18:13.206014 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36404) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:13.244802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6c7bf59-1256-4880-8280-6a9fccf427e2 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:13.246829 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c6c7bf59-1256-4880-8280-6a9fccf427e2 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 1131 time: 0.0392885 Nov 24 04:18:13.249840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36406) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:13.254963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:13.279577 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:13.384284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:13.493297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.10 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/32708ba5-3977-440e-8196-a3adb96f8554) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:13.600485 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:13.637767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:13.679604 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:13.685789 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:13.689290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:13.717553 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=32708ba5-3977-440e-8196-a3adb96f8554,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:14.049709 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:14.117496 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:14.264548 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:14.268920 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:14.338353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=32708ba5-3977-440e-8196-a3adb96f8554,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:14.349844 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:14.448687 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP d5d88d3e-582c-4d68-9ba9-bf26efb7f42b associated. External IP: 172.26.5.10, port: da9b6365-da25-4ffa-a9aa-f4010d95a86b. Nov 24 04:18:14.650742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 5cdfb00c-d228-4acd-9888-c065a2445ea9 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:18:14.755717 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:14.765344 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] Sync routers for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:14.773591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:14.774596 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:14.775209 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:14.802819 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-857281dc-8240-488f-a46b-0ff72163c508 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 1033 time: 1.5518563 Nov 24 04:18:14.803781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6804d702-7556-4e04-bacd-7eff0fe37922', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:14.805893 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36408) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:14.806417 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b40d8341-fd37-4d90-8887-9c4c9e5c964d" -d '{"events": [{"name": "network-changed", "server_uuid": "6804d702-7556-4e04-bacd-7eff0fe37922", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:14.841601 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00d38d51-7564-4295-a962-b10866011f9e x-openstack-request-id: req-00d38d51-7564-4295-a962-b10866011f9e {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:14.841907 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6804d702-7556-4e04-bacd-7eff0fe37922", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:14.842194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-00d38d51-7564-4295-a962-b10866011f9e {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:14.842613 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6804d702-7556-4e04-bacd-7eff0fe37922', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'status': 'completed', 'code': 200} Nov 24 04:18:14.877396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05578288-08ce-4506-876b-8d2b0b75ed4e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:14.878994 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-05578288-08ce-4506-876b-8d2b0b75ed4e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922&network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 1131 time: 0.0720627 Nov 24 04:18:14.889302 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:14.909857 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-f3271224-1894-4e7f-bd33-591e8b97c3fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:14.911520 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-f3271224-1894-4e7f-bd33-591e8b97c3fe service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 1136 time: 0.0441566 Nov 24 04:18:15.013143 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-cbb54795-2f10-44bc-bf8f-ddad565bac9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:15.020466 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-cbb54795-2f10-44bc-bf8f-ddad565bac9a service neutron] 10.222.0.21 "GET /v2.0/networks?id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 898 time: 0.1016216 Nov 24 04:18:15.091483 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-aa10cad2-f15b-4adf-84a5-6ff38bb3ed2a service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1036 time: 0.0612731 Nov 24 04:18:15.130763 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66fdf5b-0cfd-40dd-8b49-995ad616fe61 req-9b79f39e-2be2-42f5-b69f-a429a4682e30 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:15.132253 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e66fdf5b-0cfd-40dd-8b49-995ad616fe61 req-9b79f39e-2be2-42f5-b69f-a429a4682e30 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 983 time: 0.0592623 Nov 24 04:18:15.133909 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'd5d88d3e-582c-4d68-9ba9-bf26efb7f42b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.10', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'port_id': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1420, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1256877068', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'mac_address': 'fa:16:3e:a8:a7:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6804d702-7556-4e04-bacd-7eff0fe37922', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:13Z', 'updated_at': '2021-11-24T04:18:13Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:04Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:15.150396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-1e7b833b-1551-49d5-87e2-acdd5f9e0619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:15.151975 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-1e7b833b-1551-49d5-87e2-acdd5f9e0619 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=03997b69-bd98-402b-ba2d-a1ab5c21d048 HTTP/1.1" status: 200 len: 834 time: 0.0501676 Nov 24 04:18:15.212414 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-6d061b9b-385c-4844-96f4-e082b0837abe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:15.213958 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-6d061b9b-385c-4844-96f4-e082b0837abe service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0507936 Nov 24 04:18:15.249499 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] Checking router: 5cdfb00c-d228-4acd-9888-c065a2445ea9 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:15.258337 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:15.259035 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:15.336975 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-c9016f59-4524-43c3-8968-52ccd289b2f1 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1073747 Nov 24 04:18:15.369218 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:15.455104 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b40d8341-fd37-4d90-8887-9c4c9e5c964d req-a0f921a5-4035-4565-aeb6-85809b256706 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1089561 Nov 24 04:18:15.524720 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e66fdf5b-0cfd-40dd-8b49-995ad616fe61 req-3558808a-0c86-4bb8-8a2f-2f2f00a80335 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3851655 Nov 24 04:18:15.605345 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'd5d88d3e-582c-4d68-9ba9-bf26efb7f42b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.10', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'port_id': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1420, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1256877068', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'mac_address': 'fa:16:3e:a8:a7:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6804d702-7556-4e04-bacd-7eff0fe37922', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:13Z', 'updated_at': '2021-11-24T04:18:13Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:04Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:15.641474 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-312a398e-d4ee-43a5-97e7-362d0580b83a None None] The sync data for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv is: [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'd5d88d3e-582c-4d68-9ba9-bf26efb7f42b', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.10', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'port_id': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1420, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1256877068', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'mac_address': 'fa:16:3e:a8:a7:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6804d702-7556-4e04-bacd-7eff0fe37922', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:13Z', 'updated_at': '2021-11-24T04:18:13Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:04Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:15.840027 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd5dc590-a37d-48de-8931-b93dbfb041e9 None None] New status for floating IP d5d88d3e-582c-4d68-9ba9-bf26efb7f42b: ACTIVE {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:18:16.582193 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-68b60333-d643-45fe-b33a-600be2124a4f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:16.583668 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-68b60333-d643-45fe-b33a-600be2124a4f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 983 time: 0.0486009 Nov 24 04:18:16.653805 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-29396150-15b5-4b49-a7c9-b183df9d54aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:16.655176 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-29396150-15b5-4b49-a7c9-b183df9d54aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0641129 Nov 24 04:18:16.692842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d5fafc-57ef-4216-bece-148ce527a402 req-ca8eb952-2af0-475d-be96-437ef2debc40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:16.694271 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-11d5fafc-57ef-4216-bece-148ce527a402 req-ca8eb952-2af0-475d-be96-437ef2debc40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 983 time: 0.0941823 Nov 24 04:18:16.782917 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-11d5fafc-57ef-4216-bece-148ce527a402 req-5e80fe02-9dd6-4919-8c71-4cd6ba1e0d0a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817904 Nov 24 04:18:16.799715 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-2b59a46e-ed6f-4a31-a01b-089a4fb0a0aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1362760 Nov 24 04:18:16.811524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:16.867354 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:16.999150 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:17.031609 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:17.063802 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] device_id is not set on port da9b6365-da25-4ffa-a9aa-f4010d95a86b yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:18:17.072397 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:17.078910 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:17.181345 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=6']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:17.249697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] No DVR routers for this DVR port da9b6365-da25-4ffa-a9aa-f4010d95a86b on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:18:17.341922 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-9a799cbc-7573-477b-87e0-d76bcdfd2d78 None None] Provisioning complete for port da9b6365-da25-4ffa-a9aa-f4010d95a86b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:17.342512 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9a799cbc-7573-477b-87e0-d76bcdfd2d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:17.376067 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-9a799cbc-7573-477b-87e0-d76bcdfd2d78 None None] Port da9b6365-da25-4ffa-a9aa-f4010d95a86b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:17.386612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] In _notify_port_updated(), no bound segment for port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:18:17.387480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:17.388079 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:17.389359 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a3c98412-4c76-4bce-a333-50a7fabc84fa req-628e19bc-328b-439e-b915-6b03d2f8e564 service neutron] 10.222.0.21 "PUT /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1026 time: 0.5822582 Nov 24 04:18:17.889661 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-03ea7ec5-2b41-408f-b959-a371b7ec89a0 req-b41da09c-74a5-4525-9dd3-10b0fbbe721e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=6804d702-7556-4e04-bacd-7eff0fe37922 HTTP/1.1" status: 200 len: 210 time: 0.0267742 Nov 24 04:18:18.948044 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36424) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:18.989830 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c16440c-17c9-42d8-8255-322fff22a11f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:18.991289 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5c16440c-17c9-42d8-8255-322fff22a11f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 925 time: 0.0422301 Nov 24 04:18:19.427639 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36428) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:19.432420 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-604846649', 'description': 'tempest-secgroup-smoke-604846649 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:19.455513 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.520134 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.523709 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.552539 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.553748 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1251011 Nov 24 04:18:19.555590 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb12ff1-5f73-486f-b645-82fb3b2f3fac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7449f0b2-37fc-4502-a1a3-187c330127ca,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:19.556687 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36430) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:19.562057 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7449f0b2-37fc-4502-a1a3-187c330127ca', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:19.587941 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.643624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.646841 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.664336 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6e27e48c-166d-4106-83ec-26b506e0a44a,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:19.672290 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.673456 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-32f69443-e583-4d08-ae68-dc3b1fafe8ab tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1151152 Nov 24 04:18:19.676198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36432) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:19.680611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7449f0b2-37fc-4502-a1a3-187c330127ca', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:19.732066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.786951 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.790173 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.807162 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cec41203-c30a-4f53-9e52-7fd7db5ecf5e,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:19.814377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.815579 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ddbd6a32-4ab1-416b-952e-a4302056d705 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1383989 Nov 24 04:18:19.818409 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36434) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:19.822880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7449f0b2-37fc-4502-a1a3-187c330127ca', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:19.848479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.903596 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.907227 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.926878 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a95b318a-3962-4da7-ad71-fba8d5b8a9c8,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:19.934846 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:19.936062 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fe20bf7e-5170-4af3-a7a3-a4b491faf575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1166914 Nov 24 04:18:19.938745 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36436) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:19.943149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7449f0b2-37fc-4502-a1a3-187c330127ca', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:19.968426 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.037303 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.041300 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.062766 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61955e6f-5bc6-4d14-98bf-a181296f4e29,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:20.068174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.069355 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8c4a0ad2-4832-4e03-b56c-75422c088420 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1296837 Nov 24 04:18:20.072066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36438) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:20.076880 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7449f0b2-37fc-4502-a1a3-187c330127ca', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:20.098652 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:18:20.103526 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.162916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.166444 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.181725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e7434ec-c4cf-42bc-84c7-0f713b7ebc9f,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:20.192524 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.193787 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-7e3b963a-92bf-4524-b767-4beee5a42606 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1207545 Nov 24 04:18:20.196549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36440) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:20.200796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '7449f0b2-37fc-4502-a1a3-187c330127ca', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:20.221668 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:18:20.226454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.285600 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.289056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.305966 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0d0488a-c1d9-4a4b-bd16-4a2244ab8048,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:20.313927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:20.315219 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9cd2ccf7-530c-4d5a-a4b3-be464072b750 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1176763 Nov 24 04:18:20.462943 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-4559eda5-6e19-46bc-904b-3ff580f86a6a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-604846649&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.0459089 Nov 24 04:18:20.510947 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-f28cfac9-8875-4380-9b7e-7ebdb8ed8fc3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:20.512269 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-f28cfac9-8875-4380-9b7e-7ebdb8ed8fc3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 930 time: 0.0429265 Nov 24 04:18:20.556346 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-77cac86d-5f07-4c24-9689-027b974f1e9e service neutron] 10.222.0.48 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0323482 Nov 24 04:18:20.644367 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-39dfa22f-67d8-4219-bb81-713f9ec8b35b service neutron] 10.222.0.48 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824380 Nov 24 04:18:20.801515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:18:20.842306 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:18:21.065791 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-8cf05f93-db2e-4ddf-b227-e96150d71938 service neutron] 10.222.0.48 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4148772 Nov 24 04:18:21.233234 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6fd4e21e-3366-4f16-b926-fb616939fe9e req-5f3c30c0-6515-49e4-8821-e59498091cf3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 210 time: 0.0323789 Nov 24 04:18:22.095958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-c2cf06c5-be22-40ed-8834-c8fa48eae84f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:22.097321 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-c2cf06c5-be22-40ed-8834-c8fa48eae84f service neutron] 10.222.0.21 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1026 time: 0.0329688 Nov 24 04:18:22.206763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-de77577d-a7d5-42cc-8231-bb2ba7f11e42 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:22.208188 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-de77577d-a7d5-42cc-8231-bb2ba7f11e42 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 797 time: 0.1052089 Nov 24 04:18:22.285333 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-d9517969-9790-456d-8262-e23e9638d075 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 472 time: 0.0682452 Nov 24 04:18:22.299430 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Request body: {'port': {'device_id': '603ed921-cd01-4662-bee9-60b118ee4c77', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:22.353790 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-03887a6c-e847-48b3-bc19-227c033971ba req-439404b1-1110-4369-88f9-ba3f4036213d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 210 time: 0.0300353 Nov 24 04:18:22.380813 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:22.387455 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:18:22.634499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da9b6365-da25-4ffa-a9aa-f4010d95a86b {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:18:22.642423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:22.654659 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Transition to ACTIVE for port object da9b6365-da25-4ffa-a9aa-f4010d95a86b will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:18:22.658874 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:22.733725 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=7']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:22.836029 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:22.836364 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:22.836721 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:22.841240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:18:22.841561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Attempting to bind port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:22.846646 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 18, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:22.847033 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Checking segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:22.847351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Bound using segment: {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:22.847767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Bound port: da9b6365-da25-4ffa-a9aa-f4010d95a86b, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '44d04a49-eacd-4810-b87f-c2849fcb7f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:22.848120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:22.911067 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:22.914031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:22.919406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:22.954869 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:22.955491 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:22.956886 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] 10.222.0.21 "PUT /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1131 time: 0.6624756 Nov 24 04:18:22.957340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '603ed921-cd01-4662-bee9-60b118ee4c77', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:22.960237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44ae26e2-0be0-4ad9-857a-49d08666c7f2" -d '{"events": [{"name": "network-changed", "server_uuid": "603ed921-cd01-4662-bee9-60b118ee4c77", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:22.988276 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc82d965-5985-4e44-af11-0f8d00db6853 service neutron] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=8']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:23.013144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca0c54b2-7771-427e-bd2e-66b241e0f7e5 x-openstack-request-id: req-ca0c54b2-7771-427e-bd2e-66b241e0f7e5 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:23.013144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "603ed921-cd01-4662-bee9-60b118ee4c77", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:23.013144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-ca0c54b2-7771-427e-bd2e-66b241e0f7e5 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:23.013502 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '603ed921-cd01-4662-bee9-60b118ee4c77', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'status': 'completed', 'code': 200} Nov 24 04:18:23.043389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-9e0f49de-1f32-467a-ae35-596c65fba89a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.045426 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-9e0f49de-1f32-467a-ae35-596c65fba89a service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 1134 time: 0.0445328 Nov 24 04:18:23.117615 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-c270aa19-a37d-468e-b256-aa2e2773ddbe service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1036 time: 0.0634065 Nov 24 04:18:23.166817 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bdd38941-d390-4558-84d1-e62059698619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.168758 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-bdd38941-d390-4558-84d1-e62059698619 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=03997b69-bd98-402b-ba2d-a1ab5c21d048 HTTP/1.1" status: 200 len: 834 time: 0.0446134 Nov 24 04:18:23.215309 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-55d48f3a-ac02-47b1-b133-de3dda9ef245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.216786 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-55d48f3a-ac02-47b1-b133-de3dda9ef245 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394738 Nov 24 04:18:23.329455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-751c4e9b-65ac-42aa-810d-a3fe45af8939 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1042666 Nov 24 04:18:23.421335 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1c969301-433c-4242-a9d9-a869ecf1d02b req-990246e6-67c4-4fd0-9f6d-6d4453893da4 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818613 Nov 24 04:18:23.475963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bffa57-c862-4637-992a-177e4370f668 req-4c9c420b-c9af-4dc3-afd8-dc1570fc4d38 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.477468 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-45bffa57-c862-4637-992a-177e4370f668 req-4c9c420b-c9af-4dc3-afd8-dc1570fc4d38 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 981 time: 0.0540509 Nov 24 04:18:23.548428 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-8242b6a2-9fbd-4b12-a013-5c57e53de672 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.549902 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-8242b6a2-9fbd-4b12-a013-5c57e53de672 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 1134 time: 0.0706129 Nov 24 04:18:23.553584 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-45bffa57-c862-4637-992a-177e4370f668 req-df594e0e-20c5-4c61-9fb4-abed2338320c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661476 Nov 24 04:18:23.646230 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-14d3c432-0b2f-40d1-86fc-09f23855bb26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.647810 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-14d3c432-0b2f-40d1-86fc-09f23855bb26 service neutron] 10.222.0.21 "GET /v2.0/networks?id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 898 time: 0.0891569 Nov 24 04:18:23.712293 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-cce23507-0996-4254-8d25-0cfb27b3a00c service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1036 time: 0.0560770 Nov 24 04:18:23.761465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-c1b7eaab-01d9-4fa9-a470-ddace6d88aad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.762867 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-c1b7eaab-01d9-4fa9-a470-ddace6d88aad service neutron] 10.222.0.21 "GET /v2.0/subnets?id=03997b69-bd98-402b-ba2d-a1ab5c21d048 HTTP/1.1" status: 200 len: 834 time: 0.0423274 Nov 24 04:18:23.812432 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-39444fef-e53a-47e1-909b-fe98b3c5afcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:23.813866 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-39444fef-e53a-47e1-909b-fe98b3c5afcb service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0426967 Nov 24 04:18:23.905243 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-211c303d-a189-4fb3-8c50-511e8dfbd6a7 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825000 Nov 24 04:18:24.005921 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-44ae26e2-0be0-4ad9-857a-49d08666c7f2 req-adceef61-f6ff-422a-b72e-f36c35fe7fa3 service neutron] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923569 Nov 24 04:18:24.666937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399f72d6-54a1-430a-a154-e925d2f0efd2 req-2a7a2b31-187a-45e7-b7d0-ec9ec84dd92f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:24.668892 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-399f72d6-54a1-430a-a154-e925d2f0efd2 req-2a7a2b31-187a-45e7-b7d0-ec9ec84dd92f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 981 time: 0.0487444 Nov 24 04:18:24.716565 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-399f72d6-54a1-430a-a154-e925d2f0efd2 req-0a1558ab-1946-4d8f-bb94-d3e5975519a1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393634 Nov 24 04:18:24.826108 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:18:24.916760 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:24.930897 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'port_id': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'mac_address': 'fa:16:3e:a8:a7:e2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:18:24.966686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:24.978728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da9b6365-da25-4ffa-a9aa-f4010d95a86b {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:18:24.999537 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:25.003578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:25.049684 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=9']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:25.248863 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['da9b6365-da25-4ffa-a9aa-f4010d95a86b'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:18:25.829708 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ccbddd-ca54-4be2-b2e8-8edb2c42c63c req-710cc5bb-7a00-41a2-a33e-082bb2a2bac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:25.831198 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-59ccbddd-ca54-4be2-b2e8-8edb2c42c63c req-710cc5bb-7a00-41a2-a33e-082bb2a2bac6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 982 time: 0.0486314 Nov 24 04:18:25.877266 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-59ccbddd-ca54-4be2-b2e8-8edb2c42c63c req-f1bf82e9-47f0-4069-95e1-2aeb0ab9c6ec tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398576 Nov 24 04:18:26.859139 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:26.907473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port da9b6365-da25-4ffa-a9aa-f4010d95a86b completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:18:26.911919 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port da9b6365-da25-4ffa-a9aa-f4010d95a86b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:26.912299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:26.991569 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53f9ad12-24ac-4409-beaf-f1f8740d0837 req-fa894c72-0fcb-46f8-ac46-b6842ffa714a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:26.992253 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:26.993067 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-53f9ad12-24ac-4409-beaf-f1f8740d0837 req-fa894c72-0fcb-46f8-ac46-b6842ffa714a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 982 time: 0.0490439 Nov 24 04:18:27.018023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '603ed921-cd01-4662-bee9-60b118ee4c77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:27.020332 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2feed9df-3266-4ea1-920b-e51054c5c44e" -d '{"events": [{"server_uuid": "603ed921-cd01-4662-bee9-60b118ee4c77", "name": "network-vif-plugged", "status": "completed", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:27.036918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:27.043379 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:27.054469 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-53f9ad12-24ac-4409-beaf-f1f8740d0837 req-3dda5966-4635-4c8c-b4d7-1e2f0a7c5769 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551574 Nov 24 04:18:27.079181 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3fc83e9-8c96-411f-84f7-720ffd8f2398 x-openstack-request-id: req-a3fc83e9-8c96-411f-84f7-720ffd8f2398 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:27.079484 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "603ed921-cd01-4662-bee9-60b118ee4c77", "name": "network-vif-plugged", "status": "completed", "tag": "da9b6365-da25-4ffa-a9aa-f4010d95a86b", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:27.079745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-a3fc83e9-8c96-411f-84f7-720ffd8f2398 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:27.080147 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '603ed921-cd01-4662-bee9-60b118ee4c77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da9b6365-da25-4ffa-a9aa-f4010d95a86b', 'code': 200} Nov 24 04:18:27.096430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=10']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:27.247433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a6b753-ce65-4490-93cd-0b7e86239b9c req-52788841-ae55-49b7-b0fb-0a9637cc0b13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:27.248782 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c9a6b753-ce65-4490-93cd-0b7e86239b9c req-52788841-ae55-49b7-b0fb-0a9637cc0b13 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 1137 time: 0.0393009 Nov 24 04:18:27.297574 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c9a6b753-ce65-4490-93cd-0b7e86239b9c req-93361b30-7148-4dff-994b-fa605a229709 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411627 Nov 24 04:18:28.170889 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd60dd8b-6297-40ae-a247-c65a1f534140 req-882ab4cf-9b11-4f0b-beb6-aa8ab35f627f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:28.172405 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fd60dd8b-6297-40ae-a247-c65a1f534140 req-882ab4cf-9b11-4f0b-beb6-aa8ab35f627f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 984 time: 0.0520751 Nov 24 04:18:28.222618 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fd60dd8b-6297-40ae-a247-c65a1f534140 req-97630c3b-aec3-4f6a-9ab3-6db3ee960470 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442810 Nov 24 04:18:29.335820 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5badd9a9-c694-49bc-a7b2-5a444bd6211d req-6c7b2ff4-30fd-47b8-971c-4606d816a02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:29.337270 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5badd9a9-c694-49bc-a7b2-5a444bd6211d req-6c7b2ff4-30fd-47b8-971c-4606d816a02e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 984 time: 0.0477853 Nov 24 04:18:29.383338 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-5badd9a9-c694-49bc-a7b2-5a444bd6211d req-6217df37-86e4-4a52-a0e5-f349b92b032c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396013 Nov 24 04:18:29.493701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd9726cd-a917-4fbb-bce8-e213ca16ba51 req-ae1b91d3-c1ef-41dd-91b0-d3ffe2ca4c10 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:29.495193 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fd9726cd-a917-4fbb-bce8-e213ca16ba51 req-ae1b91d3-c1ef-41dd-91b0-d3ffe2ca4c10 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 984 time: 0.0481191 Nov 24 04:18:29.540944 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-fd9726cd-a917-4fbb-bce8-e213ca16ba51 req-3c6f7980-7249-43fc-870a-27737b62263b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398941 Nov 24 04:18:29.561995 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36492) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:29.630515 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b50795b3-9028-45ed-9e47-2e37cb24ce4e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:29.632012 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-b50795b3-9028-45ed-9e47-2e37cb24ce4e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77&network_id=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 200 len: 1132 time: 0.0689752 Nov 24 04:18:29.838957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd73828-3e3d-40f0-b035-6ce201320035 req-0405822d-8ee3-4e0e-b928-8547ea108c72 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:29.840328 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7bd73828-3e3d-40f0-b035-6ce201320035 req-0405822d-8ee3-4e0e-b928-8547ea108c72 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 984 time: 0.0478985 Nov 24 04:18:29.889871 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7bd73828-3e3d-40f0-b035-6ce201320035 req-9407769d-e24e-4b82-8fc2-64f8eab1aaf9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437799 Nov 24 04:18:31.009024 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a44336-b673-4702-bbbc-3a5de510a6d8 req-c4726c81-88c9-42e4-9748-bd8cc2938468 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:31.010486 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b3a44336-b673-4702-bbbc-3a5de510a6d8 req-c4726c81-88c9-42e4-9748-bd8cc2938468 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 984 time: 0.0518787 Nov 24 04:18:31.058483 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b3a44336-b673-4702-bbbc-3a5de510a6d8 req-835330bf-4610-4255-b185-c6d95ce181e3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=55c9bcd5-c346-4d90-b085-6eb5a018f8ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410972 Nov 24 04:18:31.132760 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be038361-e471-4076-9a04-6ee3312bc15b req-e2cde24c-d07b-40e7-b640-021edd52c147 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:31.134200 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-be038361-e471-4076-9a04-6ee3312bc15b req-e2cde24c-d07b-40e7-b640-021edd52c147 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 984 time: 0.0470092 Nov 24 04:18:31.179012 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be038361-e471-4076-9a04-6ee3312bc15b req-3f9ddc9d-643f-4b72-82a3-990d811235e2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:31.180788 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-be038361-e471-4076-9a04-6ee3312bc15b req-3f9ddc9d-643f-4b72-82a3-990d811235e2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0392594 Nov 24 04:18:31.283100 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-be038361-e471-4076-9a04-6ee3312bc15b req-eae15e14-041d-4518-bdb3-106992554575 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.0966353 Nov 24 04:18:31.293438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:31.343367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:31.475056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=da9b6365-da25-4ffa-a9aa-f4010d95a86b,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:31.507640 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] For port da9b6365-da25-4ffa-a9aa-f4010d95a86b, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:31.542984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] device_id is not set on port da9b6365-da25-4ffa-a9aa-f4010d95a86b yet. {{(pid=103381) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 04:18:31.551340 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:31.556400 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:31.632249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Pushing event updated for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=11']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:31.674818 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] No DVR routers for this DVR port da9b6365-da25-4ffa-a9aa-f4010d95a86b on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:18:31.813696 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] In _notify_port_updated(), no bound segment for port da9b6365-da25-4ffa-a9aa-f4010d95a86b on network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 {{(pid=103381) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 24 04:18:31.814594 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:31.815197 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:31.816349 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-25a22464-aa23-45b0-b895-f83f7d8abb32 None None] Provisioning complete for port da9b6365-da25-4ffa-a9aa-f4010d95a86b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:31.816878 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-be038361-e471-4076-9a04-6ee3312bc15b req-dbd91d92-5d80-44f0-b0c6-ae99224aa33d service neutron] 10.222.0.21 "PUT /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 200 len: 1027 time: 0.5268776 Nov 24 04:18:31.817015 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-25a22464-aa23-45b0-b895-f83f7d8abb32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:31.856387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-25a22464-aa23-45b0-b895-f83f7d8abb32 None None] Port da9b6365-da25-4ffa-a9aa-f4010d95a86b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:32.162975 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-e65bf1e0-ad4a-4ff4-bee6-82fa7d6072e6 req-acdf516c-0462-4ac8-9071-af25ad2e0c35 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=603ed921-cd01-4662-bee9-60b118ee4c77 HTTP/1.1" status: 200 len: 210 time: 0.0274286 Nov 24 04:18:33.216209 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36504) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:33.271883 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eff8d3f7-d149-410b-bbf4-493cc77fa3c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.297821 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eff8d3f7-d149-410b-bbf4-493cc77fa3c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.355454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eff8d3f7-d149-410b-bbf4-493cc77fa3c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.358035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-eff8d3f7-d149-410b-bbf4-493cc77fa3c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.359240 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eff8d3f7-d149-410b-bbf4-493cc77fa3c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/7449f0b2-37fc-4502-a1a3-187c330127ca HTTP/1.1" status: 204 len: 168 time: 0.1420257 Nov 24 04:18:33.368177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff8d3f7-d149-410b-bbf4-493cc77fa3c6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7449f0b2-37fc-4502-a1a3-187c330127ca,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:33.388116 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36508) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:33.543613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 32708ba5-3977-440e-8196-a3adb96f8554 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:18:33.543957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.620413 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.620750 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.632217 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 32708ba5-3977-440e-8196-a3adb96f8554 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:18:33.771859 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.801451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=32708ba5-3977-440e-8196-a3adb96f8554,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:33.859028 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:33.859363 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP d5d88d3e-582c-4d68-9ba9-bf26efb7f42b disassociated (deleted). External IP: 172.26.5.10, port: da9b6365-da25-4ffa-a9aa-f4010d95a86b. Nov 24 04:18:34.071885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 5cdfb00c-d228-4acd-9888-c065a2445ea9 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:18:34.179928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:34.185451 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.190055 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] Sync routers for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:34.200544 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:34.201166 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:34.214046 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1722ad13-4904-4be7-a08a-a58becf7e27c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/floatingips/d5d88d3e-582c-4d68-9ba9-bf26efb7f42b HTTP/1.1" status: 204 len: 168 time: 0.8248127 Nov 24 04:18:34.282261 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36514) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:34.306615 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:34.338339 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69253fe7-f21e-4c13-a74b-5acccebce61f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.363527 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69253fe7-f21e-4c13-a74b-5acccebce61f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.423035 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69253fe7-f21e-4c13-a74b-5acccebce61f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.425625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-69253fe7-f21e-4c13-a74b-5acccebce61f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.426811 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-69253fe7-f21e-4c13-a74b-5acccebce61f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9 HTTP/1.1" status: 204 len: 168 time: 0.1435568 Nov 24 04:18:34.436735 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69253fe7-f21e-4c13-a74b-5acccebce61f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6025cb8c-3f1e-45cf-aae3-5bdbc28ddcf9,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:34.478118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36518) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:34.507016 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:04Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:34.532892 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] Checking router: 5cdfb00c-d228-4acd-9888-c065a2445ea9 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:34.541178 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:34.541787 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:34.572950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port da9b6365-da25-4ffa-a9aa-f4010d95a86b {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:18:34.573181 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.645914 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:34.656854 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.669262 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for da9b6365-da25-4ffa-a9aa-f4010d95a86b owned by {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:18:34.797929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.828319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=da9b6365-da25-4ffa-a9aa-f4010d95a86b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:34.840581 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:04Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:34.876225 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ecf4958-434f-4e6c-960b-e5aba7a8fb9f None None] The sync data for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv is: [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:01Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'a4effa5f-93d7-41f5-aace-509354e3fc8e', 'name': '', 'network_id': '57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:5d:53:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1408, 'fixed_ips': [{'subnet_id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:00Z', 'updated_at': '2021-11-24T04:18:04Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '03997b69-bd98-402b-ba2d-a1ab5c21d048', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:34.895136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:18:34.908554 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:34.909931 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-9dc9d649-97e6-43da-bd12-5f58012e0b84 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/ports/da9b6365-da25-4ffa-a9aa-f4010d95a86b HTTP/1.1" status: 204 len: 168 time: 0.4294906 Nov 24 04:18:34.912606 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36520) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:34.927956 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: da9b6365-da25-4ffa-a9aa-f4010d95a86b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:18:34.928621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device da9b6365-da25-4ffa-a9aa-f4010d95a86b not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:18:34.972303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8aa42bea-a40c-46ac-9cf5-8bbf703d94ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:35.138482 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c18225c-b6be-4f49-b77a-6894ffbeceb4 None None] New status for floating IP d5d88d3e-582c-4d68-9ba9-bf26efb7f42b: DOWN {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:18:35.307146 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:35.560472 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port a4effa5f-93d7-41f5-aace-509354e3fc8e {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:18:35.560816 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:35.649469 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port a4effa5f-93d7-41f5-aace-509354e3fc8e, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=a4effa5f-93d7-41f5-aace-509354e3fc8e,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:35.649833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:35.662824 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for a4effa5f-93d7-41f5-aace-509354e3fc8e owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:18:35.844591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:35.872265 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=a4effa5f-93d7-41f5-aace-509354e3fc8e,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:36.039464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.249246 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 5cdfb00c-d228-4acd-9888-c065a2445ea9 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:18:36.350015 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:36.356594 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-3ddb5729-5c7d-4c2c-a1bc-1a06e32ab8bb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/5cdfb00c-d228-4acd-9888-c065a2445ea9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4427586 Nov 24 04:18:36.358517 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36522) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:36.360189 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] Sync routers for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:36.369761 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:36.370395 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:36.408164 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_v2 [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting subnet 03997b69-bd98-402b-ba2d-a1ab5c21d048 {{(pid=103380) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:18:36.411211 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.450347 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4031464'] for subnet, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.471630 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:36.536112 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.596197 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3452095', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4111386'] for subnet, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.624512 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Subnet': ['ID=03997b69-bd98-402b-ba2d-a1ab5c21d048,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:36.629807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.633216 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-10a3cb2a-c6fb-4780-a390-e7eec406d8e7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/subnets/03997b69-bd98-402b-ba2d-a1ab5c21d048 HTTP/1.1" status: 204 len: 168 time: 0.2732604 Nov 24 04:18:36.636473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36524) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:36.638451 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4e335f9-da9d-4c5d-8a39-a92a87a2c679 None None] Network 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:18:36.736318 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:35Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:36.763385 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] Checking router: 5cdfb00c-d228-4acd-9888-c065a2445ea9 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:36.773000 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] Routers {'5cdfb00c-d228-4acd-9888-c065a2445ea9'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:36.773626 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['5cdfb00c-d228-4acd-9888-c065a2445ea9'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:36.827443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] DHCP port deletion for 57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:18:36.878948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] Deleting port 84f09a58-1101-41cf-815f-6d08e1eebe74 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:18:36.879335 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.890505 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] Set router 5cdfb00c-d228-4acd-9888-c065a2445ea9 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:36.955109 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] For port 84f09a58-1101-41cf-815f-6d08e1eebe74, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=84f09a58-1101-41cf-815f-6d08e1eebe74,segment=NetworkSegment(44d04a49-eacd-4810-b87f-c2849fcb7f59),segment_id=44d04a49-eacd-4810-b87f-c2849fcb7f59)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:36.955535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:36.969850 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] Calling delete_port for 84f09a58-1101-41cf-815f-6d08e1eebe74 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:18:37.051618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.083427 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] Pushing event deleted for resources: {'Port': ['ID=84f09a58-1101-41cf-815f-6d08e1eebe74,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:37.084863 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:35Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:37.085197 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-529b3732-2e0b-44ac-b1fc-038a065b500e None None] No DVR routers for this DVR port 84f09a58-1101-41cf-815f-6d08e1eebe74 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:18:37.112084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.118948 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c311c83-98ea-44c1-a03b-2906bd0c14f2 None None] The sync data for ids ['5cdfb00c-d228-4acd-9888-c065a2445ea9'] in dv-neutron-819049-1-hyperv is: [{'id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'name': 'tempest-TestNetworkBasicOps-router-218229346', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211'}], 'enable_snat': True}, 'gw_port_id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:17:57Z', 'updated_at': '2021-11-24T04:18:35Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:24:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cdfb00c-d228-4acd-9888-c065a2445ea9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:17:58Z', 'updated_at': '2021-11-24T04:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:37.223058 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.273543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:18:37.273884 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.353756 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:37.355266 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.366204 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 owned by network:router_gateway {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:18:37.532563 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84f09a58-1101-41cf-815f-6d08e1eebe74 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:18:37.549819 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.554957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 84f09a58-1101-41cf-815f-6d08e1eebe74 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:18:37.555291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 84f09a58-1101-41cf-815f-6d08e1eebe74 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:18:37.555745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a4effa5f-93d7-41f5-aace-509354e3fc8e no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:18:37.577322 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:37.577839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: a4effa5f-93d7-41f5-aace-509354e3fc8e {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:18:37.578231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device a4effa5f-93d7-41f5-aace-509354e3fc8e not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:18:37.591526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-465c532a-c9e0-4960-8e09-70087aa10770 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:18:37.640163 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.735091 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.737186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.778970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.779498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Fanout notify agent at l3_agent the message router_deleted on router 5cdfb00c-d228-4acd-9888-c065a2445ea9 {{(pid=103381) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:18:37.786304 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.787411 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f47f5c39-8524-4ef7-b3bd-3abd92709bea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/routers/5cdfb00c-d228-4acd-9888-c065a2445ea9 HTTP/1.1" status: 204 len: 168 time: 1.1495938 Nov 24 04:18:37.790106 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36526) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:37.866651 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.957464 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.961047 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-86259a7d-fb4d-4246-a69d-739e6fe6d94b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:37.979558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6']}} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:37.988442 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '44d04a49-eacd-4810-b87f-c2849fcb7f59') {'for_net_delete': True} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:37.988731 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.services.segments.db [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '44d04a49-eacd-4810-b87f-c2849fcb7f59') {} {{(pid=103381) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:37.998356 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3649699'] for segment, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.011481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.017676 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Releasing vlan 190 on physical network physnet1 to pool {{(pid=103381) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:18:38.018051 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3285832'] for segment, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: Traceback (most recent call last): Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: timer() Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: cb(*args, **kw) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: return func(*args, **kwargs) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: self._notify() Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: self.callback(batched_events) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: event.method(event) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: return f(self, *a, **k) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._get(url).json() Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: return self.request(url, 'GET', **kwargs) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:18:38.021091 dv-neutron-819049-1-hyperv neutron-server[103381]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:18:38.080438 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.087178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.090326 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/networks/57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6 HTTP/1.1" status: 204 len: 168 time: 0.2992332 Nov 24 04:18:38.101478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ad2809-bb07-4d5f-b5da-40018d5d8402 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Network': ['ID=57f404a7-24bc-4d30-b8bb-9b2d1a8c3fa6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:38.103716 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36528) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:38.116267 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7459a548-9d24-47ae-bc42-ef9c97349fb4 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/agents?agent_type=L3+agent HTTP/1.1" status: 200 len: 838 time: 0.0110955 Nov 24 04:18:38.118046 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36530) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:38.123324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--1076880004', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:38.144156 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:18:38.147474 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.170315 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 155, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:18:38.179602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.179955 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment a0cabe36-52f3-4e99-b63c-469e03e87c86 of type vlan for network ace29548-7abd-48ad-8c56-bf4012f66c2d Nov 24 04:18:38.225362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.251952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.257577 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:38.258244 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.290255 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1711671 Nov 24 04:18:38.293409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36532) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:38.299642 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'admin_state_up': True, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:38.339317 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5cb14f-c5a5-4e39-b540-5650fdf16773 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=ace29548-7abd-48ad-8c56-bf4012f66c2d,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:38.349600 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network ace29548-7abd-48ad-8c56-bf4012f66c2d details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:18:38.351868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.353229 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.408952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.541620 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.732396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.750362 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.766293 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.851350 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.14 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/fe851458-98c3-44dc-8062-92e449fb03ab) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:38.956971 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:38.989602 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:39.024790 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:39.030104 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:39.033530 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:39.042354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e88be59e-7783-42d1-8579-81e3af16dced None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:18:39.057035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:39.127884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-49ae8ad1-8b1f-488e-abde-fe848d229749 None None] Provisioning complete for port fe851458-98c3-44dc-8062-92e449fb03ab triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:39.128257 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-49ae8ad1-8b1f-488e-abde-fe848d229749 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:39.161705 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-49ae8ad1-8b1f-488e-abde-fe848d229749 None None] Port fe851458-98c3-44dc-8062-92e449fb03ab cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:39.284643 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:39.498900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:39.503130 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:18:39.523335 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:18:39.523683 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device c2d8ecad-d8e7-46d2-9c39-b1c5728e2fa5 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:18:39.625861 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:18:39.731228 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:39.741082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Sync routers for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:39.751815 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:39.753559 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-8f4b1ddf-d6f0-48dd-ae45-33ebab220749 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.4592297 Nov 24 04:18:39.755840 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:39.756466 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:39.756665 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36534) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:39.786693 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-a09b33be-4517-40fd-b2b6-b0fc081c6576 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0267146 Nov 24 04:18:39.786929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36536) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:39.859735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:39.875617 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7ac91b4-0ec6-4dae-8859-0122a14a39b2 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:39.877200 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-d7ac91b4-0ec6-4dae-8859-0122a14a39b2 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0893455 Nov 24 04:18:39.879957 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36538) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:39.909400 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-bb265e78-ea8c-4667-837a-11d891e7dd11 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0260789 Nov 24 04:18:39.909634 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36540) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:39.914316 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2071236286', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:39.999894 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:18:40.003629 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.035698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:39Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:40.063291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Checking router: 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:40.063900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Updating router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 port fe851458-98c3-44dc-8062-92e449fb03ab binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:18:40.101728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.105285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.182613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.248270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=30d9e6bd-496c-43a0-95ef-15ff1748cc7d,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:40.257561 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:40.258007 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: ace29548-7abd-48ad-8c56-bf4012f66c2d, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:18:40.275690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network ace29548-7abd-48ad-8c56-bf4012f66c2d is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:18:40.284948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, ace29548-7abd-48ad-8c56-bf4012f66c2d) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:40.289035 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:40.289640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.299055 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e22e1e27-aa30-4779-95a7-7035c8135ff5 None None] Network ace29548-7abd-48ad-8c56-bf4012f66c2d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:18:40.306636 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-4d3cbb20-1ef5-4051-a264-6ec262ec35b5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.3960633 Nov 24 04:18:40.309373 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36542) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:40.409561 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.418066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.480631 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60d34a49-b463-4a27-b33c-7da7a9aa4814 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:18:40.513327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Attempting to bind port fe851458-98c3-44dc-8062-92e449fb03ab on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:40.513712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Attempting to bind port fe851458-98c3-44dc-8062-92e449fb03ab by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:40.514086 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Attempting to bind port fe851458-98c3-44dc-8062-92e449fb03ab on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:40.515991 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8304c3-f3e4-4ce0-b928-6616fdea33bf None None] Pushing event updated for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:40.524789 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 18, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:40.525170 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:40.525582 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.525978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:40.527045 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Bound port: fe851458-98c3-44dc-8062-92e449fb03ab, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:40.527432 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.577038 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-ace29548-7abd-48ad-8c56-bf4012f66c2d', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:18:40.577894 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.626465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] For port fe851458-98c3-44dc-8062-92e449fb03ab, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:40.670399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-52747e50-06da-4a36-84ff-4852c3540705 None None] Provisioning complete for port fe851458-98c3-44dc-8062-92e449fb03ab triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:40.670770 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-52747e50-06da-4a36-84ff-4852c3540705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.742900 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.851090 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] For port fe851458-98c3-44dc-8062-92e449fb03ab, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe851458-98c3-44dc-8062-92e449fb03ab,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:40.876098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.923642 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-52747e50-06da-4a36-84ff-4852c3540705 None None] Port fe851458-98c3-44dc-8062-92e449fb03ab cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:40.951819 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7825c1cc-d839-481e-a39f-45186f08b5ce None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:18:40.959910 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:40.992731 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8304c3-f3e4-4ce0-b928-6616fdea33bf None None] Pushing event updated for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:41.000852 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:41.001394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:41.006814 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Allocated IP 172.20.0.2 (ace29548-7abd-48ad-8c56-bf4012f66c2d/30d9e6bd-496c-43a0-95ef-15ff1748cc7d/57e39086-0923-48f3-ae05-d82dd3b1fd62) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:41.111841 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-0d3a17b3-6809-4cf4-af79-193cbdcee459 None None] Provisioning complete for port fe851458-98c3-44dc-8062-92e449fb03ab triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:41.112576 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0d3a17b3-6809-4cf4-af79-193cbdcee459 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.215957 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:41.412438 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0d3a17b3-6809-4cf4-af79-193cbdcee459 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.418900 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.433290 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.474029 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-0d3a17b3-6809-4cf4-af79-193cbdcee459 None None] For port fe851458-98c3-44dc-8062-92e449fb03ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe851458-98c3-44dc-8062-92e449fb03ab,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:41.476382 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.1 (ace29548-7abd-48ad-8c56-bf4012f66c2d/30d9e6bd-496c-43a0-95ef-15ff1748cc7d/be240aa1-26eb-4d67-babe-b4519d5c992b) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:41.508712 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0d3a17b3-6809-4cf4-af79-193cbdcee459 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.511577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Network ace29548-7abd-48ad-8c56-bf4012f66c2d is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:41.520217 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:41.524357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:41.535390 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Pushing event updated for resources: {'Port': ['ID=57e39086-0923-48f3-ae05-d82dd3b1fd62,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:41.597789 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.626880 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Attempting to bind port 57e39086-0923-48f3-ae05-d82dd3b1fd62 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:41.627359 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Attempting to bind port 57e39086-0923-48f3-ae05-d82dd3b1fd62 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:41.627628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Attempting to bind port 57e39086-0923-48f3-ae05-d82dd3b1fd62 on network ace29548-7abd-48ad-8c56-bf4012f66c2d {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:41.630403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.637338 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3a17b3-6809-4cf4-af79-193cbdcee459 None None] Pushing event updated for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:41.641517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 18, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:41.641901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Checking segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:41.642339 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.642735 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Bound using segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:41.643213 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Bound port: 57e39086-0923-48f3-ae05-d82dd3b1fd62, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:41.643601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.657455 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:39Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:41.669042 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network ace29548-7abd-48ad-8c56-bf4012f66c2d is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:41.674441 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:41.677004 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:41.690524 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe0790e0-d9f2-4194-8812-86a9267f5aba None None] The sync data for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv is: [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:39Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:41.708689 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:41.726805 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.746601 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] For port 57e39086-0923-48f3-ae05-d82dd3b1fd62, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:41.750474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] For port 57e39086-0923-48f3-ae05-d82dd3b1fd62, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=57e39086-0923-48f3-ae05-d82dd3b1fd62,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:41.756464 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:41.818782 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2b8568-4211-48ef-b598-e9e9f0225195 None None] Pushing event updated for resources: {'Port': ['ID=57e39086-0923-48f3-ae05-d82dd3b1fd62,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:41.869801 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:42.203239 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:42.524985 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:42.530239 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:42.607057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:42.611681 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:42.711436 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network ace29548-7abd-48ad-8c56-bf4012f66c2d is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:42.712898 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:42.834703 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56927afb-e5a1-48be-9895-4c224fd6ccb2 None None] Network ace29548-7abd-48ad-8c56-bf4012f66c2d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:18:42.835934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:18:42.957655 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:42.965197 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6aa9a223-4ffa-467f-82b1-26f249e1bf81 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6525486 Nov 24 04:18:42.965350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-fe0b6813-84da-4bda-a583-3480ddc83064 None None] Provisioning complete for port 57e39086-0923-48f3-ae05-d82dd3b1fd62 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:42.965350 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0b6813-84da-4bda-a583-3480ddc83064 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:42.965550 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36544) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:43.075253 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.075466 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0b6813-84da-4bda-a583-3480ddc83064 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.076107 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.076958 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.077614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.078276 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.078739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.083397 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1424c7a8-7fd0-4b3c-9835-a921bbf80979 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.1143174 Nov 24 04:18:43.084297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36546) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:43.114211 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-fe0b6813-84da-4bda-a583-3480ddc83064 None None] For port 57e39086-0923-48f3-ae05-d82dd3b1fd62, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=57e39086-0923-48f3-ae05-d82dd3b1fd62,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:43.118941 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fe0b6813-84da-4bda-a583-3480ddc83064 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.154823 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.155294 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.155724 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.156174 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.156614 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.157712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:43.159666 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-41a71d95-69aa-464e-8bc5-752492c2790b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4005 time: 0.0740135 Nov 24 04:18:43.163069 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36548) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:43.181973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0b6813-84da-4bda-a583-3480ddc83064 None None] Pushing event updated for resources: {'Port': ['ID=57e39086-0923-48f3-ae05-d82dd3b1fd62,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:43.341144 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-96ad591c-0db3-4957-9f94-908ab53a2870 None None] Provisioning complete for port 57e39086-0923-48f3-ae05-d82dd3b1fd62 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:43.341831 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-96ad591c-0db3-4957-9f94-908ab53a2870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.420720 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Sync routers for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:43.427249 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-eaa9fc89-b63d-4ef7-abb1-25a72881941f tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.2630212 Nov 24 04:18:43.433375 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:43.434263 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:43.457564 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-96ad591c-0db3-4957-9f94-908ab53a2870 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:43.457943 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-96ad591c-0db3-4957-9f94-908ab53a2870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.507061 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-96ad591c-0db3-4957-9f94-908ab53a2870 None None] Port be240aa1-26eb-4d67-babe-b4519d5c992b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:43.565522 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:43.649160 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-e30eaef5-f7a0-4335-ae81-56da9a1f241c None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:43.649545 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e30eaef5-f7a0-4335-ae81-56da9a1f241c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.652663 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 57e39086-0923-48f3-ae05-d82dd3b1fd62 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:43.717228 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-e30eaef5-f7a0-4335-ae81-56da9a1f241c None None] Port be240aa1-26eb-4d67-babe-b4519d5c992b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:43.735686 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 57e39086-0923-48f3-ae05-d82dd3b1fd62 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:43.736521 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.790251 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:18:42Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:43.816558 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Checking router: 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:43.816911 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Updating router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 port be240aa1-26eb-4d67-babe-b4519d5c992b binding host dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:18:43.818753 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe851458-98c3-44dc-8062-92e449fb03ab up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:43.841909 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.871944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-64cad9f4-1c7d-424d-bc3f-1be29757fe42 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:43.872461 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-64cad9f4-1c7d-424d-bc3f-1be29757fe42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.913906 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36552) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:43.914473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port fe851458-98c3-44dc-8062-92e449fb03ab triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:43.914473 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:43.920077 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1293349292', 'description': 'tempest-secgroup-smoke-1293349292 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:43.940291 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-64cad9f4-1c7d-424d-bc3f-1be29757fe42 None None] Port be240aa1-26eb-4d67-babe-b4519d5c992b cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:43.943706 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.019058 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.022631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.046458 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.047607 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1371458 Nov 24 04:18:44.050624 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36554) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:44.055191 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '42e194d2-a2ac-4b5a-bd5c-bfe62b66a451', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:44.055537 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b28b90-63e0-4173-8765-f27e578ddfcd tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.083027 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.121965 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Publish callbacks [] for port, precommit_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.127476 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.138636 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.142476 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.161454 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46582afb-69bb-4ed7-a23a-0a4ad2a1e1ac,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.165794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.167499 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-07c29b31-5792-417a-864a-9ca7da0fdee6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1158671 Nov 24 04:18:44.170278 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36556) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:44.174970 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '42e194d2-a2ac-4b5a-bd5c-bfe62b66a451', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:44.176274 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=3']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.184575 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.184959 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.185304 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.185639 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.185971 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.186346 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.186677 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.187005 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.187334 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.187655 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.187974 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.188294 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103383) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:44.204848 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.250019 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Attempting to bind port be240aa1-26eb-4d67-babe-b4519d5c992b on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:44.250613 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Attempting to bind port be240aa1-26eb-4d67-babe-b4519d5c992b by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:44.251045 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Attempting to bind port be240aa1-26eb-4d67-babe-b4519d5c992b on network ace29548-7abd-48ad-8c56-bf4012f66c2d {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:44.257144 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 18, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:44.257677 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Checking segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103383) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:44.258066 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.258522 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Bound using segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} {{(pid=103383) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:44.258990 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.managers [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Bound port: be240aa1-26eb-4d67-babe-b4519d5c992b, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'}}] {{(pid=103383) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:44.259369 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.267431 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.271861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.294615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d20b702-514f-4321-ab58-3203f33a49cd,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.300836 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.304992 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ef824823-2b7b-42c8-90b3-a24c8d150210 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1311467 Nov 24 04:18:44.305452 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36558) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:44.311087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '42e194d2-a2ac-4b5a-bd5c-bfe62b66a451', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:44.335080 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] For port be240aa1-26eb-4d67-babe-b4519d5c992b, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103383) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:44.339595 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.plugins.ml2.db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] For port be240aa1-26eb-4d67-babe-b4519d5c992b, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be240aa1-26eb-4d67-babe-b4519d5c992b,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103383) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:44.348158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.348429 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron_lib.callbacks.manager [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103383) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.409303 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b631fe4c-444c-4f78-a509-213bdc7e2fe7 None None] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=4']} {{(pid=103383) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.425102 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.431330 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.435201 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:44.435945 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:44.446973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bcc3f085-542b-4268-9089-6912d75d24b2,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.466174 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.468391 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-bd512122-8294-4626-9953-aecd6d7fdd40 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1616669 Nov 24 04:18:44.471098 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36560) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:44.476511 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '42e194d2-a2ac-4b5a-bd5c-bfe62b66a451', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:44.477651 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-1007055c-ae9d-49b9-b079-06cd41735954 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:44.480791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1007055c-ae9d-49b9-b079-06cd41735954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.507868 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.549562 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:44.573444 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.582449 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.592148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1007055c-ae9d-49b9-b079-06cd41735954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.602184 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e40be9d8-4e34-4b10-a60f-e2639cbfae41,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.611534 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.612975 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-35496cc1-27b1-48d3-bdb4-2e81ae9c327a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1406190 Nov 24 04:18:44.615764 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36562) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:44.621167 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '42e194d2-a2ac-4b5a-bd5c-bfe62b66a451', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:44.638945 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-1007055c-ae9d-49b9-b079-06cd41735954 None None] For port be240aa1-26eb-4d67-babe-b4519d5c992b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be240aa1-26eb-4d67-babe-b4519d5c992b,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:44.645715 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:18:44.649693 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1007055c-ae9d-49b9-b079-06cd41735954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.652728 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.714608 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1007055c-ae9d-49b9-b079-06cd41735954 None None] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.731255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.735199 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.752338 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=972dc578-bf5c-4bfe-92bf-dc29f482b1c5,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.762359 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.766084 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f4440e2b-fb12-43f5-b7f2-faaf647d14b8 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1467268 Nov 24 04:18:44.766307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36564) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:44.772144 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '42e194d2-a2ac-4b5a-bd5c-bfe62b66a451', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:44.774621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2097b859-29c6-493d-a8a9-d0942ac5c6e6 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:44.774621 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2097b859-29c6-493d-a8a9-d0942ac5c6e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.792987 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:18:44Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:44.795139 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:18:44.800605 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.822068 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8ffdcd-c85a-448a-94a8-a6fd92a50dbc None None] The sync data for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv is: [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:18:44Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:44.898781 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.903129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.922194 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1a2b3a42-df89-49da-baa0-75206d7ddb13,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:44.937783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:44.939514 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-8ae138ce-aac1-4be4-b0c0-27c79ae46ced tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1716490 Nov 24 04:18:45.203563 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-bd1660a7-531a-4a70-8ea4-fa40b86fc9fe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1293349292&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.0485797 Nov 24 04:18:45.314377 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-2c7c3f65-2835-4b38-a37a-662c8db4487e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:45.315887 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-2c7c3f65-2835-4b38-a37a-662c8db4487e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=ace29548-7abd-48ad-8c56-bf4012f66c2d HTTP/1.1" status: 200 len: 797 time: 0.1051104 Nov 24 04:18:45.332108 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-74b346c0-090a-48ca-ba3f-9d05a7b59b43 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0102098 Nov 24 04:18:45.387622 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-834924ff-26d8-44be-b44f-0b9b22c3ad54 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0484786 Nov 24 04:18:45.403263 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-103915c6-ca7b-4e38-ba70-ac7441388e38 service neutron] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:18:45.404574 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-103915c6-ca7b-4e38-ba70-ac7441388e38 service neutron] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054238 Nov 24 04:18:45.506298 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-6cb5564d-0bce-4342-991e-256d278fbedd service neutron] 10.222.0.48 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923464 Nov 24 04:18:45.547270 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be240aa1-26eb-4d67-babe-b4519d5c992b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:45.600844 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:45.601129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:45.606981 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-b9a2cb03-e73d-4d69-9ab3-2bbb3dc8de65 service neutron] 10.222.0.48 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0954440 Nov 24 04:18:45.834601 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f1cfb048-078e-42cc-9527-96d78ccbc33a req-5eb4222e-4ebc-4d36-ae99-d2bad1a52b54 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 210 time: 0.0855794 Nov 24 04:18:46.793430 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-d62b2ec4-86b6-426f-a318-7dd69e6a921c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:46.794911 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-d62b2ec4-86b6-426f-a318-7dd69e6a921c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=ace29548-7abd-48ad-8c56-bf4012f66c2d HTTP/1.1" status: 200 len: 797 time: 0.1128013 Nov 24 04:18:46.864061 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-d48d4ce2-2a6e-40df-ad21-c803e1ff3eea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 380 time: 0.0597105 Nov 24 04:18:46.873955 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['42e194d2-a2ac-4b5a-bd5c-bfe62b66a451']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:46.966425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-8c8adeda-60f1-44ee-9087-4e7d78e509f1 req-1c420ca8-0c0b-4f8b-9cf7-4548937e6da6 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 210 time: 0.0325196 Nov 24 04:18:47.006773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:18:47.011099 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.136002 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.12 (ace29548-7abd-48ad-8c56-bf4012f66c2d/30d9e6bd-496c-43a0-95ef-15ff1748cc7d/a05b97aa-8a46-44dd-b732-6e3dc0fad9b6) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:47.269044 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.305946 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.349782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network ace29548-7abd-48ad-8c56-bf4012f66c2d is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:47.352702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:47.357088 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:47.381043 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:47.395957 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.396219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.396564 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.396904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.397240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.397582 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.397903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.398260 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.398591 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.398916 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.399239 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.399560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:47.420619 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:47.421252 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.438531 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-de3e4de5-bb41-4aa6-853b-af02bde4d5f5 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5687764 Nov 24 04:18:47.451778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Request body: {'port': {'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:47.513449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.639680 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-cf589d88-3cb0-4746-a456-f604e8e8e51b None None] Provisioning complete for port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:47.640238 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-cf589d88-3cb0-4746-a456-f604e8e8e51b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.676179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-cf589d88-3cb0-4746-a456-f604e8e8e51b None None] Port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:18:47.772620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:18:47.780538 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.793235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Transition to ACTIVE for port object a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:18:47.796669 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.848977 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Pushing event updated for resources: {'Port': ['ID=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:47.919914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Attempting to bind port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:18:47.920302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Attempting to bind port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:18:47.920581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Attempting to bind port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 on network ace29548-7abd-48ad-8c56-bf4012f66c2d {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:47.925243 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 on network ace29548-7abd-48ad-8c56-bf4012f66c2d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:18:47.925565 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Attempting to bind port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 on network ace29548-7abd-48ad-8c56-bf4012f66c2d {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:18:47.930700 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 18, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:18:47.930969 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Checking segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:18:47.931351 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Bound using segment: {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:18:47.931778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Bound port: a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a0cabe36-52f3-4e99-b63c-469e03e87c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 155, 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:18:47.932168 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:47.998840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] For port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:18:48.001926 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] For port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:18:48.007932 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:48.043267 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.043889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:48.045548 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] 10.222.0.21 "PUT /v2.0/ports/a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 HTTP/1.1" status: 200 len: 1094 time: 0.5985899 Nov 24 04:18:48.045945 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:48.048931 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2249960a-f681-4fff-b0c2-b966959652d7" -d '{"events": [{"name": "network-changed", "server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:48.074547 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e91b83-fb63-4406-8acd-07814d28ee55 service neutron] Pushing event updated for resources: {'Port': ['ID=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:48.131560 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ceccc80d-cd38-4ea3-86ca-fb160b66252a x-openstack-request-id: req-ceccc80d-cd38-4ea3-86ca-fb160b66252a {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:48.131904 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:48.132104 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-ceccc80d-cd38-4ea3-86ca-fb160b66252a {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:48.132514 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'status': 'completed', 'code': 200} Nov 24 04:18:48.148644 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c1b973-05ae-45b0-b9dc-8ace876365ec req-0420a36f-e84e-4954-b8c9-dc44d84a37b7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.149343 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-71129f54-3c06-430d-a5e3-a6272468ec5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.150291 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-72c1b973-05ae-45b0-b9dc-8ace876365ec req-0420a36f-e84e-4954-b8c9-dc44d84a37b7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 944 time: 0.1146927 Nov 24 04:18:48.151417 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-71129f54-3c06-430d-a5e3-a6272468ec5a service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 1097 time: 0.0496294 Nov 24 04:18:48.200144 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-b8f0b66c-00d5-42e2-8093-d840eff5eacb service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 HTTP/1.1" status: 200 len: 217 time: 0.0401814 Nov 24 04:18:48.203351 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-72c1b973-05ae-45b0-b9dc-8ace876365ec req-9c92c957-98df-4ed2-bb0c-2140d219b07c tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457270 Nov 24 04:18:48.253261 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-d6975872-2538-4ca2-996b-4c8a956a4653 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.254743 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-d6975872-2538-4ca2-996b-4c8a956a4653 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=30d9e6bd-496c-43a0-95ef-15ff1748cc7d HTTP/1.1" status: 200 len: 835 time: 0.0464008 Nov 24 04:18:48.300379 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-f9fa8ab2-1972-41f3-9c6b-fcc1e26291df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.301813 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-f9fa8ab2-1972-41f3-9c6b-fcc1e26291df service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=ace29548-7abd-48ad-8c56-bf4012f66c2d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0393136 Nov 24 04:18:48.395682 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-2182c89e-c7a8-4ce8-b500-77b1f68476ae service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866079 Nov 24 04:18:48.481921 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-73b8ae80-c314-4275-90ed-d88ba8be63eb req-8cd639c0-f1bc-4d29-96e2-9f71fe3d60da service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788970 Nov 24 04:18:48.573402 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2249960a-f681-4fff-b0c2-b966959652d7 req-9c53a4ba-f4c7-40e9-bd51-5a936a01eaa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.574902 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-9c53a4ba-f4c7-40e9-bd51-5a936a01eaa4 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 1097 time: 0.0443127 Nov 24 04:18:48.664722 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2249960a-f681-4fff-b0c2-b966959652d7 req-a70f6667-9ea1-4c2a-97ae-c0968dffb9a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.666180 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-a70f6667-9ea1-4c2a-97ae-c0968dffb9a0 service neutron] 10.222.0.21 "GET /v2.0/networks?id=ace29548-7abd-48ad-8c56-bf4012f66c2d HTTP/1.1" status: 200 len: 898 time: 0.0831192 Nov 24 04:18:48.710578 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-22e9085c-5d71-41e6-9df4-efb02bdfa949 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 HTTP/1.1" status: 200 len: 217 time: 0.0361230 Nov 24 04:18:48.759118 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2249960a-f681-4fff-b0c2-b966959652d7 req-234e8a8b-8fbc-4942-9172-79859f8fdef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.760612 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-234e8a8b-8fbc-4942-9172-79859f8fdef2 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=30d9e6bd-496c-43a0-95ef-15ff1748cc7d HTTP/1.1" status: 200 len: 835 time: 0.0435321 Nov 24 04:18:48.806620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2249960a-f681-4fff-b0c2-b966959652d7 req-720427c3-d068-47ce-ac03-91501310feee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:48.808706 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-720427c3-d068-47ce-ac03-91501310feee service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=ace29548-7abd-48ad-8c56-bf4012f66c2d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394349 Nov 24 04:18:48.903642 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-558dcb38-e6a1-4893-b2ab-f65a065fbe27 service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860145 Nov 24 04:18:48.992311 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2249960a-f681-4fff-b0c2-b966959652d7 req-aa8885f9-2564-4516-ac68-c1c678aee41c service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812335 Nov 24 04:18:49.318381 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a72e57b-00c7-4da4-86ea-12bbb5a64cdc req-8ba2a177-d095-4241-b4be-0f8be37681aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:49.319813 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6a72e57b-00c7-4da4-86ea-12bbb5a64cdc req-8ba2a177-d095-4241-b4be-0f8be37681aa tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 944 time: 0.0480518 Nov 24 04:18:49.373426 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6a72e57b-00c7-4da4-86ea-12bbb5a64cdc req-cb5cf7b6-ade8-4a08-80da-08e4172f061f tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477302 Nov 24 04:18:50.484807 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a20430-2e02-4076-b47c-29b5e5a57101 req-10629896-3f99-4689-87a0-4dc51b3c6133 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:50.486285 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b5a20430-2e02-4076-b47c-29b5e5a57101 req-10629896-3f99-4689-87a0-4dc51b3c6133 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 944 time: 0.0472589 Nov 24 04:18:50.534000 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b5a20430-2e02-4076-b47c-29b5e5a57101 req-d5fc367b-8f9a-4226-9d83-86ca1227ade2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418713 Nov 24 04:18:50.984381 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:18:51.078893 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:51.090248 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:18:51.126420 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:51.138569 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:18:51.157308 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:51.161447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:51.221559 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:51.352578 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-bbea2266-71dd-4123-888f-59f432d1704f service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0799458 Nov 24 04:18:51.391927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['a05b97aa-8a46-44dd-b732-6e3dc0fad9b6'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:18:51.414812 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-7e5814b4-3e3a-4d5c-ba26-b7702fda0b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:51.416320 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-7e5814b4-3e3a-4d5c-ba26-b7702fda0b65 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 1099 time: 0.0406995 Nov 24 04:18:51.523307 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-73b92f3f-3f81-4a64-8667-bc373aa67089 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:51.524804 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-73b92f3f-3f81-4a64-8667-bc373aa67089 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0880210 Nov 24 04:18:51.589764 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-13aed398-93ca-424f-8baf-9cd84231a73d service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22 HTTP/1.1" status: 200 len: 1002 time: 0.0565114 Nov 24 04:18:51.669013 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-e103f043-1859-4e28-958c-43755ffd916b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:51.670491 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-e103f043-1859-4e28-958c-43755ffd916b service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0747442 Nov 24 04:18:51.683914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1585f3c7-e275-4b78-ac54-e296735a824f req-1c67a687-672c-4b2d-9d4d-6a3eacd15e28 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:51.685262 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1585f3c7-e275-4b78-ac54-e296735a824f req-1c67a687-672c-4b2d-9d4d-6a3eacd15e28 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 945 time: 0.0628994 Nov 24 04:18:51.754048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-539ee0f2-a3fe-49ae-9652-7c64a4e45c0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:51.755554 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-539ee0f2-a3fe-49ae-9652-7c64a4e45c0a service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0694611 Nov 24 04:18:51.760481 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1585f3c7-e275-4b78-ac54-e296735a824f req-72e3066a-53f4-4a50-ae52-4b5b52486d96 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0671375 Nov 24 04:18:51.766737 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-be08b8ea-db30-43f8-b594-2cdc5ef59b8e service neutron] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103381) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:18:51.767693 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-be08b8ea-db30-43f8-b594-2cdc5ef59b8e service neutron] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048964 Nov 24 04:18:51.860108 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-8ec87e28-3265-4ff2-be33-82016e560bd9 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845299 Nov 24 04:18:51.947847 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-4f3ca35f-f9c4-4560-814e-be91de450247 req-72420af1-a551-449a-82f3-e80427eea256 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800631 Nov 24 04:18:52.886292 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf382f87-cb0f-4bbe-983c-968dcddb09f9 req-3a922294-e5b3-467a-8510-315091f6b468 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:52.887768 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bf382f87-cb0f-4bbe-983c-968dcddb09f9 req-3a922294-e5b3-467a-8510-315091f6b468 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 945 time: 0.0538855 Nov 24 04:18:52.936546 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bf382f87-cb0f-4bbe-983c-968dcddb09f9 req-0cf2c9a6-3e6a-4df9-9908-f5a6c4703a19 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429387 Nov 24 04:18:52.991423 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:18:53.041357 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:18:53.046801 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:18:53.047180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:53.122499 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:53.145128 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:53.147800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df97139b-59a2-4f9e-9333-be8b8aec0e04" -d '{"events": [{"server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "name": "network-vif-plugged", "status": "completed", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:53.160697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:18:53.164531 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:53.336374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a35399af-2b63-4185-a327-1435a9750b86 x-openstack-request-id: req-a35399af-2b63-4185-a327-1435a9750b86 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:53.336639 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "name": "network-vif-plugged", "status": "completed", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:53.336791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-a35399af-2b63-4185-a327-1435a9750b86 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:53.337178 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'code': 200} Nov 24 04:18:53.360296 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:53.366480 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ebb6b8-3ee6-4077-9f5b-ab1e609909ba req-25caf891-19e0-4dbf-b166-a753f391c7fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:53.368504 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9ebb6b8-3ee6-4077-9f5b-ab1e609909ba req-25caf891-19e0-4dbf-b166-a753f391c7fb service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 1099 time: 0.0453830 Nov 24 04:18:53.416536 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9ebb6b8-3ee6-4077-9f5b-ab1e609909ba req-efe1fee8-cef1-4c1c-a93c-8b60b4b42d21 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410142 Nov 24 04:18:54.049413 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0f39168-f08c-4397-aba1-d791f94ce9e6 req-1756a1d4-7cfa-48d2-b177-0fc7c0dd6266 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:54.050911 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c0f39168-f08c-4397-aba1-d791f94ce9e6 req-1756a1d4-7cfa-48d2-b177-0fc7c0dd6266 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 946 time: 0.0479500 Nov 24 04:18:54.098800 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c0f39168-f08c-4397-aba1-d791f94ce9e6 req-2cd400f7-4e03-4fec-9395-8a77bcba7568 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420380 Nov 24 04:18:55.211642 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab95bfff-3917-4523-b6b1-3f7ae1c2bd10 req-ed91558b-5e9d-4fe4-b6f1-620efb0ee7f7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:55.213000 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ab95bfff-3917-4523-b6b1-3f7ae1c2bd10 req-ed91558b-5e9d-4fe4-b6f1-620efb0ee7f7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 946 time: 0.0476277 Nov 24 04:18:55.261173 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ab95bfff-3917-4523-b6b1-3f7ae1c2bd10 req-e4560044-49f2-45c3-beb5-c9e698e3df15 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418313 Nov 24 04:18:55.373078 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed35e70-8ee5-49ba-8398-d6d3c9198b94 req-df10c629-a14a-49ae-b8e2-612cf57f6a20 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:55.374572 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6ed35e70-8ee5-49ba-8398-d6d3c9198b94 req-df10c629-a14a-49ae-b8e2-612cf57f6a20 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 946 time: 0.0485213 Nov 24 04:18:55.427150 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-6ed35e70-8ee5-49ba-8398-d6d3c9198b94 req-69057ed0-fa42-4b32-ab53-f023897c93da tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466261 Nov 24 04:18:55.448326 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36622) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:55.488754 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5abbf906-b0d5-41a7-a88f-b1ff1cfba4a5 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:55.490284 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-5abbf906-b0d5-41a7-a88f-b1ff1cfba4a5 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 1094 time: 0.0400102 Nov 24 04:18:55.493033 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36624) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:55.497395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:18:55.519187 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:55.615462 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:55.714947 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.41 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/195dc8c1-8d44-472b-927b-814bae1e7b88) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:18:55.815320 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:55.847162 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:55.886904 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:18:55.889727 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:18:55.892298 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:18:55.922016 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=195dc8c1-8d44-472b-927b-814bae1e7b88,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:55.931515 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.931867 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.932208 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.932543 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.933418 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.933750 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.934080 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.934433 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.934762 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.935087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.935409 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:55.935730 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:18:56.253186 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:56.316395 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:56.460875 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:56.465386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:56.531076 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=195dc8c1-8d44-472b-927b-814bae1e7b88,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:18:56.543080 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:56.640461 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP 81e399cf-c3fe-4e17-87b5-c7588e50d3e0 associated. External IP: 172.26.5.41, port: a05b97aa-8a46-44dd-b732-6e3dc0fad9b6. Nov 24 04:18:56.841696 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:18:56.950984 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:18:56.960946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] Sync routers for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:18:56.969265 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:18:56.971566 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:56.972380 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:56.996761 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ec65d694-52dc-45fd-a0d0-5b700a0b46c9 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5026774 Nov 24 04:18:56.997342 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:18:56.999613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f0f1d59-be13-4019-b181-20cbc53fb4c4" -d '{"events": [{"name": "network-changed", "server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:18:56.999870 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36626) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:57.037558 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:18:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-924fc37a-8453-454f-b375-85e51d94e11d x-openstack-request-id: req-924fc37a-8453-454f-b375-85e51d94e11d {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:18:57.037858 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:18:57.038114 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-924fc37a-8453-454f-b375-85e51d94e11d {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:18:57.038572 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'status': 'completed', 'code': 200} Nov 24 04:18:57.080320 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:57.141028 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-fa803bd0-e848-4147-8482-7ff01c91a93a tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 HTTP/1.1" status: 200 len: 922 time: 0.1376023 Nov 24 04:18:57.141827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36630) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:57.143967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-ad21f1f6-6720-4d62-8df5-d572a40bfe72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:57.145425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-ad21f1f6-6720-4d62-8df5-d572a40bfe72 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 1099 time: 0.0815642 Nov 24 04:18:57.207833 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-26c18546-5739-4e2c-9213-f4885496fb0b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 991 time: 0.0644672 Nov 24 04:18:57.240537 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-edc85282-f30f-473f-94af-8146ca3517c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:57.241983 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-edc85282-f30f-473f-94af-8146ca3517c0 service neutron] 10.222.0.21 "GET /v2.0/networks?id=ace29548-7abd-48ad-8c56-bf4012f66c2d HTTP/1.1" status: 200 len: 898 time: 0.0888345 Nov 24 04:18:57.304923 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '81e399cf-c3fe-4e17-87b5-c7588e50d3e0', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1448, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:56Z', 'updated_at': '2021-11-24T04:18:56Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:18:44Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:57.312197 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-eed1ee5c-d327-4516-8f5c-a2ea5fd0466a service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 HTTP/1.1" status: 200 len: 999 time: 0.0606275 Nov 24 04:18:57.334095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] Checking router: 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:18:57.342935 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:18:57.343543 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:18:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:57.361344 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-e04af901-ea28-4d4d-b021-3287805a4431 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:57.362803 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-e04af901-ea28-4d4d-b021-3287805a4431 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=30d9e6bd-496c-43a0-95ef-15ff1748cc7d HTTP/1.1" status: 200 len: 835 time: 0.0431314 Nov 24 04:18:57.407826 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-eb089e0e-7722-456a-a7ca-81153b860c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:18:57.409209 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-eb089e0e-7722-456a-a7ca-81153b860c8d service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=ace29548-7abd-48ad-8c56-bf4012f66c2d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0392766 Nov 24 04:18:57.445972 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:18:57.500754 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-7e6184e9-b121-42b2-966d-3ba228f8229e service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841682 Nov 24 04:18:57.590103 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-6f0f1d59-be13-4019-b181-20cbc53fb4c4 req-f411f5f9-8096-49a4-853b-2d4c8e801a11 service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819483 Nov 24 04:18:57.663613 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '81e399cf-c3fe-4e17-87b5-c7588e50d3e0', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1448, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:56Z', 'updated_at': '2021-11-24T04:18:56Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:18:44Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:18:57.693009 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e624254f-002b-4ca6-beef-ae5552782738 None None] The sync data for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv is: [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '81e399cf-c3fe-4e17-87b5-c7588e50d3e0', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1448, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:56Z', 'updated_at': '2021-11-24T04:18:56Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:18:44Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:18:57.869421 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3705f62-85bb-432d-a30a-532fff48c554 None None] New status for floating IP 81e399cf-c3fe-4e17-87b5-c7588e50d3e0: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:18:58.211976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36632) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:18:58.270285 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-83e2a18b-2434-4205-88dd-3f5392f553db tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 993 time: 0.0572309 Nov 24 04:18:59.386441 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:19:04.964791 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a8474a17-9bf9-451c-9f1e-5ac7d3609c09 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:07.962391 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9bae7d5b-59fc-4de6-9468-e63a31865011 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:08.770387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:10.092940 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:10.864480 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:12.212400 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:29.418040 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36646) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:29.530405 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b75cb86d-6b73-4e39-9c60-571d02b51490 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1111579 Nov 24 04:19:29.533073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36648) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:29.648531 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ee26e42-e71b-4a04-ab21-c41988ee1d60 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Notify agent at dv-neutron-819049-1-hyperv the message router_removed_from_agent {{(pid=103380) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 24 04:19:29.652148 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-6ee26e42-e71b-4a04-ab21-c41988ee1d60 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "DELETE /v2.0/agents/2002a118-72c5-4068-a563-991fad169d6e/l3-routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 HTTP/1.1" status: 204 len: 168 time: 0.1175947 Nov 24 04:19:29.654641 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36650) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:30.071826 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-7dc2215b-3e58-4e59-b045-f61db5956ee3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25/l3-agents HTTP/1.1" status: 200 len: 207 time: 0.4160509 Nov 24 04:19:30.074841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36652) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:30.132981 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-134367c8-19ae-40ee-a091-a01ee2479592 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 993 time: 0.0570786 Nov 24 04:19:30.416493 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39af51b5-a88a-404f-b26b-398d808e74e4 None None] New status for floating IP 81e399cf-c3fe-4e17-87b5-c7588e50d3e0: DOWN {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:19:31.135927 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36654) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:31.198911 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-011994a4-d8ca-49b0-9911-ba467328296b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 991 time: 0.0617633 Nov 24 04:19:31.532918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe851458-98c3-44dc-8062-92e449fb03ab no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:31.606707 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:31.625383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port fe851458-98c3-44dc-8062-92e449fb03ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe851458-98c3-44dc-8062-92e449fb03ab,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:31.628728 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:31.629386 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be240aa1-26eb-4d67-babe-b4519d5c992b no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:31.703285 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:31.711815 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.712169 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.712517 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.712854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.713190 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.713526 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.713856 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.714742 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.715074 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.715401 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.715725 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.716053 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103382) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:31.753977 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:31.784784 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port be240aa1-26eb-4d67-babe-b4519d5c992b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be240aa1-26eb-4d67-babe-b4519d5c992b,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:31.788898 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:31.836066 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=6']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:32.300963 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36658) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:32.753746 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1a8aa7f-bb9e-4c15-bf69-9db9088bda6b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103381) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:19:32.754084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1a8aa7f-bb9e-4c15-bf69-9db9088bda6b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Notify agent at dv-neutron-819049-1-hyperv the message router_added_to_agent {{(pid=103381) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 24 04:19:32.779463 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-e1a8aa7f-bb9e-4c15-bf69-9db9088bda6b tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "POST /v2.0/agents/2002a118-72c5-4068-a563-991fad169d6e/l3-routers HTTP/1.1" status: 201 len: 201 time: 0.4774582 Nov 24 04:19:32.781973 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36662) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:32.801559 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] Sync routers for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:19:32.811322 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:32.812850 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:32.895748 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-ad103204-6a77-49b5-b627-1924d1403be3 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1126630 Nov 24 04:19:32.898634 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36666) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:32.924737 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:32.960824 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d8beafdd-885f-4dda-b03c-495674231d04 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 991 time: 0.0608892 Nov 24 04:19:33.140737 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:31Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '81e399cf-c3fe-4e17-87b5-c7588e50d3e0', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1448, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:56Z', 'updated_at': '2021-11-24T04:19:30Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:19:31Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:33.166202 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] Checking router: 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:19:33.173979 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:33.174598 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:33.275476 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:33.489262 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:31Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '81e399cf-c3fe-4e17-87b5-c7588e50d3e0', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1448, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:56Z', 'updated_at': '2021-11-24T04:19:30Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:19:31Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:33.515110 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12f67764-c199-4e89-ac6a-fbb896a4cec8 None None] The sync data for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv is: [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:31Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '81e399cf-c3fe-4e17-87b5-c7588e50d3e0', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.41', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'port_id': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1448, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'mac_address': 'fa:16:3e:71:2c:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:18:56Z', 'updated_at': '2021-11-24T04:19:30Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:19:31Z', 'revision_number': 6, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:19:33.965297 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36668) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:34.030544 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-29e43b7f-4ba2-4be0-a0b9-d871cdc857ef tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 991 time: 0.0640645 Nov 24 04:19:34.970565 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-8a01b106-2c9b-49e8-bc88-24f9c6fc4a1d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.037478 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36670) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:35.049842 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b9a6ea3-747e-4cdb-88b5-4a7ba56a8c33 None None] New status for floating IP 81e399cf-c3fe-4e17-87b5-c7588e50d3e0: ACTIVE {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:19:35.105770 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-eca5038d-a80d-4836-99b5-f7aa1657e1f1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 991 time: 0.0671258 Nov 24 04:19:35.575440 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe851458-98c3-44dc-8062-92e449fb03ab up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:35.622429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port fe851458-98c3-44dc-8062-92e449fb03ab triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:35.622803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.700960 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.720040 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port fe851458-98c3-44dc-8062-92e449fb03ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe851458-98c3-44dc-8062-92e449fb03ab,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:35.724098 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.724818 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be240aa1-26eb-4d67-babe-b4519d5c992b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:35.797140 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=6']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:35.810741 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:35.811148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.890745 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.922875 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port be240aa1-26eb-4d67-babe-b4519d5c992b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be240aa1-26eb-4d67-babe-b4519d5c992b,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:35.926426 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:35.972317 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=7']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:36.109503 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36672) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:36.171438 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-682ffbae-85fb-47a0-97e6-29f3c8a5e619 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 200 len: 993 time: 0.0604990 Nov 24 04:19:36.384669 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:19:36.424036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36678) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:36.575680 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port 195dc8c1-8d44-472b-927b-814bae1e7b88 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:19:36.576021 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:36.648858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:36.649183 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:36.661084 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for 195dc8c1-8d44-472b-927b-814bae1e7b88 owned by network:floatingip {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:19:36.806928 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:36.836613 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=195dc8c1-8d44-472b-927b-814bae1e7b88,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:36.898991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:36.899425 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP 81e399cf-c3fe-4e17-87b5-c7588e50d3e0 disassociated (deleted). External IP: 172.26.5.41, port: a05b97aa-8a46-44dd-b732-6e3dc0fad9b6. Nov 24 04:19:37.110361 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:19:37.219446 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:19:37.224437 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:37.229487 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] Sync routers for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:19:37.239126 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:37.239902 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:37.252745 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-70fba618-95bd-4633-be38-6fa857b5f399 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/floatingips/81e399cf-c3fe-4e17-87b5-c7588e50d3e0 HTTP/1.1" status: 204 len: 168 time: 0.8276799 Nov 24 04:19:37.253456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:19:37.255830 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-537cc145-fa75-42fc-9362-8e13faca6da2" -d '{"events": [{"name": "network-changed", "server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:19:37.349156 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:37.355637 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:19:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bc21175-2675-4d12-81b8-e5bf92f9c69f x-openstack-request-id: req-4bc21175-2675-4d12-81b8-e5bf92f9c69f {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:19:37.356150 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:19:37.356675 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-4bc21175-2675-4d12-81b8-e5bf92f9c69f {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:19:37.357268 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'status': 'completed', 'code': 200} Nov 24 04:19:37.426396 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-6e007864-00a2-44e6-b89d-e8b7a0ee81a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:37.428149 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-6e007864-00a2-44e6-b89d-e8b7a0ee81a3 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 1099 time: 0.0482237 Nov 24 04:19:37.492574 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd8f457-e0ac-4eaf-8f81-4171af322cbf req-49227d5f-ed4a-4cbf-bc50-fd054f358b4a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:37.500814 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0fd8f457-e0ac-4eaf-8f81-4171af322cbf req-49227d5f-ed4a-4cbf-bc50-fd054f358b4a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 946 time: 0.0602913 Nov 24 04:19:37.532589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-323bfe95-4ced-4e5d-bb56-f8fd268bfd6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:37.534078 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-323bfe95-4ced-4e5d-bb56-f8fd268bfd6f service neutron] 10.222.0.21 "GET /v2.0/networks?id=ace29548-7abd-48ad-8c56-bf4012f66c2d HTTP/1.1" status: 200 len: 898 time: 0.0988812 Nov 24 04:19:37.565954 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-0fd8f457-e0ac-4eaf-8f81-4171af322cbf req-ae111b29-c061-4699-ba02-701fbcbda35a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539732 Nov 24 04:19:37.576605 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:37.582071 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe851458-98c3-44dc-8062-92e449fb03ab up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:37.584114 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-5650e303-ad1f-4f1b-9acb-26a06e1de319 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 HTTP/1.1" status: 200 len: 217 time: 0.0407755 Nov 24 04:19:37.602809 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] Checking router: 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:19:37.611676 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:37.612338 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:37.634070 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port fe851458-98c3-44dc-8062-92e449fb03ab triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:37.634485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:37.634881 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-a65c1344-7b15-4128-9837-7e09694a2e24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:37.636598 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-a65c1344-7b15-4128-9837-7e09694a2e24 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=30d9e6bd-496c-43a0-95ef-15ff1748cc7d HTTP/1.1" status: 200 len: 835 time: 0.0456507 Nov 24 04:19:37.689654 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-ed8c7b6f-0a5c-46a8-b76a-465ca5be5606 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:37.691213 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-ed8c7b6f-0a5c-46a8-b76a-465ca5be5606 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=ace29548-7abd-48ad-8c56-bf4012f66c2d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0466907 Nov 24 04:19:37.719884 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be240aa1-26eb-4d67-babe-b4519d5c992b up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:37.734218 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:37.767250 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port be240aa1-26eb-4d67-babe-b4519d5c992b triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:37.767620 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:37.784756 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-8046c21a-ad0d-4ba6-854f-d50c9342671b service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853205 Nov 24 04:19:37.882516 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-537cc145-fa75-42fc-9362-8e13faca6da2 req-814be1f6-2a66-4611-b94b-369dc3c0d3b7 service neutron] 10.222.0.21 "GET /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893188 Nov 24 04:19:37.964409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-95cfcbb7-c9d8-4b59-8bc3-5440b6dd6b6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:38.030581 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:38.059656 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1459462f-e38f-49ae-9ff1-1f558806de56 None None] The sync data for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv is: [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:18:41Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'be240aa1-26eb-4d67-babe-b4519d5c992b', 'name': '', 'network_id': 'ace29548-7abd-48ad-8c56-bf4012f66c2d', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:50:f9:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_interface', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:40Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 7, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '30d9e6bd-496c-43a0-95ef-15ff1748cc7d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:19:38.669408 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-110c15bc-4fb4-488d-a778-96c526d2111f req-f141f9e4-3237-469c-b946-9b66cb8b53d7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:38.670997 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-110c15bc-4fb4-488d-a778-96c526d2111f req-f141f9e4-3237-469c-b946-9b66cb8b53d7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 946 time: 0.0508928 Nov 24 04:19:38.701305 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-370d460b-fe3b-4478-b6ff-9f934e6f1975 None None] New status for floating IP 81e399cf-c3fe-4e17-87b5-c7588e50d3e0: DOWN {{(pid=103382) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:19:38.732297 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-110c15bc-4fb4-488d-a778-96c526d2111f req-3fd4e168-fb9b-4e1c-955d-fc8cf7396a39 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0553079 Nov 24 04:19:38.768652 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-11fe7a59-57a1-4944-9a14-c116e2d0d0e1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:38.770135 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-11fe7a59-57a1-4944-9a14-c116e2d0d0e1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/ports?device_id=03b4f2a5-4ddc-49eb-8940-b827cefd9e6e HTTP/1.1" status: 200 len: 946 time: 0.0563641 Nov 24 04:19:38.774751 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:38.866702 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:19:38.867048 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:38.953903 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:38.954312 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:38.967237 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:19:39.098056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:39.126707 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=a05b97aa-8a46-44dd-b732-6e3dc0fad9b6,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:39.172743 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] No DVR routers for this DVR port a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:19:39.175228 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:39.178521 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9a8fd72e-2aaa-4361-a9ff-53745421bd1d req-26fdd03b-e2f0-420f-9522-d43ebc038372 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "DELETE /v2.0/ports/a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 HTTP/1.1" status: 204 len: 173 time: 0.4012644 Nov 24 04:19:39.358739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'name': 'network-vif-deleted', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:19:39.361038 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f9d0347-a69c-4cd9-bbd1-fd16da2b43c1" -d '{"events": [{"server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "name": "network-vif-deleted", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:19:39.396461 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:19:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd8b4270-14b6-4531-a024-e4febcf3c252 x-openstack-request-id: req-dd8b4270-14b6-4531-a024-e4febcf3c252 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:19:39.396710 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "03b4f2a5-4ddc-49eb-8940-b827cefd9e6e", "name": "network-vif-deleted", "tag": "a05b97aa-8a46-44dd-b732-6e3dc0fad9b6", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:19:39.396974 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-dd8b4270-14b6-4531-a024-e4febcf3c252 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:19:39.397380 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '03b4f2a5-4ddc-49eb-8940-b827cefd9e6e', 'name': 'network-vif-deleted', 'tag': 'a05b97aa-8a46-44dd-b732-6e3dc0fad9b6', 'status': 'completed', 'code': 200} Nov 24 04:19:39.791056 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36694) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:39.846169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d7744b0-59da-4ce3-8084-2a644bb03cee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:39.871837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d7744b0-59da-4ce3-8084-2a644bb03cee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:39.931692 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d7744b0-59da-4ce3-8084-2a644bb03cee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:39.934999 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-5d7744b0-59da-4ce3-8084-2a644bb03cee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:39.938662 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-5d7744b0-59da-4ce3-8084-2a644bb03cee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/security-groups/42e194d2-a2ac-4b5a-bd5c-bfe62b66a451 HTTP/1.1" status: 204 len: 168 time: 0.1435816 Nov 24 04:19:39.945439 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7744b0-59da-4ce3-8084-2a644bb03cee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=42e194d2-a2ac-4b5a-bd5c-bfe62b66a451,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:39.966406 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36698) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:40.095515 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:40.324032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-601271'] for router_interface, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:40.571822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port be240aa1-26eb-4d67-babe-b4519d5c992b {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:19:40.572160 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:40.656759 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port be240aa1-26eb-4d67-babe-b4519d5c992b, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=be240aa1-26eb-4d67-babe-b4519d5c992b,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:40.657115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:40.670386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for be240aa1-26eb-4d67-babe-b4519d5c992b owned by network:router_interface {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:19:40.849798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:40.866034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:40.881774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=be240aa1-26eb-4d67-babe-b4519d5c992b,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:41.066240 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-556591', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-600359'] for router_interface, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:41.281122 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:19:41.721563 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:19:41.726442 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-94a4bf60-71f6-4ba2-9274-67f16ed18b51 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7589822 Nov 24 04:19:41.729445 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36700) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:41.732026 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] Sync routers for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:19:41.741159 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:41.741794 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:41.779465 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_v2 [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting subnet 30d9e6bd-496c-43a0-95ef-15ff1748cc7d {{(pid=103381) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 04:19:41.782534 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:41.821595 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3649722'] for subnet, precommit_delete_associations {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:41.844093 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:41.907507 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16527949'] for subnet, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:41.966353 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16527940', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3285222', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3979984'] for subnet, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:41.993543 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Subnet': ['ID=30d9e6bd-496c-43a0-95ef-15ff1748cc7d,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:41.997914 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.003056 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a6738962-cb88-4f27-87c2-2edddcab3380 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/subnets/30d9e6bd-496c-43a0-95ef-15ff1748cc7d HTTP/1.1" status: 204 len: 168 time: 0.2722034 Nov 24 04:19:42.003932 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36702) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:42.005581 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9572d62a-b3bc-4cdc-b36c-c164236910a7 None None] Network ace29548-7abd-48ad-8c56-bf4012f66c2d requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:19:42.022115 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:40Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:42.050645 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] Checking router: 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:19:42.060688 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] Routers {'1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:42.061302 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:42.113739 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.175859 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] Set router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:42.210681 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] DHCP port deletion for ace29548-7abd-48ad-8c56-bf4012f66c2d request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:19:42.221484 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.256802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.274959 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] Deleting port 57e39086-0923-48f3-ae05-d82dd3b1fd62 {{(pid=103382) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:19:42.275698 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.278755 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Deleting port fe851458-98c3-44dc-8062-92e449fb03ab {{(pid=103380) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:19:42.279096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.363090 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:40Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:42.365447 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.db [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] For port fe851458-98c3-44dc-8062-92e449fb03ab, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=fe851458-98c3-44dc-8062-92e449fb03ab,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103380) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:42.365832 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.384401 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.plugin [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Calling delete_port for fe851458-98c3-44dc-8062-92e449fb03ab owned by network:router_gateway {{(pid=103380) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:19:42.390010 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fc4ccdd-8ef5-4bbc-92d8-4bf45efd774a None None] The sync data for ids ['1d6a99ab-4b33-4030-a4c2-ac088eb1ce25'] in dv-neutron-819049-1-hyperv is: [{'id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'name': 'tempest-TestNetworkBasicOps-router-1419244258', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:40Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'fe851458-98c3-44dc-8062-92e449fb03ab', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:0b:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d6a99ab-4b33-4030-a4c2-ac088eb1ce25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1433, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:18:38Z', 'updated_at': '2021-11-24T04:19:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:19:42.492387 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] For port 57e39086-0923-48f3-ae05-d82dd3b1fd62, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=57e39086-0923-48f3-ae05-d82dd3b1fd62,segment=NetworkSegment(a0cabe36-52f3-4e99-b63c-469e03e87c86),segment_id=a0cabe36-52f3-4e99-b63c-469e03e87c86)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:42.492793 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.505082 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] Calling delete_port for 57e39086-0923-48f3-ae05-d82dd3b1fd62 owned by network:dhcp {{(pid=103382) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:19:42.549741 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.579791 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Port': ['ID=fe851458-98c3-44dc-8062-92e449fb03ab,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:42.591390 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642'] for port, after_delete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.596927 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26d722a5-5b5f-4dc9-ba8e-645ca096a90e None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:19:42.622359 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] Pushing event deleted for resources: {'Port': ['ID=57e39086-0923-48f3-ae05-d82dd3b1fd62,revision_number=None']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:42.627199 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f5cbf0-cde5-4abb-a234-e5cf580062b7 None None] No DVR routers for this DVR port 57e39086-0923-48f3-ae05-d82dd3b1fd62 on host dv-neutron-819049-1-hyperv {{(pid=103382) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:19:42.648701 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-664332'] for router_gateway, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.739896 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-600433', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4750'] for router, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.742065 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.789358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-600424'] for router, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.789935 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Fanout notify agent at l3_agent the message router_deleted on router 1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 {{(pid=103380) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 04:19:42.797528 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.801203 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-21bba773-5321-4e1b-a1c5-3946b297687d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/routers/1d6a99ab-4b33-4030-a4c2-ac088eb1ce25 HTTP/1.1" status: 204 len: 168 time: 0.7932696 Nov 24 04:19:42.801378 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36704) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:42.883594 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16319655'] for network, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.975221 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16531064', 'neutron.services.segments.db._delete_segments_for_network-8769089995704'] for network, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:42.997869 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ace29548-7abd-48ad-8c56-bf4012f66c2d']}} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:43.009428 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a0cabe36-52f3-4e99-b63c-469e03e87c86') {'for_net_delete': True} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:43.010096 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.services.segments.db [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a0cabe36-52f3-4e99-b63c-469e03e87c86') {} {{(pid=103380) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:43.019646 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8769089910348', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4031473'] for segment, before_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.035742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.042273 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Releasing vlan 155 on physical network physnet1 to pool {{(pid=103380) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 04:19:43.042776 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3452689'] for segment, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: Traceback (most recent call last): Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: timer() Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: cb(*args, **kw) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: return func(*args, **kwargs) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: self._notify() Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: self.callback(batched_events) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: event.method(event) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: return f(self, *a, **k) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._get(url).json() Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: return self.request(url, 'GET', **kwargs) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 04:19:43.045798 dv-neutron-819049-1-hyperv neutron-server[103380]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 04:19:43.102548 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16531041', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-664485'] for network, after_delete {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.110359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.112766 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "DELETE /v2.0/networks/ace29548-7abd-48ad-8c56-bf4012f66c2d HTTP/1.1" status: 204 len: 168 time: 0.3104784 Nov 24 04:19:43.123509 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849031aa-994c-4ede-a0e6-af15cf43aeb7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event deleted for resources: {'Network': ['ID=ace29548-7abd-48ad-8c56-bf4012f66c2d,revision_number=None']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:43.132929 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36706) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:43.137816 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'network': {'name': 'tempest-network-smoke--104015496', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'port_security_enabled': True}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:43.158306 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'network': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:19:43.161686 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for network, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.182019 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:43.184948 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] vlan segment allocate from pool success with {'vlan_id': 160, 'physical_network': 'physnet1'} {{(pid=103380) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 04:19:43.193827 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16527514'] for segment, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.194203 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.segments_db [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Added segment 7f7a67a3-6b72-4690-b892-d1f819b2c014 of type vlan for network 1a812d30-6114-4cad-b423-6ec75bdfc93a Nov 24 04:19:43.205120 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:19:43.205468 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a05b97aa-8a46-44dd-b732-6e3dc0fad9b6 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:19:43.240313 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8769089494312'] for network, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.263684 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723919', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582'] for network, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.269222 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:43.269803 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for network, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.307344 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.1732874 Nov 24 04:19:43.309959 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36708) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:43.340000 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-558932156', 'admin_state_up': True, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:43.354772 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac17102f-7757-4090-a50f-f9b201612027 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Network': ['ID=1a812d30-6114-4cad-b423-6ec75bdfc93a,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:43.369135 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a details requested by agent ovs-agent-dv-neutron-819049-1-hyperv with host dv-neutron-819049-1-hyperv {{(pid=103382) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 04:19:43.370547 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-600276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4784'] for router, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.371582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-602104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-667804', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-592331', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4793'] for router, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.425633 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.541860 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 57e39086-0923-48f3-ae05-d82dd3b1fd62 no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:43.560825 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.562843 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: 57e39086-0923-48f3-ae05-d82dd3b1fd62 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:19:43.563198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 57e39086-0923-48f3-ae05-d82dd3b1fd62 not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:19:43.563623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe851458-98c3-44dc-8062-92e449fb03ab no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:43.587241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: fe851458-98c3-44dc-8062-92e449fb03ab {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:19:43.587591 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device fe851458-98c3-44dc-8062-92e449fb03ab not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:19:43.588007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be240aa1-26eb-4d67-babe-b4519d5c992b no longer exists at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:43.607476 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] No Port match for: be240aa1-26eb-4d67-babe-b4519d5c992b {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:19:43.607755 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device be240aa1-26eb-4d67-babe-b4519d5c992b not bound to the agent host dv-neutron-819049-1-hyperv {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:19:43.751742 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.770324 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:43.874398 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.133 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/d99edfe2-0d19-47de-b515-bcdfaa7f18da) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:19:43.973476 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:44.005519 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:44.039152 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:19:44.041975 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:44.047493 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:19:44.055777 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72189148-1f00-4856-a494-33fbc6eac299 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:19:44.083578 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=d99edfe2-0d19-47de-b515-bcdfaa7f18da,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:44.169095 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-7e9eaed0-f685-42f2-be8e-8cded7c1f747 None None] Provisioning complete for port d99edfe2-0d19-47de-b515-bcdfaa7f18da triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:44.169372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-7e9eaed0-f685-42f2-be8e-8cded7c1f747 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:44.202136 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-7e9eaed0-f685-42f2-be8e-8cded7c1f747 None None] Port d99edfe2-0d19-47de-b515-bcdfaa7f18da cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:19:44.305270 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router_gateway, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:44.511551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-602095', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-664359'] for router, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:44.634679 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 is scheduled to L3 agent 2002a118-72c5-4068-a563-991fad169d6e with binding_index 1 {{(pid=103380) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 04:19:44.738631 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:19:44.749528 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644455-d57a-4372-8242-1288cb79241d None None] Sync routers for ids ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:19:44.763157 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] Routers {'55ed6bfd-5725-4b98-80b3-19a067c4daf3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:44.763716 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:44.763999 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for router, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:44.768384 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36712) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:44.768883 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-9abde9d8-3825-403a-9df9-fb283dc50aed tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.4574623 Nov 24 04:19:44.797792 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-a6545e7a-a386-4512-84d2-0ba72d5cb452 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?project_id=b951944bf1f44ed1b10939b3ae3d3197&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0280075 Nov 24 04:19:44.800139 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36714) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:44.871518 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] Set router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:44.900395 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c67a7301-a476-4777-95b2-edb2bddd05bb tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:44.902578 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-c67a7301-a476-4777-95b2-edb2bddd05bb tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1014166 Nov 24 04:19:44.905365 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36718) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:44.938952 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36720) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:44.942796 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-67af379b-914d-49a5-b949-593b6468543e tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets?network_id=f70b2100-2610-4e2a-8841-1763c44a2ca9&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0360129 Nov 24 04:19:44.944036 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-818975974', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'ip_version': 4, 'cidr': '172.20.0.0/28', 'dns_nameservers': ['1.2.3.4']}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:45.057481 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275e5349-b8d0-4b08-8d85-9526b40f6fb5 req-a4b9991f-73e7-4526-ab85-01ddf0a038c0 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:45.058909 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-275e5349-b8d0-4b08-8d85-9526b40f6fb5 req-a4b9991f-73e7-4526-ab85-01ddf0a038c0 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 946 time: 0.0998747 Nov 24 04:19:45.070079 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:44Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:45.083703 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'subnet': 1} {{(pid=103380) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:19:45.087145 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4111423'] for subnet, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.098174 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644455-d57a-4372-8242-1288cb79241d None None] Checking router: 55ed6bfd-5725-4b98-80b3-19a067c4daf3 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:19:45.098535 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644455-d57a-4372-8242-1288cb79241d None None] Updating router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 port d99edfe2-0d19-47de-b515-bcdfaa7f18da binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:19:45.122824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82644455-d57a-4372-8242-1288cb79241d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.172941 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-275e5349-b8d0-4b08-8d85-9526b40f6fb5 req-22e2df84-46b3-49fc-a56e-a8947f50a171 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1072056 Nov 24 04:19:45.298041 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-723860', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3452030', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4111373'] for subnet, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.360690 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Subnet': ['ID=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:45.365937 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Checking segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103380) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:19:45.366336 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network hostable DHCP agents. Network: 1a812d30-6114-4cad-b423-6ec75bdfc93a, hostable agents: ['2017f21b-d647-4a6e-b306-49195b4c6afd'], hosted agents: [] {{(pid=103380) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 04:19:45.377151 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82644455-d57a-4372-8242-1288cb79241d None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.382761 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82644455-d57a-4372-8242-1288cb79241d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.383475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a is scheduled to be hosted by DHCP agent 2017f21b-d647-4a6e-b306-49195b4c6afd with binding_index 1 {{(pid=103380) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 04:19:45.394256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-819049-1-hyperv, 1a812d30-6114-4cad-b423-6ec75bdfc93a) {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:45.398835 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:45.399432 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for subnet, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.419551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7598ed5a-6d84-4c83-82ce-19779fa53d46 None None] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:19:45.420514 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-83bae74b-98a5-41f5-8b71-630c9c230bfe tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.4803114 Nov 24 04:19:45.420872 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36722) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:45.449709 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f606d2d-27e1-4b45-8e5f-aae6e29d43f8 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:19:45.465790 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2441e2e8-9346-4c10-ac1e-f091c7c2302a None None] Pushing event updated for resources: {'Port': ['ID=d99edfe2-0d19-47de-b515-bcdfaa7f18da,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:45.468003 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-82644455-d57a-4372-8242-1288cb79241d None None] Attempting to bind port d99edfe2-0d19-47de-b515-bcdfaa7f18da on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:19:45.468373 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-82644455-d57a-4372-8242-1288cb79241d None None] Attempting to bind port d99edfe2-0d19-47de-b515-bcdfaa7f18da by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:19:45.468835 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82644455-d57a-4372-8242-1288cb79241d None None] Attempting to bind port d99edfe2-0d19-47de-b515-bcdfaa7f18da on network f70b2100-2610-4e2a-8841-1763c44a2ca9 {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:45.505779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82644455-d57a-4372-8242-1288cb79241d None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 19, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:19:45.506167 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82644455-d57a-4372-8242-1288cb79241d None None] Checking segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:19:45.506578 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82644455-d57a-4372-8242-1288cb79241d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.506985 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82644455-d57a-4372-8242-1288cb79241d None None] Bound using segment: {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:19:45.507471 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-82644455-d57a-4372-8242-1288cb79241d None None] Bound port: d99edfe2-0d19-47de-b515-bcdfaa7f18da, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2d4bf4-50bd-4c43-8f74-b9785ff5147f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:19:45.507854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82644455-d57a-4372-8242-1288cb79241d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.607097 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-998cb684-b452-4e1c-aec2-c4925e1fa1f0 None None] Provisioning complete for port d99edfe2-0d19-47de-b515-bcdfaa7f18da triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:45.607469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-998cb684-b452-4e1c-aec2-c4925e1fa1f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.609383 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-82644455-d57a-4372-8242-1288cb79241d None None] For port d99edfe2-0d19-47de-b515-bcdfaa7f18da, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:19:45.648996 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-82644455-d57a-4372-8242-1288cb79241d None None] For port d99edfe2-0d19-47de-b515-bcdfaa7f18da, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d99edfe2-0d19-47de-b515-bcdfaa7f18da,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:19:45.659245 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-82644455-d57a-4372-8242-1288cb79241d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.692236 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-998cb684-b452-4e1c-aec2-c4925e1fa1f0 None None] Port d99edfe2-0d19-47de-b515-bcdfaa7f18da cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:19:45.722299 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp335db118-c780-53d5-a8b9-d1003bfa21c8-1a812d30-6114-4cad-b423-6ec75bdfc93a', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e'}]}} from dv-neutron-819049-1-hyperv. {{(pid=103382) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 04:19:45.723148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.734452 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aca447ab-2444-43a8-b0f0-41ec9dc03079 None None] DHCP port deletion for f70b2100-2610-4e2a-8841-1763c44a2ca9 request from dv-neutron-819049-1-hyperv {{(pid=103382) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 04:19:45.760405 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2441e2e8-9346-4c10-ac1e-f091c7c2302a None None] Pushing event updated for resources: {'Port': ['ID=d99edfe2-0d19-47de-b515-bcdfaa7f18da,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:45.767408 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] Routers {'55ed6bfd-5725-4b98-80b3-19a067c4daf3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:45.768008 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:45.873066 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:45.917474 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-56a3a55f-6460-42d9-971e-12c2cac7dea8 None None] Provisioning complete for port d99edfe2-0d19-47de-b515-bcdfaa7f18da triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:45.920467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-56a3a55f-6460-42d9-971e-12c2cac7dea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.008007 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] Set router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:46.072802 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.db_base_plugin_common [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Allocated IP 172.20.0.2 (1a812d30-6114-4cad-b423-6ec75bdfc93a/31184df2-a9f4-43b1-8eb0-7f8c38f6a67e/7eed010a-b493-4a8f-bd43-aa40b4a25ea8) {{(pid=103382) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:19:46.191593 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-56a3a55f-6460-42d9-971e-12c2cac7dea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.293321 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-284d448e-64b6-469f-8746-6bc00908c6e7 req-e8041425-dcdd-4f83-a2b1-732cdbe8dc5e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:46.295044 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-284d448e-64b6-469f-8746-6bc00908c6e7 req-e8041425-dcdd-4f83-a2b1-732cdbe8dc5e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 946 time: 0.0510089 Nov 24 04:19:46.345861 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-284d448e-64b6-469f-8746-6bc00908c6e7 req-f4086cc1-1a36-4a28-ab3b-26c1aefc0836 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445647 Nov 24 04:19:46.403870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-56a3a55f-6460-42d9-971e-12c2cac7dea8 None None] For port d99edfe2-0d19-47de-b515-bcdfaa7f18da, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=d99edfe2-0d19-47de-b515-bcdfaa7f18da,segment=NetworkSegment(fb2d4bf4-50bd-4c43-8f74-b9785ff5147f),segment_id=fb2d4bf4-50bd-4c43-8f74-b9785ff5147f)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:46.411292 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-56a3a55f-6460-42d9-971e-12c2cac7dea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.469219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-a24e2e50-04ff-41c8-8e2e-c4363aa21e99 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:46.470588 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-a24e2e50-04ff-41c8-8e2e-c4363aa21e99 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 946 time: 0.0532610 Nov 24 04:19:46.527263 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a3a55f-6460-42d9-971e-12c2cac7dea8 None None] Pushing event updated for resources: {'Port': ['ID=d99edfe2-0d19-47de-b515-bcdfaa7f18da,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:46.540765 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Publish callbacks [] for port, precommit_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.549867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633'] for port, after_create {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.595089 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Deleting port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 {{(pid=103381) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 04:19:46.595423 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8769089900382'] for port, before_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.598434 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a is already hosted by enough agents. {{(pid=103382) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:19:46.603816 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-82644455-d57a-4372-8242-1288cb79241d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:44Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:46.605736 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.scheduler.base_scheduler [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Resources bound (agent type, host, resource id): {{(pid=103382) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:46.608870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Pushing event updated for resources: {'Port': ['ID=7eed010a-b493-4a8f-bd43-aa40b4a25ea8,revision_number=1']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:46.622419 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.1 (1a812d30-6114-4cad-b423-6ec75bdfc93a/31184df2-a9f4-43b1-8eb0-7f8c38f6a67e/23404d4d-93c2-4a55-9e1c-ded3cb4d8900) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:19:46.637196 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Received port after_create {{(pid=103382) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:19:46.640782 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82644455-d57a-4372-8242-1288cb79241d None None] The sync data for ids ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'] in dv-neutron-819049-1-hyperv is: [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:44Z', 'revision_number': 3, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv'}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:19:46.696374 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Attempting to bind port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:19:46.696752 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Attempting to bind port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:19:46.697152 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Attempting to bind port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 on network 1a812d30-6114-4cad-b423-6ec75bdfc93a {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:46.703087 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 19, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:19:46.703485 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Checking segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:19:46.704367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.704367 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Bound using segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:19:46.704748 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Bound port: 7eed010a-b493-4a8f-bd43-aa40b4a25ea8, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:19:46.705132 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.763649 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] For port a9a81a70-97cc-44e7-9f3c-c55a11f32f22, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103381) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:46.764023 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-663838'] for port, precommit_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.772340 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] For port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:19:46.775529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] For port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7eed010a-b493-4a8f-bd43-aa40b4a25ea8,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:19:46.781354 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.845981 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:46.853759 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c81487-118d-43aa-a680-1dc2acdd5127 None None] Pushing event updated for resources: {'Port': ['ID=7eed010a-b493-4a8f-bd43-aa40b4a25ea8,revision_number=2']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:46.905850 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.086832 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:19:47.094435 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:47.101120 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:19:47.103829 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:47.156778 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.157063 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.157368 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Floating IP cb261de6-eaa9-4c84-b25d-90b15d8d4691 disassociated. External IP: 172.26.5.121, port: a9a81a70-97cc-44e7-9f3c-c55a11f32f22. Nov 24 04:19:47.157711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.plugin [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Calling delete_port for a9a81a70-97cc-44e7-9f3c-c55a11f32f22 owned by compute:nova {{(pid=103381) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 04:19:47.177334 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-601136'] for router_interface, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.396611 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.419996 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8769089902448', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8769089469642', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_delete {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.456774 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-eadd93d9-13e5-488b-b294-eb73318c969f req-5a22f2b3-1140-4cec-a2bb-dbe951a1be55 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0378287 Nov 24 04:19:47.484608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event deleted for resources: {'Port': ['ID=a9a81a70-97cc-44e7-9f3c-c55a11f32f22,revision_number=None']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:47.577497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.577853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.578224 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.578561 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.578896 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.579235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.579568 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.579900 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.580235 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.580562 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.580889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.581212 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103381) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:19:47.655145 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device d99edfe2-0d19-47de-b515-bcdfaa7f18da up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:47.711168 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port d99edfe2-0d19-47de-b515-bcdfaa7f18da triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:47.711676 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.731226 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Router b3b4882e-8f09-451f-9384-42d336c1f444 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:19:47.795848 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:47.849944 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:47.850263 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.930783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.941625 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.952414 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:47.991059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] For port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=7eed010a-b493-4a8f-bd43-aa40b4a25ea8,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:47.996180 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:48.027013 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99f44d3d-aa6e-4a2f-91f3-77d4cefd0779 None None] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a requested from dv-neutron-819049-1-hyperv {{(pid=103382) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 04:19:48.045615 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:19:48.047729 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-601244'] for router_interface, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:48.052551 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:48.065845 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] Sync routers for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:19:48.083431 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:48.084078 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:48.110522 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] No DVR routers for this DVR port a9a81a70-97cc-44e7-9f3c-c55a11f32f22 on host hv-neutron-8190 {{(pid=103381) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 04:19:48.114788 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:48.118023 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-47d787d2-7e4e-4781-9ac0-5b1140d9abc5 req-4a0c7989-1764-4684-b16f-082fb5c50136 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "DELETE /v2.0/ports/a9a81a70-97cc-44e7-9f3c-c55a11f32f22 HTTP/1.1" status: 204 len: 173 time: 1.6402781 Nov 24 04:19:48.118585 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'name': 'network-vif-deleted', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:19:48.121372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46ba42c2-8e42-407e-b3ef-9b8ae36d6b09" -d '{"events": [{"server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "name": "network-vif-deleted", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:19:48.125064 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-2fd1230a-fcec-4180-af65-772f5c8b3358 None None] Provisioning complete for port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:48.125523 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-2fd1230a-fcec-4180-af65-772f5c8b3358 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:48.183155 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Pushing event updated for resources: {'Port': ['ID=7eed010a-b493-4a8f-bd43-aa40b4a25ea8,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:48.209573 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:48.255110 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:19:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ad9cb2e-0a6a-4e16-86fe-bc8c534ea75d x-openstack-request-id: req-8ad9cb2e-0a6a-4e16-86fe-bc8c534ea75d {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:19:48.255404 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "edf4fd8c-50f1-469a-aef6-61ad97f41fa5", "name": "network-vif-deleted", "tag": "a9a81a70-97cc-44e7-9f3c-c55a11f32f22", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:19:48.256129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-8ad9cb2e-0a6a-4e16-86fe-bc8c534ea75d {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:19:48.256129 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'edf4fd8c-50f1-469a-aef6-61ad97f41fa5', 'name': 'network-vif-deleted', 'tag': 'a9a81a70-97cc-44e7-9f3c-c55a11f32f22', 'status': 'completed', 'code': 200} Nov 24 04:19:48.322016 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:19:48.323712 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:48.453763 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:48.477424 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:19:48.488849 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] Checking router: b3b4882e-8f09-451f-9384-42d336c1f444 for host: dv-neutron-819049-1-hyperv {{(pid=103383) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:19:48.507941 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103383) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:48.508749 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:48.608554 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-9e04569b-17b1-4217-8489-9d8754e8e08c req-972b04c0-b33b-400b-b1a3-ccb45048353d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0385358 Nov 24 04:19:48.664497 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:19:48.672551 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36734) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:48.673113 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-f8c5fa03-c5e7-4e5f-af9b-7fa2b3d37c80 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "PUT /v2.0/routers/55ed6bfd-5725-4b98-80b3-19a067c4daf3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2511663 Nov 24 04:19:48.697153 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_dvr_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103383) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:48.731509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-67046c32-b5b1-42b4-9b89-61a08d42680b None None] Provisioning complete for port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:48.732111 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-67046c32-b5b1-42b4-9b89-61a08d42680b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:48.803356 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-67046c32-b5b1-42b4-9b89-61a08d42680b None None] Port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:19:48.826409 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Sync routers for ids ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:19:48.837278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Routers {'55ed6bfd-5725-4b98-80b3-19a067c4daf3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:48.837913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:48.841454 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-67046c32-b5b1-42b4-9b89-61a08d42680b None None] Provisioning complete for port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:48.841826 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-67046c32-b5b1-42b4-9b89-61a08d42680b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:48.884170 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:48.884640 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:48.885747 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:48.886099 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:48.886570 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:48.887143 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:48.888786 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-acbaa860-440d-47ae-9fef-27e32f66e8d0 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4284 time: 0.2149491 Nov 24 04:19:48.891950 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36736) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:49.011113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:49.011822 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:49.015101 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:49.015853 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:49.016319 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:49.016776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:49.021522 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36738) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:49.021732 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1e274d57-00b3-4ed4-aa26-0017cff601f1 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4013 time: 0.1285238 Nov 24 04:19:49.036489 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Set router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:49.208056 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.l3_hamode_db [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103383) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:49.244052 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-c6d10ca9-ae6a-49fd-b6f3-0269855fa029 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.2210057 Nov 24 04:19:49.247720 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6186db0-792b-4461-9a1f-a8c3f4e8614b None None] The sync data for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv is: [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103383) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:19:49.282410 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '23404d4d-93c2-4a55-9e1c-ded3cb4d8900', 'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:00:d6:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:45Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 2, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:49.314838 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Checking router: 55ed6bfd-5725-4b98-80b3-19a067c4daf3 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:19:49.315191 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Updating router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 binding host dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 04:19:49.351089 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.365081 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-495702a1-69ee-4166-8571-c91df1b82fb2 None None] Provisioning complete for port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:49.365444 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-495702a1-69ee-4166-8571-c91df1b82fb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.430934 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-495702a1-69ee-4166-8571-c91df1b82fb2 None None] Port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:19:49.559707 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36742) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:49.569297 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1830403214', 'description': 'tempest-secgroup-smoke-1830403214 description', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:49.615496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.645685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:49.709496 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.731037 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-721959'] for security_group, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.758839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 7eed010a-b493-4a8f-bd43-aa40b4a25ea8 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:49.759439 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.767726 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c33dd5e0-30bc-4029-9c68-8d2bee943e2d req-97f3a0b6-a2ca-494d-88d3-853a8c676518 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0484474 Nov 24 04:19:49.779717 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.781295 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2205875 Nov 24 04:19:49.784456 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36746) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:49.789017 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '24432c86-d6a6-472e-bc33-a107b0436238', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:49.803565 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1176f334-77f4-4c36-aa1c-96e83a2460b4 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=24432c86-d6a6-472e-bc33-a107b0436238,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:49.833473 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.863287 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Publish callbacks [] for port, precommit_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.876303 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.894534 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9fa54ac-2e7f-4702-a063-2fabb9cdf8c7 None None] New status for floating IP cb261de6-eaa9-4c84-b25d-90b15d8d4691: DOWN {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:19:49.911549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.918747 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.943220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=279180e7-6daf-4c08-8487-3eeee7d6cf4a,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:49.952956 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.953245 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d52db37e-eeb8-4b76-a3c6-654b80c6aa5b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1676676 Nov 24 04:19:49.956329 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36748) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:49.961664 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '24432c86-d6a6-472e-bc33-a107b0436238', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:49.999241 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:49.999740 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22f6391-918e-4a5d-a58f-6881dff849ff None None] Pushing event updated for resources: {'Port': ['ID=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,revision_number=3']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:50.073954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Attempting to bind port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 on host dv-neutron-819049-1-hyperv for vnic_type normal with profile {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:19:50.075976 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Attempting to bind port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 by drivers openvswitch,hyperv on host dv-neutron-819049-1-hyperv at level 0 using segments [{'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:19:50.076406 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Attempting to bind port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 on network 1a812d30-6114-4cad-b423-6ec75bdfc93a {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:50.082178 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Checking agent: {'id': 'e7b5468f-7835-45f7-9679-d04a29f07e40', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-819049-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 1, 11), 'started_at': datetime.datetime(2021, 11, 24, 4, 1, 41), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 19, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-819049-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:19:50.082552 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Checking segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103382) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:19:50.084572 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.085372 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Bound using segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} {{(pid=103382) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:19:50.085892 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.managers [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Bound port: 23404d4d-93c2-4a55-9e1c-ded3cb4d8900, host: dv-neutron-819049-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'}}] {{(pid=103382) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:19:50.086274 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.091087 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.100327 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.136510 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.138003 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1805689 Nov 24 04:19:50.138976 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dadfc5da-cbf7-403b-9a9e-9c3160009280 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c86d1e5a-f79d-478d-918f-f515dad8a73e,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:50.142433 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36750) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:50.151889 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '24432c86-d6a6-472e-bc33-a107b0436238', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:50.197054 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.207610 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] For port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900, host dv-neutron-819049-1-hyperv, cleared binding levels {{(pid=103382) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:19:50.215112 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] For port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900, host dv-neutron-819049-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:19:50.221720 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.290572 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.298581 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.308697 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Routers {'55ed6bfd-5725-4b98-80b3-19a067c4daf3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:19:50.309443 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:50.313803 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22f6391-918e-4a5d-a58f-6881dff849ff None None] Pushing event updated for resources: {'Port': ['ID=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:50.350798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.357032 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36752) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:50.362767 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2184925 Nov 24 04:19:50.364150 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '24432c86-d6a6-472e-bc33-a107b0436238', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:50.366362 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb761e9-985f-4085-a10a-d763f69bdf73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c00cd5e-ea03-4897-808e-d6191bcb671f,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:50.400314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-bc5aa1b3-cd35-4036-8dd7-547444be031f None None] Provisioning complete for port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:50.400314 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc5aa1b3-cd35-4036-8dd7-547444be031f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.418343 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.523086 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.528934 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.571073 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.575850 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2138612 Nov 24 04:19:50.576222 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36754) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:50.581119 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '24432c86-d6a6-472e-bc33-a107b0436238', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:50.587845 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717bfcf9-21d9-4529-84e9-9d7c07a71b08 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a53fcbf8-ca4e-4e8a-9461-1e84a95a3401,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:50.613657 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.securitygroups_db [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:19:50.621198 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.712623 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] Set router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:19:50.712842 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.718372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.865023 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc5aa1b3-cd35-4036-8dd7-547444be031f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:50.940059 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-bc5aa1b3-cd35-4036-8dd7-547444be031f None None] For port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900, host dv-neutron-819049-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-819049-1-hyperv',level=0,port_id=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:50.943830 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bc5aa1b3-cd35-4036-8dd7-547444be031f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.035788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc5aa1b3-cd35-4036-8dd7-547444be031f None None] Pushing event updated for resources: {'Port': ['ID=23404d4d-93c2-4a55-9e1c-ded3cb4d8900,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:51.061619 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '23404d4d-93c2-4a55-9e1c-ded3cb4d8900', 'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:00:d6:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:45Z', 'updated_at': '2021-11-24T04:19:50Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:19:51.098792 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1e5bc3d-ce4d-4d05-b5f4-4665484cd640 None None] The sync data for ids ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'] in dv-neutron-819049-1-hyperv is: [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_interfaces': [{'id': '23404d4d-93c2-4a55-9e1c-ded3cb4d8900', 'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:00:d6:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:45Z', 'updated_at': '2021-11-24T04:19:50Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:19:51.106316 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-951470cf-3118-448e-926c-7fe73441d030 None None] Provisioning complete for port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:51.106579 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-951470cf-3118-448e-926c-7fe73441d030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.134533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=daa0698e-a916-4fa7-aeeb-19bea950752e,revision_number=0']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:51.140940 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.142477 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-90a17f46-c13b-402c-9d6c-96c148f569af tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5649879 Nov 24 04:19:51.145553 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36758) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:19:51.150131 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'security_group_rule': {'security_group_id': '24432c86-d6a6-472e-bc33-a107b0436238', 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:51.188233 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e333648f-9609-49e8-8278-bbd4c0d60dce req-30f25f7d-2d3a-4721-9379-acb59c24a035 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0666585 Nov 24 04:19:51.216835 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.securitygroups_db [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Project b951944bf1f44ed1b10939b3ae3d3197 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 04:19:51.226708 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.231925 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9a81a70-97cc-44e7-9f3c-c55a11f32f22 no longer exists at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 04:19:51.274918 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] No Port match for: a9a81a70-97cc-44e7-9f3c-c55a11f32f22 {{(pid=103382) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 04:19:51.279034 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device a9a81a70-97cc-44e7-9f3c-c55a11f32f22 not bound to the agent host hv-neutron-8190 {{(pid=103382) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 04:19:51.313949 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.320023 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-679297'] for security_group_rule, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.342982 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8569d3ea-5db6-4893-b408-8dc22864faf3,revision_number=0']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:51.350625 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.361875 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b3904a7a-0929-4483-b597-d833cad727be tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2054753 Nov 24 04:19:51.546258 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-a007ce9b-8db6-417e-8030-33e11207e7ae tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1830403214&fields=id&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 267 time: 0.0679393 Nov 24 04:19:51.596393 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Device 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 up at agent ovs-agent-dv-neutron-819049-1-hyperv {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:51.651994 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Provisioning complete for port 23404d4d-93c2-4a55-9e1c-ded3cb4d8900 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:51.652511 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:51.654569 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-0828ddc8-1563-41c9-9dfa-6ac28bf02906 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:51.656327 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-0828ddc8-1563-41c9-9dfa-6ac28bf02906 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 796 time: 0.1162264 Nov 24 04:19:51.680343 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-fd9935ec-cd16-416a-adf8-5296b8429b6d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/quotas/b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 375 time: 0.0180640 Nov 24 04:19:51.752831 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-b782398c-449e-4750-9b32-bd2d2b5aecc3 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0710092 Nov 24 04:19:51.810084 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-84207551-90e4-4d3a-94a2-ce767d8ef7e1 service neutron] http://10.222.0.48:9696/v2.0/extensions returned with HTTP 200 {{(pid=103380) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 04:19:51.811384 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-84207551-90e4-4d3a-94a2-ce767d8ef7e1 service neutron] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0552123 Nov 24 04:19:51.910050 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-bef143ad-47b8-40c5-a46f-ac48b8564722 service neutron] 10.222.0.48 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922697 Nov 24 04:19:52.006312 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-c2f93839-dc15-4371-8425-61d6d752cc3f service neutron] 10.222.0.48 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0952506 Nov 24 04:19:52.179129 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-7a868c0d-7bf8-449a-9581-64c8167808fe req-95391f81-4adb-41a0-8136-03c4f4120467 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 210 time: 0.0266244 Nov 24 04:19:52.336828 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-244cacbf-34c1-4135-a0a0-0943e2f3e300 req-e53114b0-0315-4649-af04-e39c994c3011 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0337026 Nov 24 04:19:53.330048 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c18c2b3a-c3e1-4930-844c-18fc7e3eb873 req-fecdb717-cd25-460f-8b72-4b6ff7256c4a tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 210 time: 0.0315285 Nov 24 04:19:53.366177 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-3f9946b1-7ddc-4ff4-b277-4724afdd8d71 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:53.367648 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-3f9946b1-7ddc-4ff4-b277-4724afdd8d71 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 796 time: 0.1690490 Nov 24 04:19:53.435496 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-2e65e01b-8a6c-49a4-81d4-b5813ca4143e tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b951944bf1f44ed1b10939b3ae3d3197 HTTP/1.1" status: 200 len: 380 time: 0.0560107 Nov 24 04:19:53.443462 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-31b7b789-a6b5-4e6b-95d8-43e244be7ff3 req-d41862cf-6fe3-48b0-aa5b-68665a647de8 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=edf4fd8c-50f1-469a-aef6-61ad97f41fa5 HTTP/1.1" status: 200 len: 210 time: 0.0254457 Nov 24 04:19:53.448744 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'port': {'device_id': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'admin_state_up': True, 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'security_groups': ['24432c86-d6a6-472e-bc33-a107b0436238']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:53.562275 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Made reservation on behalf of b951944bf1f44ed1b10939b3ae3d3197 for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:19:53.565923 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:53.690693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.20.0.6 (1a812d30-6114-4cad-b423-6ec75bdfc93a/31184df2-a9f4-43b1-8eb0-7f8c38f6a67e/0848cd70-f6f9-4256-9ec2-89de03a6c528) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:19:53.831113 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:53.864186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:53.907542 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network 1a812d30-6114-4cad-b423-6ec75bdfc93a is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:19:53.910593 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:53.914301 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:19:53.943690 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=0848cd70-f6f9-4256-9ec2-89de03a6c528,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:53.973367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:53.974047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:53.990374 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-508334a5-6d66-42eb-9d02-7b09f198002d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5460281 Nov 24 04:19:54.002533 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Request body: {'port': {'device_id': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:54.059219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.123867 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-a93721f0-10c0-4ef8-9306-c547329e0a64 None None] Provisioning complete for port 0848cd70-f6f9-4256-9ec2-89de03a6c528 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:54.125198 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a93721f0-10c0-4ef8-9306-c547329e0a64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.164812 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-a93721f0-10c0-4ef8-9306-c547329e0a64 None None] Port 0848cd70-f6f9-4256-9ec2-89de03a6c528 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:19:54.323793 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0848cd70-f6f9-4256-9ec2-89de03a6c528 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:19:54.331255 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.344065 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Transition to ACTIVE for port object 0848cd70-f6f9-4256-9ec2-89de03a6c528 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:19:54.348711 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.403221 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Pushing event updated for resources: {'Port': ['ID=0848cd70-f6f9-4256-9ec2-89de03a6c528,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:54.513047 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592cc923-7706-4b85-b8c8-7448a00c5025 req-2e7a15b4-b5d0-4a42-a4ac-376126e27ae7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:54.514650 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-592cc923-7706-4b85-b8c8-7448a00c5025 req-2e7a15b4-b5d0-4a42-a4ac-376126e27ae7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 943 time: 0.0945792 Nov 24 04:19:54.518219 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Attempting to bind port 0848cd70-f6f9-4256-9ec2-89de03a6c528 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:19:54.518626 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Attempting to bind port 0848cd70-f6f9-4256-9ec2-89de03a6c528 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:19:54.518961 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Attempting to bind port 0848cd70-f6f9-4256-9ec2-89de03a6c528 on network 1a812d30-6114-4cad-b423-6ec75bdfc93a {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:54.542796 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Port 0848cd70-f6f9-4256-9ec2-89de03a6c528 on network 1a812d30-6114-4cad-b423-6ec75bdfc93a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:19:54.543161 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Attempting to bind port 0848cd70-f6f9-4256-9ec2-89de03a6c528 on network 1a812d30-6114-4cad-b423-6ec75bdfc93a {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:54.553597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 19, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:19:54.553929 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Checking segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:19:54.554337 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Bound using segment: {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:19:54.555115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Bound port: 0848cd70-f6f9-4256-9ec2-89de03a6c528, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7f7a67a3-6b72-4690-b892-d1f819b2c014', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 160, 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:19:54.555481 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.616412 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-592cc923-7706-4b85-b8c8-7448a00c5025 req-1e861371-f07b-4f59-b397-30341cdcc233 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0939302 Nov 24 04:19:54.643328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] For port 0848cd70-f6f9-4256-9ec2-89de03a6c528, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:19:54.646415 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] For port 0848cd70-f6f9-4256-9ec2-89de03a6c528, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:19:54.652176 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.686677 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:54.687372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:54.688644 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] 10.222.0.21 "PUT /v2.0/ports/0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 1093 time: 0.6904757 Nov 24 04:19:54.689081 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'tag': '0848cd70-f6f9-4256-9ec2-89de03a6c528'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:19:54.691349 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f64099e-e7c9-4441-853a-fadd3751563c" -d '{"events": [{"name": "network-changed", "server_uuid": "e8f801cf-0c20-4daf-b468-f4fcb4decd30", "tag": "0848cd70-f6f9-4256-9ec2-89de03a6c528"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:19:54.695489 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-ee288c8b-7517-4c17-911c-ca54a832d4a0 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-627946103&fields=id&tenant_id=a953770267d4499382d1c4d95a04322e HTTP/1.1" status: 200 len: 267 time: 0.0443296 Nov 24 04:19:54.728460 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc31c35-2c45-41e3-8d04-b3fe38e53ab6 service neutron] Pushing event updated for resources: {'Port': ['ID=0848cd70-f6f9-4256-9ec2-89de03a6c528,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:54.742516 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:19:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e9dd7f70-9d9d-4af8-be68-d529d4cbf663 x-openstack-request-id: req-e9dd7f70-9d9d-4af8-be68-d529d4cbf663 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:19:54.742948 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e8f801cf-0c20-4daf-b468-f4fcb4decd30", "tag": "0848cd70-f6f9-4256-9ec2-89de03a6c528", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:19:54.743211 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-e9dd7f70-9d9d-4af8-be68-d529d4cbf663 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:19:54.744564 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'tag': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'status': 'completed', 'code': 200} Nov 24 04:19:54.802045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-de29c6eb-c7c2-4737-8387-65af25c34ba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:54.803961 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-de29c6eb-c7c2-4737-8387-65af25c34ba8 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1096 time: 0.0540254 Nov 24 04:19:54.854905 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-2702ef76-186e-49f4-96be-2db9bfd8cd85 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 217 time: 0.0428631 Nov 24 04:19:54.909673 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-440f9b6d-ec16-499a-887c-22b82b779cff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:54.911396 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-440f9b6d-ec16-499a-887c-22b82b779cff service neutron] 10.222.0.21 "GET /v2.0/subnets?id=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e HTTP/1.1" status: 200 len: 843 time: 0.0499451 Nov 24 04:19:54.960774 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-937be21a-0bc5-4004-9778-4d9c6db3c035 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:54.962259 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-937be21a-0bc5-4004-9778-4d9c6db3c035 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=1a812d30-6114-4cad-b423-6ec75bdfc93a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0431283 Nov 24 04:19:55.061708 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-d5f93035-9739-42e4-acac-73f6bdf98a75 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0925918 Nov 24 04:19:55.157998 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c4c2537e-3d15-48a7-9bc1-4cf1b4c5a8b1 req-7768b590-f9af-4309-ac56-1b4a5146e719 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880091 Nov 24 04:19:55.166920 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-bb8ed737-aad8-412a-bcc7-7508159a9c1e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:55.168388 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-bb8ed737-aad8-412a-bcc7-7508159a9c1e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 811 time: 0.4593334 Nov 24 04:19:55.183880 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-6e1d4ad3-ca96-463e-88d2-cbd0e59f958a tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/quotas/a953770267d4499382d1c4d95a04322e HTTP/1.1" status: 200 len: 375 time: 0.0097265 Nov 24 04:19:55.235960 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-a54d80bb-ae47-4ee9-8a7a-db97bf4c6d47 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0452380 Nov 24 04:19:55.249487 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f64099e-e7c9-4441-853a-fadd3751563c req-0f4a9d50-5597-491e-91f1-590edb9585db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:55.251027 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-0f4a9d50-5597-491e-91f1-590edb9585db service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1096 time: 0.0463185 Nov 24 04:19:55.332225 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-61971b8f-fd5a-4b5f-8bf0-2b0c3f6f4905 service neutron] 10.222.0.48 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842900 Nov 24 04:19:55.344032 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f64099e-e7c9-4441-853a-fadd3751563c req-06dae076-b780-4878-a434-8969e9b956ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:55.345542 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-06dae076-b780-4878-a434-8969e9b956ae service neutron] 10.222.0.21 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 897 time: 0.0834498 Nov 24 04:19:55.392383 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-aad6b146-cb2d-4068-afaf-d599d6481cd0 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 217 time: 0.0391898 Nov 24 04:19:55.421766 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-0daddebb-01e6-48d9-96fa-8ae684e386e3 service neutron] 10.222.0.48 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833373 Nov 24 04:19:55.444517 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f64099e-e7c9-4441-853a-fadd3751563c req-5d2e95a2-0fb0-4e0a-9019-f6f2b209749b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:55.445998 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-5d2e95a2-0fb0-4e0a-9019-f6f2b209749b service neutron] 10.222.0.21 "GET /v2.0/subnets?id=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e HTTP/1.1" status: 200 len: 843 time: 0.0461571 Nov 24 04:19:55.492655 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f64099e-e7c9-4441-853a-fadd3751563c req-e1ddad19-c617-41fb-8d00-ec5a5563272e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:55.494243 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-e1ddad19-c617-41fb-8d00-ec5a5563272e service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=1a812d30-6114-4cad-b423-6ec75bdfc93a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403492 Nov 24 04:19:55.594444 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-c43b2513-38a5-42bd-8dc4-d462245365ba service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0911369 Nov 24 04:19:55.702477 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3f64099e-e7c9-4441-853a-fadd3751563c req-0a436972-0789-4c07-a682-27c50f77b947 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0979440 Nov 24 04:19:55.708376 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3a947db2-fe35-476f-a333-6d8b82f40882 req-6f85e7fc-985b-4b62-92c8-5a3169cfac07 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 210 time: 0.0284061 Nov 24 04:19:55.756283 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee9b5f4-deb3-4898-a09f-969b06217aff req-57b333c2-200a-4550-9b86-d23712a51e73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:55.757806 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2ee9b5f4-deb3-4898-a09f-969b06217aff req-57b333c2-200a-4550-9b86-d23712a51e73 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 943 time: 0.0520484 Nov 24 04:19:55.813204 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-2ee9b5f4-deb3-4898-a09f-969b06217aff req-6cfc6b6f-c8a5-4e8c-af36-8e17eeec32ac tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486357 Nov 24 04:19:56.612258 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-85b37902-ca04-40d3-a046-7be4ffd5b494 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:56.613713 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-85b37902-ca04-40d3-a046-7be4ffd5b494 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 811 time: 0.1041543 Nov 24 04:19:56.678388 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-442b7e2c-b1b3-4d33-90b8-4771faabd9c0 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a953770267d4499382d1c4d95a04322e HTTP/1.1" status: 200 len: 379 time: 0.0554435 Nov 24 04:19:56.687689 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'port': {'device_id': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'admin_state_up': True, 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'security_groups': ['6a16d4b2-5d18-452b-9b60-5cd39326b89c']}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:56.809253 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-33326f83-0d3c-4ba6-bf11-c44555167b0f req-5265a018-de46-499e-a76d-5080d0557348 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 210 time: 0.0313759 Nov 24 04:19:56.815479 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Made reservation on behalf of a953770267d4499382d1c4d95a04322e for: {'port': 1} {{(pid=103381) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 04:19:56.819518 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:56.976776 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3bcaf91-a817-4417-81dc-24503f86978c req-52ad43d1-93eb-4cdf-af16-606eb326bf28 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:56.978475 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e3bcaf91-a817-4417-81dc-24503f86978c req-52ad43d1-93eb-4cdf-af16-606eb326bf28 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 943 time: 0.0948617 Nov 24 04:19:56.995990 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Allocated IP 172.20.0.13 (4db6f33c-c141-4219-ad0f-97dfea0992c0/ba4b836b-28d1-471d-a461-f54951a2cf23/c3ae7427-f5a6-4b83-8b79-7daa425fa824) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:19:57.060905 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-e3bcaf91-a817-4417-81dc-24503f86978c req-890b710b-2ff8-4fbb-89ac-3d608b542ca7 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0759380 Nov 24 04:19:57.171643 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.203794 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.250589 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Network 4db6f33c-c141-4219-ad0f-97dfea0992c0 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:19:57.253758 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:19:57.258372 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:19:57.259935 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 0848cd70-f6f9-4256-9ec2-89de03a6c528 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:19:57.262991 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'Port': ['ID=c3ae7427-f5a6-4b83-8b79-7daa425fa824,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:57.309149 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:57.310190 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.328611 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-b4a148da-6a85-418c-aaf8-39d0e18f11e9 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.21 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6447845 Nov 24 04:19:57.344736 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Request body: {'port': {'device_id': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8190'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:19:57.375999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 0848cd70-f6f9-4256-9ec2-89de03a6c528, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:57.390931 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'port_id': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'mac_address': 'fa:16:3e:62:ec:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 160, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:19:57.422608 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.449051 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.470328 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0848cd70-f6f9-4256-9ec2-89de03a6c528 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:19:57.489995 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 0848cd70-f6f9-4256-9ec2-89de03a6c528, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:57.496307 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.545839 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=0848cd70-f6f9-4256-9ec2-89de03a6c528,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:57.567231 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-3c525875-4a66-44f8-8a86-9c0975849112 None None] Provisioning complete for port c3ae7427-f5a6-4b83-8b79-7daa425fa824 triggered by entity DHCP. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:57.567618 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-3c525875-4a66-44f8-8a86-9c0975849112 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.607348 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.plugin [None req-3c525875-4a66-44f8-8a86-9c0975849112 None None] Port c3ae7427-f5a6-4b83-8b79-7daa425fa824 cannot update to ACTIVE because it is not bound. {{(pid=103382) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 04:19:57.700311 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c3ae7427-f5a6-4b83-8b79-7daa425fa824 {{(pid=103381) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:19:57.707597 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.720164 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.provisioning_blocks [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Transition to ACTIVE for port object c3ae7427-f5a6-4b83-8b79-7daa425fa824 will not be triggered until provisioned by entity L2. {{(pid=103381) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 04:19:57.724037 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.724699 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['0848cd70-f6f9-4256-9ec2-89de03a6c528'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:19:57.799623 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Pushing event updated for resources: {'Port': ['ID=c3ae7427-f5a6-4b83-8b79-7daa425fa824,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:57.859321 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Attempting to bind port c3ae7427-f5a6-4b83-8b79-7daa425fa824 on host hv-neutron-8190 for vnic_type normal with profile {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 04:19:57.859734 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Attempting to bind port c3ae7427-f5a6-4b83-8b79-7daa425fa824 by drivers openvswitch,hyperv on host hv-neutron-8190 at level 0 using segments [{'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 04:19:57.860125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Attempting to bind port c3ae7427-f5a6-4b83-8b79-7daa425fa824 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:57.865602 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Port c3ae7427-f5a6-4b83-8b79-7daa425fa824 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8190 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 04:19:57.865997 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Attempting to bind port c3ae7427-f5a6-4b83-8b79-7daa425fa824 on network 4db6f33c-c141-4219-ad0f-97dfea0992c0 {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 04:19:57.872231 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Checking agent: {'id': '6e0865bf-f664-4b3f-8ae1-4a39b4abaf5b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8190', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'started_at': datetime.datetime(2021, 11, 24, 4, 6, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 4, 19, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 04:19:57.872638 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Checking segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103381) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 04:19:57.874188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Bound using segment: {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'} {{(pid=103381) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 04:19:57.874188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.managers [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Bound port: c3ae7427-f5a6-4b83-8b79-7daa425fa824, host: hv-neutron-8190, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '19c8da9b-b324-412b-a4ed-2230d609e8ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 176, 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0'}}] {{(pid=103381) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 04:19:57.874188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:57.946837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] For port c3ae7427-f5a6-4b83-8b79-7daa425fa824, host hv-neutron-8190, cleared binding levels {{(pid=103381) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 04:19:57.951679 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.plugins.ml2.db [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] For port c3ae7427-f5a6-4b83-8b79-7daa425fa824, host hv-neutron-8190, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103381) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 04:19:57.959125 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:58.000169 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.000897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for port, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:58.002407 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] 10.222.0.21 "PUT /v2.0/ports/c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 1094 time: 0.6648097 Nov 24 04:19:58.002971 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'tag': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:19:58.005302 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffba6a83-8832-479b-baba-15003ec883f6" -d '{"events": [{"name": "network-changed", "server_uuid": "543fd16a-cfae-4f78-9a30-1594f6e24f33", "tag": "c3ae7427-f5a6-4b83-8b79-7daa425fa824"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:19:58.044890 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3037d59-6390-4d34-9aa0-bdc93c0d6e8b req-b11c9eba-ac34-477c-b293-39a5cd923e18 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.046704 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d3037d59-6390-4d34-9aa0-bdc93c0d6e8b req-b11c9eba-ac34-477c-b293-39a5cd923e18 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.1251214 Nov 24 04:19:58.101558 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:19:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2228d3e6-b848-46d0-87c4-02bee84787fe x-openstack-request-id: req-2228d3e6-b848-46d0-87c4-02bee84787fe {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:19:58.101954 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "543fd16a-cfae-4f78-9a30-1594f6e24f33", "tag": "c3ae7427-f5a6-4b83-8b79-7daa425fa824", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:19:58.102178 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-2228d3e6-b848-46d0-87c4-02bee84787fe {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:19:58.102837 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'tag': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'status': 'completed', 'code': 200} Nov 24 04:19:58.108861 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a424fd-7657-4f75-a566-5e2bb9cf319b service neutron] Pushing event updated for resources: {'Port': ['ID=c3ae7427-f5a6-4b83-8b79-7daa425fa824,revision_number=3']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:58.136008 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-f6a0d164-4c97-4bd2-bcda-6f1bd2916cd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.137725 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-f6a0d164-4c97-4bd2-bcda-6f1bd2916cd2 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1097 time: 0.0818408 Nov 24 04:19:58.159319 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-d3037d59-6390-4d34-9aa0-bdc93c0d6e8b req-3d02bd5e-628a-4f2f-acf5-9a54eb10b51e tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1043270 Nov 24 04:19:58.191118 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-ab34b16e-e0c8-4656-b5ce-1c026f19c099 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 217 time: 0.0438502 Nov 24 04:19:58.267020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-ad2d62dc-9f95-4a04-8269-4e479776e46e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.268498 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-ad2d62dc-9f95-4a04-8269-4e479776e46e service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0698059 Nov 24 04:19:58.281499 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-034c23b9-14b5-4f5e-9a2a-29f5b27bc1e3 req-73dc86d4-d222-431b-bdf4-55fd30e4d6cc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.283000 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-034c23b9-14b5-4f5e-9a2a-29f5b27bc1e3 req-73dc86d4-d222-431b-bdf4-55fd30e4d6cc tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 944 time: 0.0947180 Nov 24 04:19:58.364867 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-034c23b9-14b5-4f5e-9a2a-29f5b27bc1e3 req-31ac8a45-552f-4f5d-94f8-8ac2880b1212 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0725770 Nov 24 04:19:58.375188 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-891dd255-d8d9-43f4-bb5c-a4e12f69e6c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.376906 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-891dd255-d8d9-43f4-bb5c-a4e12f69e6c5 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0929513 Nov 24 04:19:58.475112 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-7d6effd3-f806-4ff6-8b48-a33632f8e3fe service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0896921 Nov 24 04:19:58.565391 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f9f62691-0c58-4344-b5ca-29f2a7d55345 req-9396a493-fbf3-4f49-b4c2-95ece087e44f service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829165 Nov 24 04:19:58.648031 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffba6a83-8832-479b-baba-15003ec883f6 req-605a096a-e3b3-412d-ab5f-959653defd7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.649568 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-605a096a-e3b3-412d-ab5f-959653defd7e service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1097 time: 0.0405493 Nov 24 04:19:58.742186 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffba6a83-8832-479b-baba-15003ec883f6 req-1ac3220b-e2e3-400b-a2a2-2957611f8d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.743545 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-1ac3220b-e2e3-400b-a2a2-2957611f8d88 service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0862935 Nov 24 04:19:58.784003 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-149802ae-c819-48a0-9841-72b0463c4330 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 217 time: 0.0334454 Nov 24 04:19:58.836367 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffba6a83-8832-479b-baba-15003ec883f6 req-e9e0c7df-890d-41c8-a1e2-7d89342e9901 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.837797 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-e9e0c7df-890d-41c8-a1e2-7d89342e9901 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0471017 Nov 24 04:19:58.883739 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffba6a83-8832-479b-baba-15003ec883f6 req-3e3d01f0-3ba4-472a-ae35-ec202fe5056f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:58.885881 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-3e3d01f0-3ba4-472a-ae35-ec202fe5056f service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397038 Nov 24 04:19:58.973746 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-33fdad57-e8c9-4c1f-9f25-b3446f165f26 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808072 Nov 24 04:19:59.068239 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-ffba6a83-8832-479b-baba-15003ec883f6 req-0aaae697-619e-4fc7-8126-32064ec7108d service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875185 Nov 24 04:19:59.271312 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device 0848cd70-f6f9-4256-9ec2-89de03a6c528 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:19:59.272011 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c791f975-5f0d-472b-a63a-d603ec44161e req-6f597e0f-5575-4251-bbac-ac53f6d29f50 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:59.274002 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c791f975-5f0d-472b-a63a-d603ec44161e req-6f597e0f-5575-4251-bbac-ac53f6d29f50 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0510886 Nov 24 04:19:59.321020 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port 0848cd70-f6f9-4256-9ec2-89de03a6c528 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:19:59.325301 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port 0848cd70-f6f9-4256-9ec2-89de03a6c528 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:19:59.325659 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-c791f975-5f0d-472b-a63a-d603ec44161e req-0dd1ec62-35ed-4184-ab49-cd6a2bda3b62 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450847 Nov 24 04:19:59.325895 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:59.403184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:59.429973 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0848cd70-f6f9-4256-9ec2-89de03a6c528'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:19:59.432808 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-069eea5d-8551-41fb-84c1-a77ed2644e39" -d '{"events": [{"server_uuid": "e8f801cf-0c20-4daf-b468-f4fcb4decd30", "name": "network-vif-plugged", "status": "completed", "tag": "0848cd70-f6f9-4256-9ec2-89de03a6c528"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:19:59.452376 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port 0848cd70-f6f9-4256-9ec2-89de03a6c528, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528,segment=NetworkSegment(7f7a67a3-6b72-4690-b892-d1f819b2c014),segment_id=7f7a67a3-6b72-4690-b892-d1f819b2c014)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:19:59.458056 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:19:59.504220 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d10fbb7-e555-4fcb-afb8-429ec25e1b6c req-6e6af5ed-5a98-4043-a8af-974aad48baea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:59.505765 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1d10fbb7-e555-4fcb-afb8-429ec25e1b6c req-6e6af5ed-5a98-4043-a8af-974aad48baea tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 944 time: 0.0659068 Nov 24 04:19:59.528624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=0848cd70-f6f9-4256-9ec2-89de03a6c528,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:19:59.563224 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:19:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad55b6c9-c28a-4c1d-b5be-90018632448b x-openstack-request-id: req-ad55b6c9-c28a-4c1d-b5be-90018632448b {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:19:59.563529 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e8f801cf-0c20-4daf-b468-f4fcb4decd30", "name": "network-vif-plugged", "status": "completed", "tag": "0848cd70-f6f9-4256-9ec2-89de03a6c528", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:19:59.563788 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-ad55b6c9-c28a-4c1d-b5be-90018632448b {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:19:59.564189 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'code': 200} Nov 24 04:19:59.581821 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-1d10fbb7-e555-4fcb-afb8-429ec25e1b6c req-6a77e14c-cbbb-4b03-87c9-da338dfaa8cb tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693996 Nov 24 04:19:59.742331 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9969574-4757-434b-94f8-80c25538c322 req-9873129b-6f13-4e7b-ae9d-4576f8da0e2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:19:59.743781 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9969574-4757-434b-94f8-80c25538c322 req-9873129b-6f13-4e7b-ae9d-4576f8da0e2b service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1098 time: 0.0439439 Nov 24 04:19:59.790232 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-b9969574-4757-434b-94f8-80c25538c322 req-821351e4-d28e-4571-8d53-d92ec18387b5 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388169 Nov 24 04:20:00.454940 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45121dcd-f45f-4d0c-98e2-c2de14fac406 req-3ae007be-70f6-4cd6-9b87-6d84c1907362 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:00.456518 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45121dcd-f45f-4d0c-98e2-c2de14fac406 req-3ae007be-70f6-4cd6-9b87-6d84c1907362 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0614762 Nov 24 04:20:00.507587 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-45121dcd-f45f-4d0c-98e2-c2de14fac406 req-ca6be3e6-278f-4851-a3b6-63bd07b5c15c tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447755 Nov 24 04:20:00.708763 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e6ae7c-54b3-45b5-bbd4-eb21f02c244d req-5d4896ef-bbe3-41c2-9dde-78c5ba0c9005 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:00.717224 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-76e6ae7c-54b3-45b5-bbd4-eb21f02c244d req-5d4896ef-bbe3-41c2-9dde-78c5ba0c9005 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 945 time: 0.0602009 Nov 24 04:20:00.771246 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-76e6ae7c-54b3-45b5-bbd4-eb21f02c244d req-83cfed00-25d8-4227-9e67-e210143f39c1 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0527949 Nov 24 04:20:01.629161 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd33a355-4cde-47e6-8721-7fc6465e617a req-ae70dafb-d54f-47d3-a060-8f3581ca6d19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:01.631027 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bd33a355-4cde-47e6-8721-7fc6465e617a req-ae70dafb-d54f-47d3-a060-8f3581ca6d19 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0554399 Nov 24 04:20:01.685545 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-bd33a355-4cde-47e6-8721-7fc6465e617a req-23faa91b-0166-413e-b712-94c2848aed1d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474844 Nov 24 04:20:01.889045 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f6c82d-bc42-4bf1-98d7-48a092b84a4e req-abfd440c-2c93-48c3-9a5c-618949b398d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:01.890548 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-35f6c82d-bc42-4bf1-98d7-48a092b84a4e req-abfd440c-2c93-48c3-9a5c-618949b398d2 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 945 time: 0.0493040 Nov 24 04:20:01.944479 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-35f6c82d-bc42-4bf1-98d7-48a092b84a4e req-19764400-a77c-411b-a140-a8410a4691ee tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478959 Nov 24 04:20:02.062581 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-867c36da-c0c7-4a90-82b1-b385eeda1143 req-75eb7073-d3dc-486a-94cf-4a76bee45357 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:02.064056 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-867c36da-c0c7-4a90-82b1-b385eeda1143 req-75eb7073-d3dc-486a-94cf-4a76bee45357 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 945 time: 0.0504515 Nov 24 04:20:02.116098 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-867c36da-c0c7-4a90-82b1-b385eeda1143 req-40af96c7-50d7-46f3-86ed-f1b035e13725 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/security-groups?id=24432c86-d6a6-472e-bc33-a107b0436238&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461404 Nov 24 04:20:02.137720 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36862) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:20:02.177712 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afa4acb3-7910-411a-a288-1df0cbba43d4 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:02.179231 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-afa4acb3-7910-411a-a288-1df0cbba43d4 tempest-TestNetworkBasicOps-460105223 tempest-TestNetworkBasicOps-460105223-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1093 time: 0.0405056 Nov 24 04:20:02.181972 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.wsgi [-] (103380) accepted ('10.222.0.48', 36864) {{(pid=103380) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:20:02.186348 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.v2.base [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103380) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:20:02.210973 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:02.303881 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:02.407358 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.db_base_plugin_common [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Allocated IP 172.26.5.2 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/95b39d9e-2328-4d0e-88d0-78ff5f5e5a32) {{(pid=103380) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:20:02.506585 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:02.544017 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3452130'] for port, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:02.580613 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103380) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:20:02.586854 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.base_scheduler [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Resources bound (agent type, host, resource id): {{(pid=103380) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:20:02.590375 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Received port after_create {{(pid=103380) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:20:02.595792 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=95b39d9e-2328-4d0e-88d0-78ff5f5e5a32,revision_number=1']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:20:02.624471 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.624841 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.625182 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.625529 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.625870 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.626243 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.626582 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.626918 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.627256 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.627588 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.627919 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.628248 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-819049-1-hyperv {{(pid=103380) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 04:20:02.797983 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ceb25d-93c3-40bd-bec7-41d374806cf1 req-8ca767a9-7c37-4e78-b1b4-2538445a3fb5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:02.799535 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-15ceb25d-93c3-40bd-bec7-41d374806cf1 req-8ca767a9-7c37-4e78-b1b4-2538445a3fb5 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0484209 Nov 24 04:20:02.849594 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-15ceb25d-93c3-40bd-bec7-41d374806cf1 req-c4471b20-01b4-4954-a7a7-79c93908d030 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435457 Nov 24 04:20:02.962048 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:03.026475 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:03.174057 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks [] for port, precommit_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:03.178305 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3452137'] for port, after_update {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:03.244108 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Pushing event updated for resources: {'Port': ['ID=95b39d9e-2328-4d0e-88d0-78ff5f5e5a32,revision_number=2']} {{(pid=103380) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:20:03.255466 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:03.353398 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.db.l3_db [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Floating IP f9ede397-5dad-4356-8d12-6fae283bb408 associated. External IP: 172.26.5.2, port: 0848cd70-f6f9-4256-9ec2-89de03a6c528. Nov 24 04:20:03.557339 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103380) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:20:03.669892 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103380) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:20:03.679886 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] Sync routers for ids ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:20:03.687359 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron_lib.callbacks.manager [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103380) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:03.691184 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] Routers {'55ed6bfd-5725-4b98-80b3-19a067c4daf3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:20:03.691807 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:03.715791 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [None req-b163f6cc-d08e-442d-964a-f315e11e260d tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 994 time: 1.5327747 Nov 24 04:20:03.716386 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'tag': '0848cd70-f6f9-4256-9ec2-89de03a6c528'}] {{(pid=103380) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:20:03.718620 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36868) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:20:03.719144 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7759a2b25ef8475f544826cbaaaa67d2ba4bcfe69a6734afb8b8dc3bf9ee2689" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc62c7ba-34a6-41d8-9081-7659246d9c29" -d '{"events": [{"name": "network-changed", "server_uuid": "e8f801cf-0c20-4daf-b468-f4fcb4decd30", "tag": "0848cd70-f6f9-4256-9ec2-89de03a6c528"}]}' {{(pid=103380) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:20:03.787230 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-6a379573-1256-4ae7-be90-baa96011e461 tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f9ede397-5dad-4356-8d12-6fae283bb408 HTTP/1.1" status: 200 len: 989 time: 0.0655184 Nov 24 04:20:03.803948 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] Set router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:20:03.812831 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:20:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2276a38-11d2-470d-9bf6-d88a72e861e5 x-openstack-request-id: req-d2276a38-11d2-470d-9bf6-d88a72e861e5 {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:20:03.813139 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e8f801cf-0c20-4daf-b468-f4fcb4decd30", "tag": "0848cd70-f6f9-4256-9ec2-89de03a6c528", "status": "completed", "code": 200}]} {{(pid=103380) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:20:03.813403 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-d2276a38-11d2-470d-9bf6-d88a72e861e5 {{(pid=103380) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:20:03.813817 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'tag': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'status': 'completed', 'code': 200} Nov 24 04:20:03.884018 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-de4cb229-424e-4396-b649-fba40287adb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:03.886501 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-de4cb229-424e-4396-b649-fba40287adb5 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1098 time: 0.0467145 Nov 24 04:20:04.020841 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-6bba55ac-a7f9-45f1-b88f-892502ab2997 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:04.022378 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-6bba55ac-a7f9-45f1-b88f-892502ab2997 service neutron] 10.222.0.21 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 897 time: 0.1290462 Nov 24 04:20:04.030858 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd67e35-7a17-4a30-88fe-06f4d084e416 req-4a2c0cb6-29ba-4d53-89b0-464f6da0dd88 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:04.032285 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3bd67e35-7a17-4a30-88fe-06f4d084e416 req-4a2c0cb6-29ba-4d53-89b0-464f6da0dd88 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.1050782 Nov 24 04:20:04.036954 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f9ede397-5dad-4356-8d12-6fae283bb408', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.2', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'port_id': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1468, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'mac_address': 'fa:16:3e:62:ec:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:20:02Z', 'updated_at': '2021-11-24T04:20:02Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23404d4d-93c2-4a55-9e1c-ded3cb4d8900', 'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:00:d6:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:45Z', 'updated_at': '2021-11-24T04:19:50Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:04.066399 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] Checking router: 55ed6bfd-5725-4b98-80b3-19a067c4daf3 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:20:04.075710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] Routers {'55ed6bfd-5725-4b98-80b3-19a067c4daf3'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:20:04.076327 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:19:38Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:04.122351 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-54b68618-e729-4987-afd9-a006eb675ef4 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 997 time: 0.0890577 Nov 24 04:20:04.150025 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-3bd67e35-7a17-4a30-88fe-06f4d084e416 req-dd2f8072-6498-4280-a8fb-deb8cb0bc735 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1098092 Nov 24 04:20:04.183551 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] Set router 55ed6bfd-5725-4b98-80b3-19a067c4daf3 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:20:04.191782 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-f5dab325-4b68-46ea-ad81-0bfb631214c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:04.193655 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-f5dab325-4b68-46ea-ad81-0bfb631214c0 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e HTTP/1.1" status: 200 len: 843 time: 0.0615826 Nov 24 04:20:04.240891 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-67068e75-34de-437d-9b68-3be4b9fdd90e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:04.242378 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-67068e75-34de-437d-9b68-3be4b9fdd90e service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=1a812d30-6114-4cad-b423-6ec75bdfc93a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0404086 Nov 24 04:20:04.329972 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-df23cb80-cdcb-4485-8d4b-c68b9446ed46 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0804460 Nov 24 04:20:04.399568 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f9ede397-5dad-4356-8d12-6fae283bb408', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.2', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'port_id': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1468, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'mac_address': 'fa:16:3e:62:ec:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:20:02Z', 'updated_at': '2021-11-24T04:20:02Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23404d4d-93c2-4a55-9e1c-ded3cb4d8900', 'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:00:d6:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:45Z', 'updated_at': '2021-11-24T04:19:50Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:04.421618 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-dc62c7ba-34a6-41d8-9081-7659246d9c29 req-e60644a9-8120-4248-81b1-581691b8a98a service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847523 Nov 24 04:20:04.428730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f8cf98-a148-4bb0-9505-56bef0f0abbb None None] The sync data for ids ['55ed6bfd-5725-4b98-80b3-19a067c4daf3'] in dv-neutron-819049-1-hyperv is: [{'id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'name': 'tempest-TestNetworkBasicOps-router-558932156', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:47Z', 'revision_number': 4, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'gw_port': {'id': 'd99edfe2-0d19-47de-b515-bcdfaa7f18da', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2c:90:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1452, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:43Z', 'updated_at': '2021-11-24T04:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': 'f9ede397-5dad-4356-8d12-6fae283bb408', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'floating_ip_address': '172.26.5.2', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'port_id': '0848cd70-f6f9-4256-9ec2-89de03a6c528', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1468, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'mac_address': 'fa:16:3e:62:ec:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8f801cf-0c20-4daf-b468-f4fcb4decd30', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:20:02Z', 'updated_at': '2021-11-24T04:20:02Z', 'revision_number': 0, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23404d4d-93c2-4a55-9e1c-ded3cb4d8900', 'name': '', 'network_id': '1a812d30-6114-4cad-b423-6ec75bdfc93a', 'tenant_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'mac_address': 'fa:16:3e:00:d6:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55ed6bfd-5725-4b98-80b3-19a067c4daf3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:19:45Z', 'updated_at': '2021-11-24T04:19:50Z', 'revision_number': 5, 'project_id': 'b951944bf1f44ed1b10939b3ae3d3197', 'subnets': [{'id': '31184df2-a9f4-43b1-8eb0-7f8c38f6a67e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:20:04.614692 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cdc0c0b-5db6-4a17-9bb9-ed14c88025e1 None None] New status for floating IP f9ede397-5dad-4356-8d12-6fae283bb408: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:20:04.789323 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36876) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:20:04.847950 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-faf03559-9ccc-4ff6-9b91-0f3d5025ff2b tempest-TestNetworkBasicOps-1670795509 tempest-TestNetworkBasicOps-1670795509-project] 10.222.0.48 "GET /v2.0/floatingips/f9ede397-5dad-4356-8d12-6fae283bb408 HTTP/1.1" status: 200 len: 991 time: 0.0574851 Nov 24 04:20:04.962628 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f5814540-32fd-4c9a-b130-89c83c58983c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:05.266227 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee54f241-8bdb-4760-9b27-228b26e1291e req-7da7b33f-371c-4842-a4b1-48347543ef77 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:05.267697 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ee54f241-8bdb-4760-9b27-228b26e1291e req-7da7b33f-371c-4842-a4b1-48347543ef77 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0483842 Nov 24 04:20:05.315149 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-ee54f241-8bdb-4760-9b27-228b26e1291e req-66afc9ce-a7b2-43fb-a652-10adcfdf658d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417209 Nov 24 04:20:06.428631 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58848225-b8e9-438c-b39e-7f7322f5fee3 req-56aa2e24-bb79-45b9-afbb-f94242345453 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:06.430067 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-58848225-b8e9-438c-b39e-7f7322f5fee3 req-56aa2e24-bb79-45b9-afbb-f94242345453 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0508120 Nov 24 04:20:06.478455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-58848225-b8e9-438c-b39e-7f7322f5fee3 req-717dc965-1059-4ca0-9fbc-df2db1876120 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412207 Nov 24 04:20:07.594387 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef0efd7-e045-4bcb-9229-6950a08ddc0b req-6b095263-2c1f-4449-9d6d-796cbc27cadc tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:07.595848 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7ef0efd7-e045-4bcb-9229-6950a08ddc0b req-6b095263-2c1f-4449-9d6d-796cbc27cadc tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0516775 Nov 24 04:20:07.644680 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-7ef0efd7-e045-4bcb-9229-6950a08ddc0b req-b4ae7b6b-34de-48db-9343-804ef012343b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428941 Nov 24 04:20:07.965766 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-4a85c420-fff5-431b-b45d-4714966f5eeb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:08.756742 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21c61a6-d48f-48e2-939b-2036daf0d271 req-b09f7d74-1e43-47c2-9308-7d3359598934 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:08.758187 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a21c61a6-d48f-48e2-939b-2036daf0d271 req-b09f7d74-1e43-47c2-9308-7d3359598934 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 944 time: 0.0486419 Nov 24 04:20:08.777255 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:08.807669 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a21c61a6-d48f-48e2-939b-2036daf0d271 req-d745b1a9-f113-4228-93b2-f6a31456189a tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435171 Nov 24 04:20:09.344673 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c3ae7427-f5a6-4b83-8b79-7daa425fa824 details requested by agent hyperv_hv-neutron-8190 with host hv-neutron-8190 {{(pid=103382) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 04:20:09.438234 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c3ae7427-f5a6-4b83-8b79-7daa425fa824, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:20:09.449603 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Returning: {'device': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'port_id': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'mac_address': 'fa:16:3e:5a:65:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103382) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 04:20:09.489508 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:09.502385 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c3ae7427-f5a6-4b83-8b79-7daa425fa824 {{(pid=103382) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 04:20:09.521870 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c3ae7427-f5a6-4b83-8b79-7daa425fa824, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:20:09.525924 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:09.574465 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=c3ae7427-f5a6-4b83-8b79-7daa425fa824,revision_number=4']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:20:09.737020 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] get_ports_and_sgs() called for port_ids ['c3ae7427-f5a6-4b83-8b79-7daa425fa824'] {{(pid=103382) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 04:20:09.922307 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b278cc49-f34a-4d79-8447-da4dbaeeab01 req-414a9eb1-a110-4e76-a302-8a5acab93e9d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:09.923818 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b278cc49-f34a-4d79-8447-da4dbaeeab01 req-414a9eb1-a110-4e76-a302-8a5acab93e9d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 945 time: 0.0480330 Nov 24 04:20:09.972477 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-b278cc49-f34a-4d79-8447-da4dbaeeab01 req-4ed759dd-77d6-4e5d-9b46-8517f4fb99da tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426426 Nov 24 04:20:10.101048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:10.868622 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:11.086036 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedb4ca3-ff00-414e-9df3-919a37e860fb req-c0b14e9b-02cf-4723-a9e3-039eadd0b790 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:11.087423 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fedb4ca3-ff00-414e-9df3-919a37e860fb req-c0b14e9b-02cf-4723-a9e3-039eadd0b790 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 945 time: 0.0500457 Nov 24 04:20:11.141564 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-fedb4ca3-ff00-414e-9df3-919a37e860fb req-1ae96944-0fe9-4c7b-9362-b5e3d9877342 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454128 Nov 24 04:20:11.368532 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Device c3ae7427-f5a6-4b83-8b79-7daa425fa824 up at agent hyperv_hv-neutron-8190 {{(pid=103382) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 04:20:11.430542 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning for port c3ae7427-f5a6-4b83-8b79-7daa425fa824 completed by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 04:20:11.434099 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.provisioning_blocks [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Provisioning complete for port c3ae7427-f5a6-4b83-8b79-7daa425fa824 triggered by entity L2. {{(pid=103382) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 04:20:11.434496 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16524419'] for port, provisioning_complete {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:11.649664 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:11.670769 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824'}] {{(pid=103382) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:20:11.672999 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a18b22c402edea7107c7431b913958ec3f3d2bdc07a96956cdcdf9663995a6fe" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ef202d9-0413-4ef3-b260-6855771252fe" -d '{"events": [{"server_uuid": "543fd16a-cfae-4f78-9a30-1594f6e24f33", "name": "network-vif-plugged", "status": "completed", "tag": "c3ae7427-f5a6-4b83-8b79-7daa425fa824"}]}' {{(pid=103382) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:20:11.685710 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.plugins.ml2.db [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] For port c3ae7427-f5a6-4b83-8b79-7daa425fa824, host hv-neutron-8190, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8190',level=0,port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824,segment=NetworkSegment(19c8da9b-b324-412b-a4ed-2230d609e8ef),segment_id=19c8da9b-b324-412b-a4ed-2230d609e8ef)] {{(pid=103382) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 04:20:11.689824 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669'] for port, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:11.713241 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 04:20:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03c0cc1a-686b-42c6-a87e-6e9b67fefe64 x-openstack-request-id: req-03c0cc1a-686b-42c6-a87e-6e9b67fefe64 {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:20:11.713540 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "543fd16a-cfae-4f78-9a30-1594f6e24f33", "name": "network-vif-plugged", "status": "completed", "tag": "c3ae7427-f5a6-4b83-8b79-7daa425fa824", "code": 200}]} {{(pid=103382) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:20:11.713797 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-03c0cc1a-686b-42c6-a87e-6e9b67fefe64 {{(pid=103382) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:20:11.714261 dv-neutron-819049-1-hyperv neutron-server[103382]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'code': 200} Nov 24 04:20:11.741950 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Pushing event updated for resources: {'Port': ['ID=c3ae7427-f5a6-4b83-8b79-7daa425fa824,revision_number=5']} {{(pid=103382) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:20:11.889158 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a0a1c7-7713-409c-aa64-20fb533b5aa8 req-48d4c9bc-b3c2-4b5a-b454-f02da2663e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:11.890624 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a8a0a1c7-7713-409c-aa64-20fb533b5aa8 req-48d4c9bc-b3c2-4b5a-b454-f02da2663e56 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1099 time: 0.0396347 Nov 24 04:20:11.936891 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-a8a0a1c7-7713-409c-aa64-20fb533b5aa8 req-3e9d4234-fdb5-43f3-8d6a-7c8addceb948 service neutron] 10.222.0.21 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385039 Nov 24 04:20:12.221510 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:12.253885 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e730a50-c4e7-46c3-b592-dc79a2a0d57c req-2c73c61c-1676-4417-b756-e35f242d1305 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:12.255371 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9e730a50-c4e7-46c3-b592-dc79a2a0d57c req-2c73c61c-1676-4417-b756-e35f242d1305 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 946 time: 0.0483482 Nov 24 04:20:12.303208 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-9e730a50-c4e7-46c3-b592-dc79a2a0d57c req-25fccb11-d937-44f5-a2cf-a5dab715496d tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418358 Nov 24 04:20:13.386585 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:20:13.420396 dv-neutron-819049-1-hyperv neutron-server[103380]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3447fdc1-60df-4e46-a903-78c388b3d85d req-199b4e9d-1358-4f70-ac37-f3d1cd3a9886 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103380) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:13.421872 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3447fdc1-60df-4e46-a903-78c388b3d85d req-199b4e9d-1358-4f70-ac37-f3d1cd3a9886 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 946 time: 0.0514989 Nov 24 04:20:13.469629 dv-neutron-819049-1-hyperv neutron-server[103380]: INFO neutron.wsgi [req-3447fdc1-60df-4e46-a903-78c388b3d85d req-9cdae6b9-6182-46ee-a8e5-c94f24915c1b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418637 Nov 24 04:20:13.583897 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a824e2-d67b-44c0-af27-599cdd16f28c req-44f41a6a-7aec-4c09-bd39-89bcb9aca3b3 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:13.585246 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-60a824e2-d67b-44c0-af27-599cdd16f28c req-44f41a6a-7aec-4c09-bd39-89bcb9aca3b3 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 946 time: 0.0509717 Nov 24 04:20:13.633043 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-60a824e2-d67b-44c0-af27-599cdd16f28c req-31be4586-c33d-4d84-ad83-02f15969ccd3 tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "GET /v2.0/security-groups?id=6a16d4b2-5d18-452b-9b60-5cd39326b89c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419030 Nov 24 04:20:13.654958 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36898) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:20:13.693461 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99063206-a6f4-475b-85e0-aeaa9290016e tempest-TestVolumeBootPattern-1619669075 tempest-TestVolumeBootPattern-1619669075-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:13.694958 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-99063206-a6f4-475b-85e0-aeaa9290016e tempest-TestVolumeBootPattern-1619669075 tempest-TestVolumeBootPattern-1619669075-project-admin] 10.222.0.48 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1094 time: 0.0390368 Nov 24 04:20:13.697837 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.wsgi [-] (103381) accepted ('10.222.0.48', 36900) {{(pid=103381) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 04:20:13.701968 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.v2.base [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Request body: {'floatingip': {'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'port_id': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103381) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 04:20:13.723670 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for floatingip, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:13.820129 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:13.920449 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.db_base_plugin_common [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Allocated IP 172.26.5.106 (f70b2100-2610-4e2a-8841-1763c44a2ca9/3754be7e-8738-44a0-8cf7-94c154ac7d80/eca3f921-bc58-49fa-908d-3e71cd74e9d4) {{(pid=103381) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 04:20:14.019697 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for port, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:14.052287 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8769089469633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3285179'] for port, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:14.091509 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Network f70b2100-2610-4e2a-8841-1763c44a2ca9 is already hosted by enough agents. {{(pid=103381) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 04:20:14.094317 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.base_scheduler [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Resources bound (agent type, host, resource id): {{(pid=103381) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 04:20:14.097693 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Received port after_create {{(pid=103381) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 04:20:14.103213 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'Port': ['ID=eca3f921-bc58-49fa-908d-3e71cd74e9d4,revision_number=1']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:20:14.775511 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:14.850383 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16292232'] for port, before_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:14.999020 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks [] for port, precommit_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:15.003474 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16293709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33420', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-556582', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8769089900526', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8769089469651', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8769089469669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3285168'] for port, after_update {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:15.077389 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Pushing event updated for resources: {'Port': ['ID=eca3f921-bc58-49fa-908d-3e71cd74e9d4,revision_number=2']} {{(pid=103381) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 04:20:15.085773 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-664503'] for floatingip, after_create {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:15.185461 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.db.l3_db [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Floating IP 179e48b6-e6a5-4119-bc88-b3e1626ecf73 associated. External IP: 172.26.5.106, port: c3ae7427-f5a6-4b83-8b79-7daa425fa824. Nov 24 04:20:15.386559 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Router b3b4882e-8f09-451f-9384-42d336c1f444 has already been hosted by L3 agent 2002a118-72c5-4068-a563-991fad169d6e {{(pid=103381) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 04:20:15.491607 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Notify agent at l3_agent.dv-neutron-819049-1-hyperv the message routers_updated {{(pid=103381) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 04:20:15.501964 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] Sync routers for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 04:20:15.512225 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron_lib.callbacks.manager [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-473776'] for floatingip, before_response {{(pid=103381) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:15.512754 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:20:15.513394 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:20:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:15.539843 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [None req-d6df6648-a485-4fd8-afc0-4adddfba9c7b tempest-TestVolumeBootPattern-1493203035 tempest-TestVolumeBootPattern-1493203035-project] 10.222.0.48 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8409848 Nov 24 04:20:15.540668 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'tag': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824'}] {{(pid=103381) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 04:20:15.543783 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.48/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a4f9b0e03c414dcff75974ace9f94067a7f7c47dfe4bdbeda258064e7d6d284" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93a6c57e-26d3-466c-a3e3-1851ec764365" -d '{"events": [{"name": "network-changed", "server_uuid": "543fd16a-cfae-4f78-9a30-1594f6e24f33", "tag": "c3ae7427-f5a6-4b83-8b79-7daa425fa824"}]}' {{(pid=103381) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 04:20:15.579840 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 04:20:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-712237a7-6597-45d2-9379-5032be5a8930 x-openstack-request-id: req-712237a7-6597-45d2-9379-5032be5a8930 {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 04:20:15.580130 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "543fd16a-cfae-4f78-9a30-1594f6e24f33", "tag": "c3ae7427-f5a6-4b83-8b79-7daa425fa824", "status": "completed", "code": 200}]} {{(pid=103381) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 04:20:15.580386 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.48/compute/v2.1/os-server-external-events used request id req-712237a7-6597-45d2-9379-5032be5a8930 {{(pid=103381) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 04:20:15.580787 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'tag': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'status': 'completed', 'code': 200} Nov 24 04:20:15.621935 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:20:15.647994 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-5f7d012a-7d02-4960-8aa6-9b054106b831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:15.649399 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-5f7d012a-7d02-4960-8aa6-9b054106b831 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1099 time: 0.0445397 Nov 24 04:20:15.737498 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-dad670c4-7708-4713-9a06-804df09bb03a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:15.739030 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-dad670c4-7708-4713-9a06-804df09bb03a service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0827067 Nov 24 04:20:15.806663 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-6d4ed968-ec28-4d5f-b9a4-d8936e1f4fa5 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 1000 time: 0.0607731 Nov 24 04:20:15.839993 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '179e48b6-e6a5-4119-bc88-b3e1626ecf73', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'floating_ip_address': '172.26.5.106', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'port_id': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1470, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'mac_address': 'fa:16:3e:5a:65:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:20:14Z', 'updated_at': '2021-11-24T04:20:14Z', 'revision_number': 0, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:15.855236 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-8d9efec9-c887-4458-9ed4-c576963fc565 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:15.856707 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-8d9efec9-c887-4458-9ed4-c576963fc565 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0437386 Nov 24 04:20:15.865653 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] Checking router: b3b4882e-8f09-451f-9384-42d336c1f444 for host: dv-neutron-819049-1-hyperv {{(pid=103382) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 04:20:15.874179 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] Routers {'b3b4882e-8f09-451f-9384-42d336c1f444'} bound to L3 agent in host dv-neutron-819049-1-hyperv {{(pid=103382) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 04:20:15.874805 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-819049-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T04:01:07Z,description=,heartbeat_timestamp=2021-11-24T04:20:08Z,host='dv-neutron-819049-1-hyperv',id=2002a118-72c5-4068-a563-991fad169d6e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T04:01:07Z,topic='l3_agent')) {'router_ids': ['b3b4882e-8f09-451f-9384-42d336c1f444'], 'active': True} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:15.903798 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-f1819b9c-0143-4d2f-bb90-43f9099e81be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:15.905204 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-f1819b9c-0143-4d2f-bb90-43f9099e81be service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407917 Nov 24 04:20:15.979624 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_dvr_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] Set router b3b4882e-8f09-451f-9384-42d336c1f444 gateway port host: dv-neutron-819049-1-hyperv {{(pid=103382) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 04:20:16.000372 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-bac33f8a-2bf1-4149-ac5b-e0a3f1e0b3cf service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859220 Nov 24 04:20:16.092054 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-93a6c57e-26d3-466c-a3e3-1851ec764365 req-5ec4ef16-0e41-4f7b-bdb6-d3b68bda357b service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827127 Nov 24 04:20:16.205730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.db.l3_hamode_db [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '179e48b6-e6a5-4119-bc88-b3e1626ecf73', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'floating_ip_address': '172.26.5.106', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'port_id': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1470, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'mac_address': 'fa:16:3e:5a:65:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:20:14Z', 'updated_at': '2021-11-24T04:20:14Z', 'revision_number': 0, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-819049-1-hyperv', False) {} {{(pid=103382) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 04:20:16.231404 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83aa6b27-cdfd-4b16-a81e-30b273e28801 None None] The sync data for ids ['b3b4882e-8f09-451f-9384-42d336c1f444'] in dv-neutron-819049-1-hyperv is: [{'id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'name': 'tempest-TestVolumeBootPattern-760561520-router', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'external_fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61'}], 'enable_snat': True}, 'gw_port_id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T04:16:55Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'gw_port': {'id': '26ae2d98-1602-4ac7-959b-a544eed04539', 'name': '', 'network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:70:01:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1366, 'fixed_ips': [{'subnet_id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'ip_address': '172.26.5.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:56Z', 'updated_at': '2021-11-24T04:16:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3754be7e-8738-44a0-8cf7-94c154ac7d80', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-819049-1-hyperv', '_floatingips': [{'id': '179e48b6-e6a5-4119-bc88-b3e1626ecf73', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'floating_ip_address': '172.26.5.106', 'floating_network_id': 'f70b2100-2610-4e2a-8841-1763c44a2ca9', 'router_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'port_id': 'c3ae7427-f5a6-4b83-8b79-7daa425fa824', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1470, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'mac_address': 'fa:16:3e:5a:65:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '543fd16a-cfae-4f78-9a30-1594f6e24f33', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T04:20:14Z', 'updated_at': '2021-11-24T04:20:14Z', 'revision_number': 0, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ea347121-5e2a-4526-aeef-23275e92ec96', 'name': '', 'network_id': '4db6f33c-c141-4219-ad0f-97dfea0992c0', 'tenant_id': 'a953770267d4499382d1c4d95a04322e', 'mac_address': 'fa:16:3e:cf:0e:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3b4882e-8f09-451f-9384-42d336c1f444', 'device_owner': 'network:router_interface', 'standard_attr_id': 1367, 'fixed_ips': [{'subnet_id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-819049-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T04:16:58Z', 'updated_at': '2021-11-24T04:17:03Z', 'revision_number': 5, 'project_id': 'a953770267d4499382d1c4d95a04322e', 'subnets': [{'id': 'ba4b836b-28d1-471d-a461-f54951a2cf23', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103382) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 04:20:16.403021 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c487921-e682-4875-b35c-37aca0cd9087 None None] New status for floating IP 179e48b6-e6a5-4119-bc88-b3e1626ecf73: ACTIVE {{(pid=103383) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 04:20:34.963854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-0600c38b-d755-45f6-a465-5142bfe7593b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:37.967649 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-da596726-e5b1-478a-8a6a-ce1483f4a827 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:38.779347 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:40.103430 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:40.871060 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:42.239690 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:20:50.384891 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:20:53.846826 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-7a1d346b-7f5d-4ede-9bf8-3f7fb8a6a9c4 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391746 Nov 24 04:20:53.928549 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cc7745-d198-429d-8625-72c0907342f1 req-e998b178-809b-4fb9-bc29-e0ca348c3bba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:53.930032 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-e998b178-809b-4fb9-bc29-e0ca348c3bba service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1098 time: 0.0406556 Nov 24 04:20:54.037257 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cc7745-d198-429d-8625-72c0907342f1 req-d2e61804-0945-4b66-9e2c-08979b341b01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:54.038764 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-d2e61804-0945-4b66-9e2c-08979b341b01 service neutron] 10.222.0.21 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 897 time: 0.0898228 Nov 24 04:20:54.105050 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-8dbbd095-4269-4328-8fe6-62e42809017f service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 999 time: 0.0585325 Nov 24 04:20:54.156989 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cc7745-d198-429d-8625-72c0907342f1 req-f14eab1e-ee2e-4692-aa71-e311366ae72b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:54.158434 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-f14eab1e-ee2e-4692-aa71-e311366ae72b service neutron] 10.222.0.21 "GET /v2.0/subnets?id=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e HTTP/1.1" status: 200 len: 843 time: 0.0458388 Nov 24 04:20:54.202612 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cc7745-d198-429d-8625-72c0907342f1 req-fbe64d55-7a9e-47d8-9b7c-d16738381d65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:20:54.204048 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-fbe64d55-7a9e-47d8-9b7c-d16738381d65 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=1a812d30-6114-4cad-b423-6ec75bdfc93a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389781 Nov 24 04:20:54.291312 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-7a950e94-406b-4d42-aba5-befc6cf4700c service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801790 Nov 24 04:20:54.382498 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-50cc7745-d198-429d-8625-72c0907342f1 req-aa6f981d-6fd8-4513-989b-4095483a80e4 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833802 Nov 24 04:21:04.964674 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-b3d32897-ac86-4d3e-889b-a01b54fd97dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:07.968913 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-fd221a99-afd3-4abf-ab3b-d1bc450b8349 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:08.782577 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:10.102201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:10.872204 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:12.242240 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:27.384054 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:21:34.969469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e0ca38e8-8591-49f0-8925-3fa70fae97f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:37.969469 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-afe3a1e5-52ff-4dc4-a646-b552e752b694 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:38.784507 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:40.105450 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:40.872953 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:42.239989 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:21:55.079875 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-971ee8c7-367d-48ba-a2d0-13351a70a13d service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0425537 Nov 24 04:21:55.141202 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-f9e6a7fa-eb29-4af8-ae00-3d6a0edf39c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:21:55.142668 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-f9e6a7fa-eb29-4af8-ae00-3d6a0edf39c9 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1099 time: 0.0388441 Nov 24 04:21:55.242967 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-14880004-e8f9-4d01-8136-65601441041b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:21:55.244309 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-14880004-e8f9-4d01-8136-65601441041b service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0815747 Nov 24 04:21:55.318516 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-89fec0c0-670b-4ac6-9f1e-cd377ccfa9b5 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 1002 time: 0.0659573 Nov 24 04:21:55.366573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-a972af06-97f2-4f6a-909d-ab6b8e04c3b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:21:55.367971 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-a972af06-97f2-4f6a-909d-ab6b8e04c3b8 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0432620 Nov 24 04:21:55.414896 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-d5e52d4c-2bbc-4b6f-beb3-2b9b070be1f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:21:55.416385 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-d5e52d4c-2bbc-4b6f-beb3-2b9b070be1f5 service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407045 Nov 24 04:21:55.514096 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-e0353dde-dfe1-4a0f-b090-2a7de2113536 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894508 Nov 24 04:21:55.610898 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-f09d5680-c330-4d0b-ad44-796f1d3d7cd4 req-9ce989b3-c063-4ee2-9e4d-b3ea0b521540 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882895 Nov 24 04:22:04.382923 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:22:04.971411 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-bfbb8f2c-fd6e-4e68-9cc6-ce6d729ebd22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:07.970129 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-32ef126c-61a1-4aff-95d8-57cbfe89a41b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:08.790509 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:10.109330 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:10.876165 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:12.254467 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:34.973188 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1c2e49a1-d7a3-4d47-aab6-a0c4a5cf6f0e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:37.970885 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-d92ebf5d-2e94-4928-b896-16d6b1ea4cee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:38.790201 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:40.112890 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:40.885035 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:41.381195 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:22:42.268225 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:22:56.308100 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-e9e3cc79-4fdc-4042-8657-2e5436141eb6 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390387 Nov 24 04:22:56.396115 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-afeaf2bd-8d8f-4604-ac49-cf7b9646ae67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:22:56.397583 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-afeaf2bd-8d8f-4604-ac49-cf7b9646ae67 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1098 time: 0.0447807 Nov 24 04:22:56.500378 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-d816b423-7e20-479e-872c-99ba2d0aeb02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:22:56.501844 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-d816b423-7e20-479e-872c-99ba2d0aeb02 service neutron] 10.222.0.21 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 897 time: 0.0853398 Nov 24 04:22:56.567817 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-d7d5a9e8-622f-4363-98ae-329b45b335ff service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 999 time: 0.0557544 Nov 24 04:22:56.620134 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-dbae6044-c39b-41fc-be01-be1a6abf83e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:22:56.621578 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-dbae6044-c39b-41fc-be01-be1a6abf83e7 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e HTTP/1.1" status: 200 len: 843 time: 0.0472751 Nov 24 04:22:56.666483 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-4ab6f7d5-0187-4be7-91fb-17f0f98773dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:22:56.667966 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-4ab6f7d5-0187-4be7-91fb-17f0f98773dc service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=1a812d30-6114-4cad-b423-6ec75bdfc93a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0395439 Nov 24 04:22:56.757026 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-d4429616-4a8d-4436-a0f4-50e905e96f09 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815382 Nov 24 04:22:56.848877 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-39e1b947-9390-4bdb-a9c2-af5823cb38ba req-fc760567-0a52-45cc-9056-67e75aa10481 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841379 Nov 24 04:23:04.974574 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-6362d4e6-a97d-4a9d-9071-564edccc3a5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:07.972289 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-92c8ec1c-3b34-4e72-b64f-0683366a9ff4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:08.793786 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:10.113637 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:10.876779 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:12.268124 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:18.380156 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:23:34.975800 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a9743161-9698-4b3b-bb4b-500f790aef62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:37.976304 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-5210c27c-546c-4a87-9a2a-f481e9020307 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:38.795930 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:40.115554 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:40.880226 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:42.282730 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:23:55.378785 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:23:57.376361 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-7746684e-3c77-48ec-81df-81e87fb7558c service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1074598 Nov 24 04:23:57.437328 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-2d138bcb-2fe5-4c45-81e3-ae18d9453798 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:23:57.438824 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-2d138bcb-2fe5-4c45-81e3-ae18d9453798 service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1099 time: 0.0400102 Nov 24 04:23:57.542851 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-a7b31cf4-6545-4fb2-8e59-1744cec9db0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:23:57.544780 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-a7b31cf4-6545-4fb2-8e59-1744cec9db0e service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0861363 Nov 24 04:23:57.610701 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-e6a265d8-8576-41b8-a46e-068404bf45f1 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 1002 time: 0.0587184 Nov 24 04:23:57.666284 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-ba3cab91-5618-41d5-ac41-470309e6284a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:23:57.668713 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-ba3cab91-5618-41d5-ac41-470309e6284a service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0504735 Nov 24 04:23:57.720087 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-367b7b87-ca57-4ca0-9b86-759cccdcd2ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:23:57.721587 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-367b7b87-ca57-4ca0-9b86-759cccdcd2ec service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0462577 Nov 24 04:23:57.811141 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-2d0911a7-fab2-4de8-8dd9-9029033f38c2 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810075 Nov 24 04:23:57.912966 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-c451de4e-690f-4a32-8f79-1eff63dc0f0a req-e42fbfd6-c3c3-4613-9fa5-4cc73dfc597e service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951374 Nov 24 04:24:04.977254 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a2213dfb-d3da-447f-8977-d0b2e9362066 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:07.978341 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-db9891b6-6641-48e4-871c-9bc0e6341f62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:08.800148 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:10.118429 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:10.884656 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:12.281662 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:32.377609 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:24:34.978717 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-eb75f9b4-877d-46e6-bb20-13450df10661 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:37.979278 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a30e5c2e-38d6-4b1b-846f-c74e60a85ae3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:38.801031 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:40.121048 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:40.885901 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:42.300636 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:24:57.861549 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-976a81bb-87d2-4b19-83c7-1cc4eef5af84 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390060 Nov 24 04:24:57.946574 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf96f353-f387-4927-b669-863b597c1f6e req-96df0f8d-1c10-47e7-871f-36ab8476ef5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:24:57.948092 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-96df0f8d-1c10-47e7-871f-36ab8476ef5a service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=b951944bf1f44ed1b10939b3ae3d3197&device_id=e8f801cf-0c20-4daf-b468-f4fcb4decd30 HTTP/1.1" status: 200 len: 1098 time: 0.0441325 Nov 24 04:24:58.048249 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf96f353-f387-4927-b669-863b597c1f6e req-9fc73316-4982-4ce8-a3a5-b11b43e0237a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:24:58.049691 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-9fc73316-4982-4ce8-a3a5-b11b43e0237a service neutron] 10.222.0.21 "GET /v2.0/networks?id=1a812d30-6114-4cad-b423-6ec75bdfc93a HTTP/1.1" status: 200 len: 897 time: 0.0825374 Nov 24 04:24:58.118039 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-7926ef77-93d7-4396-970e-c5c99b03fea8 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0848cd70-f6f9-4256-9ec2-89de03a6c528 HTTP/1.1" status: 200 len: 999 time: 0.0615060 Nov 24 04:24:58.166076 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf96f353-f387-4927-b669-863b597c1f6e req-5a70773a-01cf-4bf1-961b-171594de9b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:24:58.167501 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-5a70773a-01cf-4bf1-961b-171594de9b44 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=31184df2-a9f4-43b1-8eb0-7f8c38f6a67e HTTP/1.1" status: 200 len: 843 time: 0.0422606 Nov 24 04:24:58.213121 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf96f353-f387-4927-b669-863b597c1f6e req-3b661ac2-b8b5-4087-947d-7e719b5c6baa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:24:58.214535 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-3b661ac2-b8b5-4087-947d-7e719b5c6baa service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=1a812d30-6114-4cad-b423-6ec75bdfc93a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0391521 Nov 24 04:24:58.306532 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-256da152-2631-4d06-9b64-396a4cd2cd0f service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842130 Nov 24 04:24:58.394464 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-bf96f353-f387-4927-b669-863b597c1f6e req-1b14af87-4a1e-43ea-b7ea-be23e20dabd7 service neutron] 10.222.0.21 "GET /v2.0/networks/1a812d30-6114-4cad-b423-6ec75bdfc93a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809398 Nov 24 04:25:04.979685 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-a8d3fc60-8b71-401e-b6fe-d67faab86fe6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:07.995229 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-1fcad14b-df60-43ca-9637-c9ac90c266e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:08.805920 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:09.376959 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:25:10.123854 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:10.886978 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:12.301946 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:34.982334 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-9e7dfec3-366a-4a44-93c9-28ec4bda66ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:37.976447 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-ad5b3d54-afde-44de-aab9-1e23f414de1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:38.805544 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-11a33bd8-8992-4352-ab67-2f6c2db92291 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:40.126671 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-e8cb8099-1e44-4e91-9d23-775131991780 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:40.888968 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-f2b8e165-eb5f-415c-bc2a-2dddca400970 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:42.311646 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-580a1b52-7a15-4e2a-8a85-7779243becb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 04:25:46.375894 dv-neutron-819049-1-hyperv neutron-server[103383]: DEBUG neutron.db.agents_db [None req-639f17a1-2e59-4d7c-824e-6bd89da3e9ef None None] Agent healthcheck: found 6 active agents {{(pid=103383) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 04:25:58.298192 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-d52fd416-9e6b-4fbb-8296-ab78ba5c0ee6 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0389702 Nov 24 04:25:58.357984 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-93fd3147-1fda-4a73-80a3-93528636c7be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:25:58.359455 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-93fd3147-1fda-4a73-80a3-93528636c7be service neutron] 10.222.0.21 "GET /v2.0/ports?tenant_id=a953770267d4499382d1c4d95a04322e&device_id=543fd16a-cfae-4f78-9a30-1594f6e24f33 HTTP/1.1" status: 200 len: 1099 time: 0.0400250 Nov 24 04:25:58.468767 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-2cee85d1-ee21-4809-85d5-2047cc58ae0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:25:58.470231 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-2cee85d1-ee21-4809-85d5-2047cc58ae0a service neutron] 10.222.0.21 "GET /v2.0/networks?id=4db6f33c-c141-4219-ad0f-97dfea0992c0 HTTP/1.1" status: 200 len: 912 time: 0.0868762 Nov 24 04:25:58.538544 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-4e196bf0-6cfa-421f-be68-c3d036e5c740 service neutron] 10.222.0.21 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c3ae7427-f5a6-4b83-8b79-7daa425fa824 HTTP/1.1" status: 200 len: 1002 time: 0.0613286 Nov 24 04:25:58.590573 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-03ddcbae-ac0a-49e8-a034-eebe8ddca6d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:25:58.592546 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-03ddcbae-ac0a-49e8-a034-eebe8ddca6d9 service neutron] 10.222.0.21 "GET /v2.0/subnets?id=ba4b836b-28d1-471d-a461-f54951a2cf23 HTTP/1.1" status: 200 len: 850 time: 0.0467737 Nov 24 04:25:58.637833 dv-neutron-819049-1-hyperv neutron-server[103381]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-353d08de-61d5-42bc-b81f-c8a2a9baa7fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103381) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 04:25:58.639871 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-353d08de-61d5-42bc-b81f-c8a2a9baa7fc service neutron] 10.222.0.21 "GET /v2.0/ports?network_id=4db6f33c-c141-4219-ad0f-97dfea0992c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0404515 Nov 24 04:25:58.725731 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-01fa44b1-8380-4127-86d7-364df02f43f6 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789049 Nov 24 04:25:58.818012 dv-neutron-819049-1-hyperv neutron-server[103381]: INFO neutron.wsgi [req-57c31c11-2c55-49b8-9143-37071874e2b4 req-c3b0830a-b2f4-4e33-b50a-93cf53682372 service neutron] 10.222.0.21 "GET /v2.0/networks/4db6f33c-c141-4219-ad0f-97dfea0992c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847855 Nov 24 04:26:04.984858 dv-neutron-819049-1-hyperv neutron-server[103382]: DEBUG neutron_lib.callbacks.manager [None req-df1f0db4-800a-40bb-bdfd-5ff491c4d546 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8769089995713', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16531286'] for agent, after_update {{(pid=103382) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}}